Understanding Cloud Infrastructure: Costs, Limits and Trade-offs

Consider cloud infrastructure specifically. The interesting number is not the average, it is the 99th percentile. Cloud Infrastructure: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Every abstraction you add is a place where behaviour can differ from intent. That applies to cloud infrastructure as well.

Teams working on search indexing usually discover this the hard way. A design that cannot be rolled back is a design that cannot be changed safely. Latency budgets are easier to defend when every hop has a stated ceiling. This is most visible in search indexing. Consider search indexing specifically. Caching helps only until the invalidation rules become the bottleneck.

A queue smooths spikes but also hides how far behind you are. This is most visible in rate limiting. Consider rate limiting specifically. Retries without jitter turn a small outage into a large one. Rate Limiting: Separating the reads from the writes buys room to change either side.

Consider log analysis specifically. If the rollback plan needs a meeting, it is not a rollback plan. Log Analysis: Small pages that stay small are easier to keep fast than large ones made fast. Write the invariant down; otherwise it lives only in someone's memory. That applies to log analysis as well.

Queue Design: If the rollback plan needs a meeting, it is not a rollback plan. Queue Design: Small pages that stay small are easier to keep fast than large ones made fast. Queue Design: Write the invariant down; otherwise it lives only in someone's memory.

Schema Migration: Configurations should be reviewable in a diff, not only in a console. Schema Migration: The best time to add an index is before the table gets large. Schema Migration: Failures are usually correlated, so plan for the shared dependency.

The interesting number is not the average, it is the 99th percentile. The same reasoning holds for crawl budget. For crawl budget, the constraint matters more than the feature list. Adding a cache in front of a slow query is a fix; fixing the query is a cure. Teams working on crawl budget usually discover this the hard way. Every abstraction you add is a place where behaviour can differ from intent.

In practice, crawl budget behaves differently: If a metric has no owner, it will drift until it causes an incident. The cheapest optimisation is usually removing work nobody asked for. The same reasoning holds for crawl budget. For crawl budget, the constraint matters more than the feature list. Aggregating at write time trades flexibility for predictable read cost.

Storage Tiers: A queue smooths spikes but also hides how far behind you are. Storage Tiers: Retries without jitter turn a small outage into a large one. Storage Tiers: Separating the reads from the writes buys room to change either side.

Log Analysis: Serving static bytes is the cheapest thing you can do at the edge. Log Analysis: A schema is an interface; changing it is a migration, not an edit. Log Analysis: Track the denominator as carefully as the numerator.

If the rollback plan needs a meeting, it is not a rollback plan. That applies to edge caching as well. In practice, edge caching behaves differently: Small pages that stay small are easier to keep fast than large ones made fast. Write the invariant down; otherwise it lives only in someone's memory. The same reasoning holds for edge caching.

Search Indexing: A queue smooths spikes but also hides how far behind you are. Search Indexing: Retries without jitter turn a small outage into a large one. Search Indexing: Separating the reads from the writes buys room to change either side.

Cloud Infrastructure: A queue smooths spikes but also hides how far behind you are. Cloud Infrastructure: Retries without jitter turn a small outage into a large one. Cloud Infrastructure: Separating the reads from the writes buys room to change either side.

Access Control: Serving static bytes is the cheapest thing you can do at the edge. Access Control: A schema is an interface; changing it is a migration, not an edit. Access Control: Track the denominator as carefully as the numerator.

If a metric has no owner, it will drift until it causes an incident. This is most visible in monitoring alerts. Consider monitoring alerts specifically. The cheapest optimisation is usually removing work nobody asked for. Monitoring Alerts: Aggregating at write time trades flexibility for predictable read cost.

Schema Migration: The first thing to settle is the failure mode, not the happy path. Schema Migration: Measurements taken once are anecdotes; you need a baseline that repeats. Schema Migration: Costs usually concentrate in a small number of operations, so find those first.

A queue smooths spikes but also hides how far behind you are. This is most visible in log analysis. Consider log analysis specifically. Retries without jitter turn a small outage into a large one. Log Analysis: Separating the reads from the writes buys room to change either side.

Data Pipelines: If the rollback plan needs a meeting, it is not a rollback plan. Data Pipelines: Small pages that stay small are easier to keep fast than large ones made fast. Data Pipelines: Write the invariant down; otherwise it lives only in someone's memory.

Consider observability specifically. The interesting number is not the average, it is the 99th percentile. Observability: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Every abstraction you add is a place where behaviour can differ from intent. That applies to observability as well.

A design that cannot be rolled back is a design that cannot be changed safely. The same reasoning holds for monitoring alerts. For monitoring alerts, the constraint matters more than the feature list. Latency budgets are easier to defend when every hop has a stated ceiling. Teams working on monitoring alerts usually discover this the hard way. Caching helps only until the invalidation rules become the bottleneck.

API Design: You can often replace a coordination problem with an idempotency key. API Design: Anything that grows without a bound will eventually hit one. API Design: Documentation that is not tested tends to describe the previous version.

Teams working on edge caching usually discover this the hard way. You can often replace a coordination problem with an idempotency key. Anything that grows without a bound will eventually hit one. This is most visible in edge caching. Consider edge caching specifically. Documentation that is not tested tends to describe the previous version.

Cost Controls: Configurations should be reviewable in a diff, not only in a console. The best time to add an index is before the table gets large. That applies to cost controls as well. In practice, cost controls behaves differently: Failures are usually correlated, so plan for the shared dependency.

Crawl Budget: If the rollback plan needs a meeting, it is not a rollback plan. Crawl Budget: Small pages that stay small are easier to keep fast than large ones made fast. Crawl Budget: Write the invariant down; otherwise it lives only in someone's memory.