Ns2 Independent coverage of news

Cloud Infrastructure Compared: What Actually Matters

By Nina Alvarez · · 1144 words
Cloud Infrastructure Compared: What Actually Matters

A queue smooths spikes but also hides how far behind you are. This is most visible in log analysis. Consider log analysis specifically. Retries without jitter turn a small outage into a large one. Log Analysis: Separating the reads from the writes buys room to change either side.

Log Analysis: The first thing to settle is the failure mode, not the happy path. Log Analysis: Measurements taken once are anecdotes; you need a baseline that repeats. Log Analysis: Costs usually concentrate in a small number of operations, so find those first.

In practice, load balancing behaves differently: If a metric has no owner, it will drift until it causes an incident. The cheapest optimisation is usually removing work nobody asked for. The same reasoning holds for load balancing. For load balancing, the constraint matters more than the feature list. Aggregating at write time trades flexibility for predictable read cost.

Queue Design: If a metric has no owner, it will drift until it causes an incident. Queue Design: The cheapest optimisation is usually removing work nobody asked for. Queue Design: Aggregating at write time trades flexibility for predictable read cost.

Backup Strategy: Periodic jobs should be safe to run twice, because they will be. Backup Strategy: You rarely need a new component to fix a boundary problem. Backup Strategy: The signal you want is often already logged, just not aggregated.

Log Analysis: You can often replace a coordination problem with an idempotency key. Log Analysis: Anything that grows without a bound will eventually hit one. Log Analysis: Documentation that is not tested tends to describe the previous version.

Observability: The first thing to settle is the failure mode, not the happy path. Measurements taken once are anecdotes; you need a baseline that repeats. That applies to observability as well. In practice, observability behaves differently: Costs usually concentrate in a small number of operations, so find those first.

Teams working on access control usually discover this the hard way. You can often replace a coordination problem with an idempotency key. Anything that grows without a bound will eventually hit one. This is most visible in access control. Consider access control specifically. Documentation that is not tested tends to describe the previous version.

Cloud Infrastructure: A design that cannot be rolled back is a design that cannot be changed safely. Cloud Infrastructure: Latency budgets are easier to defend when every hop has a stated ceiling. Cloud Infrastructure: Caching helps only until the invalidation rules become the bottleneck.

Storage Tiers: Serving static bytes is the cheapest thing you can do at the edge. Storage Tiers: A schema is an interface; changing it is a migration, not an edit. Storage Tiers: Track the denominator as carefully as the numerator.

Queue Design: Periodic jobs should be safe to run twice, because they will be. Queue Design: You rarely need a new component to fix a boundary problem. Queue Design: The signal you want is often already logged, just not aggregated.

Consider api design specifically. If the rollback plan needs a meeting, it is not a rollback plan. API Design: Small pages that stay small are easier to keep fast than large ones made fast. Write the invariant down; otherwise it lives only in someone's memory. That applies to api design as well.

Use direct language and describe the limit in practical terms. For example: “I want to use a condom every time we have sex,” or “Please ask before taking or sharing photos of me.” A person can briefly explain why, but they do not have to prove that a boundary is reasonable. If the limit is not yet clear to them, they can say so and ask to pause while they decide.

Serving static bytes is the cheapest thing you can do at the edge. The same reasoning holds for queue design. For queue design, the constraint matters more than the feature list. A schema is an interface; changing it is a migration, not an edit. Teams working on queue design usually discover this the hard way. Track the denominator as carefully as the numerator.

Crawl Budget: The interesting number is not the average, it is the 99th percentile. Crawl Budget: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Crawl Budget: Every abstraction you add is a place where behaviour can differ from intent.

Crawl Budget: The first thing to settle is the failure mode, not the happy path. Crawl Budget: Measurements taken once are anecdotes; you need a baseline that repeats. Crawl Budget: Costs usually concentrate in a small number of operations, so find those first.

Data Pipelines: Serving static bytes is the cheapest thing you can do at the edge. Data Pipelines: A schema is an interface; changing it is a migration, not an edit. Data Pipelines: Track the denominator as carefully as the numerator.

Schema Markup: A queue smooths spikes but also hides how far behind you are. Schema Markup: Retries without jitter turn a small outage into a large one. Schema Markup: Separating the reads from the writes buys room to change either side.

The interesting number is not the average, it is the 99th percentile. That applies to rate limiting as well. In practice, rate limiting behaves differently: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Every abstraction you add is a place where behaviour can differ from intent. The same reasoning holds for rate limiting.

Backup Strategy: Configurations should be reviewable in a diff, not only in a console. The best time to add an index is before the table gets large. That applies to backup strategy as well. In practice, backup strategy behaves differently: Failures are usually correlated, so plan for the shared dependency.

Access Control: The interesting number is not the average, it is the 99th percentile. Access Control: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Access Control: Every abstraction you add is a place where behaviour can differ from intent.

API Design: Serving static bytes is the cheapest thing you can do at the edge. API Design: A schema is an interface; changing it is a migration, not an edit. API Design: Track the denominator as carefully as the numerator.

Rate Limiting: If a metric has no owner, it will drift until it causes an incident. The cheapest optimisation is usually removing work nobody asked for. That applies to rate limiting as well. In practice, rate limiting behaves differently: Aggregating at write time trades flexibility for predictable read cost.

Load Balancing: If a metric has no owner, it will drift until it causes an incident. Load Balancing: The cheapest optimisation is usually removing work nobody asked for. Load Balancing: Aggregating at write time trades flexibility for predictable read cost.

Related reading