News Fundamentals 2: A Practical Overview

Load Balancing: You can often replace a coordination problem with an idempotency key. Load Balancing: Anything that grows without a bound will eventually hit one. Load Balancing: Documentation that is not tested tends to describe the previous version.

Access Control: Serving static bytes is the cheapest thing you can do at the edge. Access Control: A schema is an interface; changing it is a migration, not an edit. Access Control: Track the denominator as carefully as the numerator.

Queue Design: Configurations should be reviewable in a diff, not only in a console. Queue Design: The best time to add an index is before the table gets large. Queue Design: Failures are usually correlated, so plan for the shared dependency.

Consider load balancing specifically. A design that cannot be rolled back is a design that cannot be changed safely. Load Balancing: Latency budgets are easier to defend when every hop has a stated ceiling. Caching helps only until the invalidation rules become the bottleneck. That applies to load balancing as well.

Monitoring Alerts: The first thing to settle is the failure mode, not the happy path. Measurements taken once are anecdotes; you need a baseline that repeats. That applies to monitoring alerts as well. In practice, monitoring alerts behaves differently: Costs usually concentrate in a small number of operations, so find those first.

A design that cannot be rolled back is a design that cannot be changed safely. The same reasoning holds for observability. For observability, the constraint matters more than the feature list. Latency budgets are easier to defend when every hop has a stated ceiling. Teams working on observability usually discover this the hard way. Caching helps only until the invalidation rules become the bottleneck.

Cloud Infrastructure: Periodic jobs should be safe to run twice, because they will be. You rarely need a new component to fix a boundary problem. That applies to cloud infrastructure as well. In practice, cloud infrastructure behaves differently: The signal you want is often already logged, just not aggregated.

Cloud Infrastructure: A queue smooths spikes but also hides how far behind you are. Cloud Infrastructure: Retries without jitter turn a small outage into a large one. Cloud Infrastructure: Separating the reads from the writes buys room to change either side.

Search Indexing: The interesting number is not the average, it is the 99th percentile. Search Indexing: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Search Indexing: Every abstraction you add is a place where behaviour can differ from intent.

The interesting number is not the average, it is the 99th percentile. That applies to release process as well. In practice, release process behaves differently: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Every abstraction you add is a place where behaviour can differ from intent. The same reasoning holds for release process.

Release Process: If the rollback plan needs a meeting, it is not a rollback plan. Release Process: Small pages that stay small are easier to keep fast than large ones made fast. Release Process: Write the invariant down; otherwise it lives only in someone's memory.

If the rollback plan needs a meeting, it is not a rollback plan. That applies to schema migration as well. In practice, schema migration behaves differently: Small pages that stay small are easier to keep fast than large ones made fast. Write the invariant down; otherwise it lives only in someone's memory. The same reasoning holds for schema migration.

Search Indexing: A queue smooths spikes but also hides how far behind you are. Search Indexing: Retries without jitter turn a small outage into a large one. Search Indexing: Separating the reads from the writes buys room to change either side.

Access Control: A design that cannot be rolled back is a design that cannot be changed safely. Access Control: Latency budgets are easier to defend when every hop has a stated ceiling. Access Control: Caching helps only until the invalidation rules become the bottleneck.

Access Control: The first thing to settle is the failure mode, not the happy path. Access Control: Measurements taken once are anecdotes; you need a baseline that repeats. Access Control: Costs usually concentrate in a small number of operations, so find those first.

Configurations should be reviewable in a diff, not only in a console. This is most visible in crawl budget. Consider crawl budget specifically. The best time to add an index is before the table gets large. Crawl Budget: Failures are usually correlated, so plan for the shared dependency.

Configurations should be reviewable in a diff, not only in a console. This is most visible in access control. Consider access control specifically. The best time to add an index is before the table gets large. Access Control: Failures are usually correlated, so plan for the shared dependency.

Log Analysis: You can often replace a coordination problem with an idempotency key. Log Analysis: Anything that grows without a bound will eventually hit one. Log Analysis: Documentation that is not tested tends to describe the previous version.

Serving static bytes is the cheapest thing you can do at the edge. That applies to backup strategy as well. In practice, backup strategy behaves differently: A schema is an interface; changing it is a migration, not an edit. Track the denominator as carefully as the numerator. The same reasoning holds for backup strategy.

Access Control: The interesting number is not the average, it is the 99th percentile. Access Control: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Access Control: Every abstraction you add is a place where behaviour can differ from intent.

Storage Tiers: If the rollback plan needs a meeting, it is not a rollback plan. Storage Tiers: Small pages that stay small are easier to keep fast than large ones made fast. Storage Tiers: Write the invariant down; otherwise it lives only in someone's memory.

Queue Design: The first thing to settle is the failure mode, not the happy path. Queue Design: Measurements taken once are anecdotes; you need a baseline that repeats. Queue Design: Costs usually concentrate in a small number of operations, so find those first.

Consider cloud infrastructure specifically. The interesting number is not the average, it is the 99th percentile. Cloud Infrastructure: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Every abstraction you add is a place where behaviour can differ from intent. That applies to cloud infrastructure as well.

Search Indexing: Periodic jobs should be safe to run twice, because they will be. Search Indexing: You rarely need a new component to fix a boundary problem. Search Indexing: The signal you want is often already logged, just not aggregated.