Ns2 Independent coverage of news

Understanding News Fundamentals 4: Costs, Limits and Trade-offs

By Laura Bennett · · 1198 words
Understanding News Fundamentals 4: Costs, Limits and Trade-offs

In practice, backup strategy behaves differently: A queue smooths spikes but also hides how far behind you are. Retries without jitter turn a small outage into a large one. The same reasoning holds for backup strategy. For backup strategy, the constraint matters more than the feature list. Separating the reads from the writes buys room to change either side.

Rate Limiting: Periodic jobs should be safe to run twice, because they will be. Rate Limiting: You rarely need a new component to fix a boundary problem. Rate Limiting: The signal you want is often already logged, just not aggregated.

Observability: If the rollback plan needs a meeting, it is not a rollback plan. Observability: Small pages that stay small are easier to keep fast than large ones made fast. Observability: Write the invariant down; otherwise it lives only in someone's memory.

Consider content delivery specifically. The interesting number is not the average, it is the 99th percentile. Content Delivery: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Every abstraction you add is a place where behaviour can differ from intent. That applies to content delivery as well.

Consider release process specifically. If the rollback plan needs a meeting, it is not a rollback plan. Release Process: Small pages that stay small are easier to keep fast than large ones made fast. Write the invariant down; otherwise it lives only in someone's memory. That applies to release process as well.

Search Indexing: The interesting number is not the average, it is the 99th percentile. Search Indexing: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Search Indexing: Every abstraction you add is a place where behaviour can differ from intent.

Access Control: Periodic jobs should be safe to run twice, because they will be. Access Control: You rarely need a new component to fix a boundary problem. Access Control: The signal you want is often already logged, just not aggregated.

Queue Design: If the rollback plan needs a meeting, it is not a rollback plan. Queue Design: Small pages that stay small are easier to keep fast than large ones made fast. Queue Design: Write the invariant down; otherwise it lives only in someone's memory.

For crawl budget, the constraint matters more than the feature list. The first thing to settle is the failure mode, not the happy path. Teams working on crawl budget usually discover this the hard way. Measurements taken once are anecdotes; you need a baseline that repeats. Costs usually concentrate in a small number of operations, so find those first. This is most visible in crawl budget.

Schema Migration: Periodic jobs should be safe to run twice, because they will be. Schema Migration: You rarely need a new component to fix a boundary problem. Schema Migration: The signal you want is often already logged, just not aggregated.

The interesting number is not the average, it is the 99th percentile. The same reasoning holds for access control. For access control, the constraint matters more than the feature list. Adding a cache in front of a slow query is a fix; fixing the query is a cure. Teams working on access control usually discover this the hard way. Every abstraction you add is a place where behaviour can differ from intent.

API Design: If a metric has no owner, it will drift until it causes an incident. API Design: The cheapest optimisation is usually removing work nobody asked for. API Design: Aggregating at write time trades flexibility for predictable read cost.

A queue smooths spikes but also hides how far behind you are. This is most visible in rate limiting. Consider rate limiting specifically. Retries without jitter turn a small outage into a large one. Rate Limiting: Separating the reads from the writes buys room to change either side.

Log Analysis: Serving static bytes is the cheapest thing you can do at the edge. Log Analysis: A schema is an interface; changing it is a migration, not an edit. Log Analysis: Track the denominator as carefully as the numerator.

Backup Strategy: A queue smooths spikes but also hides how far behind you are. Backup Strategy: Retries without jitter turn a small outage into a large one. Backup Strategy: Separating the reads from the writes buys room to change either side.

Access Control: A queue smooths spikes but also hides how far behind you are. Retries without jitter turn a small outage into a large one. That applies to access control as well. In practice, access control behaves differently: Separating the reads from the writes buys room to change either side.

For api design, the constraint matters more than the feature list. Configurations should be reviewable in a diff, not only in a console. Teams working on api design usually discover this the hard way. The best time to add an index is before the table gets large. Failures are usually correlated, so plan for the shared dependency. This is most visible in api design.

For queue design, the constraint matters more than the feature list. A queue smooths spikes but also hides how far behind you are. Teams working on queue design usually discover this the hard way. Retries without jitter turn a small outage into a large one. Separating the reads from the writes buys room to change either side. This is most visible in queue design.

Monitoring Alerts: If a metric has no owner, it will drift until it causes an incident. Monitoring Alerts: The cheapest optimisation is usually removing work nobody asked for. Monitoring Alerts: Aggregating at write time trades flexibility for predictable read cost.

Storage Tiers: You can often replace a coordination problem with an idempotency key. Storage Tiers: Anything that grows without a bound will eventually hit one. Storage Tiers: Documentation that is not tested tends to describe the previous version.

Teams working on backup strategy usually discover this the hard way. The interesting number is not the average, it is the 99th percentile. Adding a cache in front of a slow query is a fix; fixing the query is a cure. This is most visible in backup strategy. Consider backup strategy specifically. Every abstraction you add is a place where behaviour can differ from intent.

Cloud Infrastructure: Serving static bytes is the cheapest thing you can do at the edge. Cloud Infrastructure: A schema is an interface; changing it is a migration, not an edit. Cloud Infrastructure: Track the denominator as carefully as the numerator.

Boundaries can change with circumstances, health, trust or preference. Partners can check in before a new activity or after an experience, without treating a previous agreement as permanent. Digital boundaries deserve the same care as in-person ones: discuss private messages, location sharing, passwords and images. Consent to receive or make an image is not permission to forward it.

Data Pipelines: The interesting number is not the average, it is the 99th percentile. Data Pipelines: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Data Pipelines: Every abstraction you add is a place where behaviour can differ from intent.

Related reading