Understanding Site Topics Fundamentals 4: Costs, Limits and Trade-offs

Teams working on log analysis usually discover this the hard way. A design that cannot be rolled back is a design that cannot be changed safely. Latency budgets are easier to defend when every hop has a stated ceiling. This is most visible in log analysis. Consider log analysis specifically. Caching helps only until the invalidation rules become the bottleneck.

Listening is part of the conversation. Ask what the other person understands, and invite them to describe their own boundaries without treating the exchange as a negotiation in which every limit must be traded away. Open questions such as “What would help you feel comfortable?” can clarify expectations. If a question feels intrusive, either person can decline to answer it.

Crawl Budget: If a metric has no owner, it will drift until it causes an incident. Crawl Budget: The cheapest optimisation is usually removing work nobody asked for. Crawl Budget: Aggregating at write time trades flexibility for predictable read cost.

Search Indexing: Periodic jobs should be safe to run twice, because they will be. Search Indexing: You rarely need a new component to fix a boundary problem. Search Indexing: The signal you want is often already logged, just not aggregated.

Cost Controls: Configurations should be reviewable in a diff, not only in a console. Cost Controls: The best time to add an index is before the table gets large. Cost Controls: Failures are usually correlated, so plan for the shared dependency.

Storage Tiers: If the rollback plan needs a meeting, it is not a rollback plan. Storage Tiers: Small pages that stay small are easier to keep fast than large ones made fast. Storage Tiers: Write the invariant down; otherwise it lives only in someone's memory.

Cost Controls: You can often replace a coordination problem with an idempotency key. Cost Controls: Anything that grows without a bound will eventually hit one. Cost Controls: Documentation that is not tested tends to describe the previous version.

Serving static bytes is the cheapest thing you can do at the edge. That applies to storage tiers as well. In practice, storage tiers behaves differently: A schema is an interface; changing it is a migration, not an edit. Track the denominator as carefully as the numerator. The same reasoning holds for storage tiers.

Rate Limiting: The first thing to settle is the failure mode, not the happy path. Rate Limiting: Measurements taken once are anecdotes; you need a baseline that repeats. Rate Limiting: Costs usually concentrate in a small number of operations, so find those first.

Cloud Infrastructure: The interesting number is not the average, it is the 99th percentile. Cloud Infrastructure: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Cloud Infrastructure: Every abstraction you add is a place where behaviour can differ from intent.

Load Balancing: Configurations should be reviewable in a diff, not only in a console. Load Balancing: The best time to add an index is before the table gets large. Load Balancing: Failures are usually correlated, so plan for the shared dependency.

A queue smooths spikes but also hides how far behind you are. This is most visible in release process. Consider release process specifically. Retries without jitter turn a small outage into a large one. Release Process: Separating the reads from the writes buys room to change either side.

Serving static bytes is the cheapest thing you can do at the edge. That applies to cost controls as well. In practice, cost controls behaves differently: A schema is an interface; changing it is a migration, not an edit. Track the denominator as carefully as the numerator. The same reasoning holds for cost controls.

In practice, rate limiting behaves differently: Periodic jobs should be safe to run twice, because they will be. You rarely need a new component to fix a boundary problem. The same reasoning holds for rate limiting. For rate limiting, the constraint matters more than the feature list. The signal you want is often already logged, just not aggregated.

A respectful response acknowledges the limit and follows it. A partner may ask a clarifying question, provided the question is not a way to wear someone down. Repeated requests after a clear no, guilt, anger used to secure agreement, or threats to end the relationship can undermine consent. Silence or lack of resistance should not be treated as agreement.

Queue Design: A queue smooths spikes but also hides how far behind you are. Queue Design: Retries without jitter turn a small outage into a large one. Queue Design: Separating the reads from the writes buys room to change either side.

Content Delivery: The interesting number is not the average, it is the 99th percentile. Content Delivery: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Content Delivery: Every abstraction you add is a place where behaviour can differ from intent.

In practice, backup strategy behaves differently: A queue smooths spikes but also hides how far behind you are. Retries without jitter turn a small outage into a large one. The same reasoning holds for backup strategy. For backup strategy, the constraint matters more than the feature list. Separating the reads from the writes buys room to change either side.

Cloud Infrastructure: The first thing to settle is the failure mode, not the happy path. Measurements taken once are anecdotes; you need a baseline that repeats. That applies to cloud infrastructure as well. In practice, cloud infrastructure behaves differently: Costs usually concentrate in a small number of operations, so find those first.

Schema Migration: The interesting number is not the average, it is the 99th percentile. Schema Migration: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Schema Migration: Every abstraction you add is a place where behaviour can differ from intent.

A respectful response may include questions asked to understand, a clear acceptance of the limit, or a request to discuss a separate preference. A partner does not have to share your boundary to respect it. By contrast, repeated bargaining after you have said no, guilt, threats, ridicule, or continuing after you ask to stop are not respectful ways to handle a boundary. You are not responsible for making another person approve of your limit.

Content Delivery: If the rollback plan needs a meeting, it is not a rollback plan. Content Delivery: Small pages that stay small are easier to keep fast than large ones made fast. Content Delivery: Write the invariant down; otherwise it lives only in someone's memory.

Pay attention to the conditions around the conversation. A substantial power difference, financial dependence or fear of someone’s reaction can make it harder to speak openly. These circumstances do not automatically determine a legal outcome, but they are reasons to take extra care and avoid pressuring the other person. Give them time and a genuine opportunity to say no.

Backup Strategy: The first thing to settle is the failure mode, not the happy path. Backup Strategy: Measurements taken once are anecdotes; you need a baseline that repeats. Backup Strategy: Costs usually concentrate in a small number of operations, so find those first.