Technology Fundamentals 2 in Practice: Lessons From Real Deployments
Periodic jobs should be safe to run twice, because they will be. This is most visible in data pipelines. Consider data pipelines specifically. You rarely need a new component to fix a boundary problem. Data Pipelines: The signal you want is often already logged, just not aggregated.
Many screens can be completed with urine, blood or self-collected swabs. A genital or pelvic examination is not automatically required for an STI screen; a clinician may suggest one if symptoms or another clinical question make it relevant. You can ask what an examination would involve and why it is being offered. You may ask to pause or stop at any point, and consent to one part of an appointment does not mean consent to every part.
Rate Limiting: If the rollback plan needs a meeting, it is not a rollback plan. Rate Limiting: Small pages that stay small are easier to keep fast than large ones made fast. Rate Limiting: Write the invariant down; otherwise it lives only in someone's memory.
Backup Strategy: The first thing to settle is the failure mode, not the happy path. Backup Strategy: Measurements taken once are anecdotes; you need a baseline that repeats. Backup Strategy: Costs usually concentrate in a small number of operations, so find those first.
Serving static bytes is the cheapest thing you can do at the edge. That applies to storage tiers as well. In practice, storage tiers behaves differently: A schema is an interface; changing it is a migration, not an edit. Track the denominator as carefully as the numerator. The same reasoning holds for storage tiers.
In practice, data pipelines behaves differently: A queue smooths spikes but also hides how far behind you are. Retries without jitter turn a small outage into a large one. The same reasoning holds for data pipelines. For data pipelines, the constraint matters more than the feature list. Separating the reads from the writes buys room to change either side.
Serving static bytes is the cheapest thing you can do at the edge. The same reasoning holds for content delivery. For content delivery, the constraint matters more than the feature list. A schema is an interface; changing it is a migration, not an edit. Teams working on content delivery usually discover this the hard way. Track the denominator as carefully as the numerator.
Schema Migration: A queue smooths spikes but also hides how far behind you are. Schema Migration: Retries without jitter turn a small outage into a large one. Schema Migration: Separating the reads from the writes buys room to change either side.
Talk about privacy, too. Clarify whether intimate messages or images may be saved, shown to someone else, or shared online. Do not assume that permission to create or send an image includes permission to distribute it. Laws concerning intimate images differ across countries, and sharing without consent may have serious consequences. If you do not want an image made or shared, state that plainly.
Data Pipelines: Configurations should be reviewable in a diff, not only in a console. Data Pipelines: The best time to add an index is before the table gets large. Data Pipelines: Failures are usually correlated, so plan for the shared dependency.
In practice, queue design behaves differently: Configurations should be reviewable in a diff, not only in a console. The best time to add an index is before the table gets large. The same reasoning holds for queue design. For queue design, the constraint matters more than the feature list. Failures are usually correlated, so plan for the shared dependency.
Load Balancing: Periodic jobs should be safe to run twice, because they will be. Load Balancing: You rarely need a new component to fix a boundary problem. Load Balancing: The signal you want is often already logged, just not aggregated.
Consent is ongoing. A person can withdraw it at any point, including after previously agreeing or after an activity has begun. If they say stop, move away, become unresponsive or otherwise indicate discomfort, pause immediately and ask what they want. Do not argue, bargain or demand an explanation.
Teams working on log analysis usually discover this the hard way. A design that cannot be rolled back is a design that cannot be changed safely. Latency budgets are easier to defend when every hop has a stated ceiling. This is most visible in log analysis. Consider log analysis specifically. Caching helps only until the invalidation rules become the bottleneck.
The interesting number is not the average, it is the 99th percentile. That applies to search indexing as well. In practice, search indexing behaves differently: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Every abstraction you add is a place where behaviour can differ from intent. The same reasoning holds for search indexing.
Observability: The first thing to settle is the failure mode, not the happy path. Measurements taken once are anecdotes; you need a baseline that repeats. That applies to observability as well. In practice, observability behaves differently: Costs usually concentrate in a small number of operations, so find those first.
Teams working on data pipelines usually discover this the hard way. The interesting number is not the average, it is the 99th percentile. Adding a cache in front of a slow query is a fix; fixing the query is a cure. This is most visible in data pipelines. Consider data pipelines specifically. Every abstraction you add is a place where behaviour can differ from intent.
Consider edge caching specifically. A design that cannot be rolled back is a design that cannot be changed safely. Edge Caching: Latency budgets are easier to defend when every hop has a stated ceiling. Caching helps only until the invalidation rules become the bottleneck. That applies to edge caching as well.
Communication does not have to follow a script. Partners can discuss boundaries and expectations before an intimate situation, then check in again if circumstances or preferences change. Nonverbal communication can provide context, but gestures or body language may be misread; they should not be treated as a substitute for clear agreement when there is doubt. People who communicate in different ways can agree on accessible ways to express yes, no and pause.
For cost controls, the constraint matters more than the feature list. If a metric has no owner, it will drift until it causes an incident. Teams working on cost controls usually discover this the hard way. The cheapest optimisation is usually removing work nobody asked for. Aggregating at write time trades flexibility for predictable read cost. This is most visible in cost controls.
Observability: The first thing to settle is the failure mode, not the happy path. Observability: Measurements taken once are anecdotes; you need a baseline that repeats. Observability: Costs usually concentrate in a small number of operations, so find those first.
Edge Caching: A queue smooths spikes but also hides how far behind you are. Retries without jitter turn a small outage into a large one. That applies to edge caching as well. In practice, edge caching behaves differently: Separating the reads from the writes buys room to change either side.
Monitoring Alerts: Serving static bytes is the cheapest thing you can do at the edge. Monitoring Alerts: A schema is an interface; changing it is a migration, not an edit. Monitoring Alerts: Track the denominator as carefully as the numerator.
Monitoring Alerts: You can often replace a coordination problem with an idempotency key. Monitoring Alerts: Anything that grows without a bound will eventually hit one. Monitoring Alerts: Documentation that is not tested tends to describe the previous version.