Design a Video Transcoding Pipeline - System Design
Someone uploads a 4GB 4K master. Before anyone can watch it, that one file has to become roughly a dozen different versions - 360p, 480p, …
Read MoreSpeculative Decoding Is the Inference Trick That Cuts LLM Latency Without Changing the Model
Most self-hosted LLM teams respond to slow generation the same way: buy a bigger GPU. Latency is high, tokens per second is low, so the fix …
Read MoreDesign a Distributed Counter at Scale - System Design
“Design a distributed counter” sounds like homework until you write down what it actually is: a single number that millions of people want …
Read MoreDesign a Feature Flag Service - System Design
A feature flag service sounds like a key-value store with a boolean in it. “Is new-checkout on? Return true or false.” That framing survives …
Read MoreDesign TikTok / Instagram Reels (Short-Video Feed) - System Design
People see the swipe and think the hard part is video. It is not. Serving a 15-second clip is a CDN problem that YouTube solved a decade …
Read MorePydantic AI Makes LLM Output Validation a First-Class Engineering Problem
If you still have a re.search(r'\{.*\}', response) somewhere in your codebase to pull JSON out of an LLM reply, that line is a liability. …
Read MoreDesign Discord (Voice Chat with Low Latency) - System Design
People hear “build Discord voice” and reach for the same WebRTC tutorial they would use for a video call: two peers, an SDP exchange, media …
Read MoreDesign Insurance Claims Processing - System Design
“Design insurance claims” sounds like a form with a Submit button. A customer uploads a photo of their dented car, someone looks at it, …
Read MoreDesign Loan Disbursal Platform (FinTech) - System Design
A loan disbursal platform looks like a form plus a yes/no, and interviewers love it because it is not. The “form” fans out to a half-dozen …
Read MoreDesign Aadhaar / National Identity Database - System Design
“Store identity for everyone and let them prove who they are” sounds like a users table with a photo column. Then you look at the numbers …
Read MoreDesign Twitch (Live Streaming Platform) - System Design
Twitch is not a video problem with a chat bolted on. It is a real-time interaction problem that happens to carry video. That is the thing …
Read MoreDesign WhatsApp Status (24-hour Stories) - System Design
WhatsApp Status looks like Instagram Stories with a different logo, and if you design it like Stories you will get most of it right and miss …
Read MoreYour Engineers Hate the New AI Tools - How to Fix Rollout Without Mandating Adoption
The fastest way to make your best engineers distrust AI tooling is to mandate it. I have watched three orgs do this in 2026, and the pattern …
Read MoreDesign Comment Moderation / Toxicity Filter - System Design
Content moderation looks like a machine learning problem and ends up being a systems problem. The model is the easy part - a toxicity …
Read MoreDesign Live Cricket Score / Sports Updates - System Design
Everyone starts this problem by drawing a box labeled “score database” and an arrow to a phone. The interviewer nods and then tells you it …
Read MoreDesign Live Sports Streaming (Hotstar / IPL) - System Design
Live sports is the hardest shape of video there is, and it is hard for a reason that is the exact opposite of YouTube. On a VOD platform you …
Read MorePrompt Caching Cuts Your LLM Bill by 80 Percent and Nobody Is Using It
Here is a number that should bother you: on most production LLM apps I have looked at, the prompt caching hit rate is close to zero, even …
Read MoreDesign Mobile Recharge / Bill Payment - System Design
A user opens the app, taps “Electricity”, types a consumer number, and a second later sees “Bill: 2,340, due Nov 20”. They pay, and a few …
Read MoreDesign Password Manager (1Password / LastPass) - System Design
A password manager looks like a trivial CRUD app. Store some login records, sync them across the user’s phone and laptop, auto-fill them …
Read MoreDesign Single Sign-On (SSO / OAuth Provider) - System Design
Single Sign-On sounds like a login screen. It is not. It is a token factory that a hundred applications trust, sitting at the center of an …
Read More