Search
Find concepts, problems, patterns, roadmaps, and videos. Concepts and Problems are canonical learning entities — other types are supporting resources.
In-Memory Caching & Event Loop Architecture
Caching is the architectural technique of retaining copies of frequently accessed, computationally expensive data in high-speed, volatile memory (e.g. Redis, Memcached, CPU caches) to bypass slow disk I/O, database table scans, and network hops. Proper caching slashes latency from tens of milliseconds to sub-milliseconds and shields databases from query saturation.
Rate Limiting & Token Buckets
Rate limiting is a defense mechanism that constrains the frequency of requests a client, IP, or token can make within a specified time window, preventing resource exhaustion, DDoS surges, and API abuse. By bounding throughput at the ingress perimeter, rate limiters protect downstream databases and worker pools from catastrophic cascading overload.
Event-Driven Architecture & Message Streaming
Event-driven architecture replaces synchronous REST HTTP calls with asynchronous event publishing (Kafka/RabbitMQ), ensuring high throughput and fault isolation.
Load Balancing & Consistent Hashing
Load balancing is the architectural discipline of distributing incoming network and application traffic across a pool of healthy backend servers to ensure high availability, prevent server saturation, and eliminate single points of failure. By decoupling client entry points from backend execution nodes, load balancers allow systems to scale horizontally from tens of requests to millions of requests per second.
Database Indexing: B-Trees vs LSM-Trees
Database indexes turn linear O(N) table scans into logarithmic O(log N) lookups. B-Trees optimize point & range reads; LSM-Trees turn random writes into sequential disk writes.
Quorum Consistency & Raft Consensus
Data replication copies datasets across multiple network nodes to ensure high availability, read scalability, and disaster fault tolerance. Managing replicas forces architects to navigate the fundamental trade-off between strong consistency (immediate linearizability) and high availability during network partitions (CAP and PACELC Theorems).
Database Sharding & Range Partitioning
Database sharding is the horizontal data partitioning architecture that splits a monolithic database into multiple independent physical database instances (shards), distributing storage capacity, write IOPS, and RAM buffer pools across independent compute nodes.
Message Queues & DLQ Backpressure
Message queues decouple producers from consumers, holding job tasks in RAM/disk until worker pools process them.
B-Trees vs LSM-Trees Storage Engines
B-Trees vs LSM-Trees Storage Engines provides core foundational patterns in Algorithms & Data Structures. Compare B+ Tree read-optimized node layouts against LSM-Tree append-only SSTable write buffers.
Graph Traversal & Pathfinding: BFS, DFS & Dijkstra
Graph Traversal & Pathfinding: BFS, DFS & Dijkstra provides core foundational patterns in Algorithms & Data Structures. Traverse graphs efficiently using Breadth-First Search, Depth-First Search, and Dijkstra shortest path algorithms.
Circuit Breakers & Resilience Patterns
A circuit breaker wraps remote network calls in a stateful monitoring harness that automatically trips OPEN to fail-fast when downstream error or timeout thresholds breach, preventing caller thread exhaustion and cascading distributed outages. By failing fast, circuit breakers insulate upstream services and grant recovering dependencies breathing room to heal.
Vector Databases, HNSW Indexing & RAG Pipelines
Vector databases index high-dimensional vector embeddings (e.g. 1536-dim vectors) produced by AI models, enabling sub-millisecond semantic search via Hierarchical Navigable Small World (HNSW) graph indexing.
Distributed Locking & Redlock Algorithm
Distributed Locking & Redlock Algorithm provides core foundational patterns in Distributed Concurrency & Multithreading. Synchronize atomic operations across distributed nodes using Redis SETNX, TTL fencing tokens, and Redlock consensus.
OAuth2, JWT & Mutual TLS (mTLS) Security Architecture
API security uses OAuth2 authorization framework with cryptographically signed JSON Web Tokens (JWT) for stateless user verification, and mTLS for mutual identity verification between microservices.
Canary Deployment & Progressive Delivery Pipelines
Canary deployment is a progressive delivery strategy that routes a tiny fraction of live user traffic (e.g. 1% → 10% → 50% → 100%) to a new release while running the proven baseline version side-by-side. Automated telemetry controllers evaluate latency, error rates, and business conversions, automatically cutting traffic back to zero within seconds if safety thresholds are breached.
Consumer-Driven Contract Testing & Chaos Engineering
Consumer-Driven Contract Testing (e.g. Pact) allows downstream microservice consumers to define explicit API expectations (contracts) that upstream producers validate independently in CI pipelines, eliminating brittle end-to-end integration environments.
API Gateway & Layer 7 Protocols: REST, RPC, WebSockets
API Gateway & Layer 7 Protocols: REST, RPC, WebSockets provides core foundational patterns in DevOps & Platform Engineering. Centralize entry routing, protocol translation (gRPC to REST), authentication, and client aggregation at the edge.
JVM Architecture, Memory Model & Garbage Collection
JVM Architecture, Memory Model & Garbage Collection provides core foundational patterns in Software Design & Architecture. Master Java Virtual Machine class loading, heap memory regions (Eden, Survivor, Tenured), and GC algorithms (G1, ZGC).
AI Agents, LangGraph & Stateful Tool Orchestration
AI Agents, LangGraph & Stateful Tool Orchestration provides core foundational patterns in AI & Machine Learning Engineering. Orchestrate autonomous agentic workflows using state machines, function calling contracts, and multi-agent loops.
Apache Spark: AQE, Catalyst Optimizer & Distributed DataFrames
Apache Spark: AQE, Catalyst Optimizer & Distributed DataFrames provides core foundational patterns in DevOps & Platform Engineering. Process petabyte-scale data using distributed RDD partitions, Catalyst optimizer query plans, and Adaptive Query Execution.
Prompt Engineering, LLM Reasoning & Thinking Models
Prompt Engineering, LLM Reasoning & Thinking Models provides core foundational patterns in AI & Machine Learning Engineering. Design structured prompts, Few-Shot examples, Chain-of-Thought reasoning, and mitigation for LLM hallucinations.
Tree Data Structures & Traversal Mechanics
Tree Data Structures & Traversal Mechanics provides core foundational patterns in Algorithms & Data Structures. Master hierarchical data models including Binary Trees, BSTs, AVL Trees, and In-Order/Pre-Order/Post-Order traversals.
Hash Tables & Probabilistic Bloom Filters
Hash Tables & Probabilistic Bloom Filters provides core foundational patterns in Algorithms & Data Structures. Achieve O(1) constant time lookups and test set membership with zero false negatives using space-efficient Bloom filters.
SOLID Principles, Clean Architecture & KISS
SOLID Principles, Clean Architecture & KISS provides core foundational patterns in Software Design & Architecture. Build maintainable software using Single Responsibility, Open-Closed, Liskov Substitution, Interface Segregation, and Dependency Inversion.
Git Internals, DAGs & Continuous Feature Delivery
Git Internals, DAGs & Continuous Feature Delivery provides core foundational patterns in DevOps & Platform Engineering. Understand Git object hashes (Blobs, Trees, Commits), Golden Branch trunk models, and feature toggle flags.
Vector Embeddings, Dot Product & Cosine Similarity
Vector Embeddings, Dot Product & Cosine Similarity provides core foundational patterns in AI & Machine Learning Engineering. Represent unstructured text and audio as high-dimensional mathematical vectors and measure semantic similarity.
GoF Design Patterns: Strategy, Decorator, Factory & Observer
GoF Design Patterns: Strategy, Decorator, Factory & Observer provides core foundational patterns in Software Design & Architecture. Apply battle-tested Gang of Four object-oriented design patterns to decouple algorithms and dynamically extend behavior.
LLM Quantization, GPTQ/AWQ & Inference Performance
LLM Quantization, GPTQ/AWQ & Inference Performance provides core foundational patterns in AI & Machine Learning Engineering. Compress large language model weights from FP16 to INT4/INT8 to optimize GPU VRAM memory bandwidth and token throughput.
Topological Sort, Inverted Index & Search Patterns
Topological Sort, Inverted Index & Search Patterns provides core foundational patterns in Algorithms & Data Structures. Solve dependency DAG ordering, inverted index search scans, and logarithmic searching in large datasets.
Low-Level System Design: LRU Cache, Elevator & Ticket Booking
Low-Level System Design: LRU Cache, Elevator & Ticket Booking provides core foundational patterns in Software Design & Architecture. Design object-oriented class hierarchies, concurrency synchronization, and clean interfaces for real-world interview LLDs.
Python GIL-Free Concurrency, Asyncio & Coroutines
Python GIL-Free Concurrency, Asyncio & Coroutines provides core foundational patterns in Distributed Concurrency & Multithreading. Navigate Python Global Interpreter Lock transitions, free-threaded CPython (nogil), asyncio event loops, and multi-processing.
Stack & Queue Data Structures & Monotonic Stack Pattern
Stack & Queue Data Structures & Monotonic Stack Pattern provides core foundational patterns in Algorithms & Data Structures. Manage LIFO / FIFO orderings and optimize range queries with Monotonic Stacks in linear time.
High-Level System Design Architectures: Chat, Streaming & Distributed Platforms
High-Level System Design Architectures: Chat, Streaming & Distributed Platforms provides core foundational patterns in Software Design & Architecture. Architect distributed systems for Chat, News Feed, Video Streaming, Ticketmaster, Proximity, and Payment Platforms under peak load.
Database Isolation Levels & Transaction Anomalies
Database Isolation Levels & Transaction Anomalies provides core foundational patterns in Distributed Systems & Storage. Understand Dirty Reads, Non-Repeatable Reads, Phantom Reads, Write Skew, and SSI isolation in SQL and NoSQL engines.
Data Warehousing, Data Lake & Medallion Architecture
Data Warehousing, Data Lake & Medallion Architecture provides core foundational patterns in DevOps & Platform Engineering. Design analytical storage pipelines using Lambda, Kappa, Medallion Bronze/Silver/Gold layers, and CDC log streaming.
Core Algorithm Patterns: Two Pointers, Fast & Slow, Sliding Window & DP
Core Algorithm Patterns: Two Pointers, Fast & Slow, Sliding Window & DP provides core foundational patterns in Algorithms & Data Structures. Master top interview algorithm techniques including Two Pointers, Fast & Slow Pointers, Sliding Window, and Dynamic Programming.
Deep Learning Foundations: Backpropagation, Transformers & Optimizers
Deep Learning Foundations: Backpropagation, Transformers & Optimizers provides core foundational patterns in AI & Machine Learning Engineering. Derive backpropagation matrix calculus, Softmax activation, AdamW optimization, and dense Transformer neural networks.
Distributed ACID Transactions & Optimistic Locking
Distributed ACID Transactions & Optimistic Locking provides core foundational patterns in Distributed Systems & Storage. Evaluate ACID vs BASE guarantees, Compare-and-Swap optimistic concurrency control, and distributed locking mechanisms.
SQL Query Tuning: Index Seeks, Scans, Clustered & Covering Indexes
Relational query execution hinges on whether the optimizer executes an Index Seek (direct O(log N) B-Tree root-to-leaf traversal) or an Index/Table Scan (O(N) sequential page reads). When non-clustered indexes lack requested SELECT columns, the engine must perform a Key/RID Lookup back to clustered index pages for every row, triggering catastrophic random disk I/O.
Heaps & Priority Queues
A binary heap stores elements in a complete tree where each parent is smaller (min-heap) or larger (max-heap) than its children, enabling efficient priority queue operations.
Divide & Conquer Algorithms
Divide & conquer splits input, solves subproblems recursively, and merges partial answers—classic examples include merge sort and binary search on answer space.
CAP Theorem & Consistency Models
During a network partition, a distributed store cannot simultaneously provide both strong consistency and full availability; engineering chooses which guarantee to weaken and how clients observe stale reads.
Idempotency & Message Deduplication
At-least-once delivery is the practical default; idempotent handlers and deduplication tables turn duplicate deliveries into harmless no-ops.
CQRS & Event Sourcing
CQRS splits command (write) and query (read) paths; event sourcing stores state transitions as immutable events that can rebuild projections.
Saga & Compensation Patterns
A saga breaks a global transaction into local transactions with compensations; orchestration centralizes flow while choreography uses events.
Bulkhead & Fault Isolation
The bulkhead pattern limits resources per dependency or tenant—like ship compartments—so failures stay localized.
Transactional Outbox Pattern
The outbox table stores events in the same DB transaction as business rows; a relay process publishes to Kafka/RabbitMQ with at-least-once delivery.
Linked List Patterns
Linked List Patterns is a foundational topic in Algorithms & Data Structures. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Array Manipulation Techniques
Array Manipulation Techniques is a foundational topic in Algorithms & Data Structures. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
String Matching Algorithms
String Matching Algorithms is a foundational topic in Algorithms & Data Structures. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Bitmask Dynamic Programming
Bitmask Dynamic Programming is a foundational topic in Algorithms & Data Structures. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Bit Manipulation Techniques
Bit Manipulation Techniques is a foundational topic in Algorithms & Data Structures. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Matrix Traversal Patterns
Matrix Traversal Patterns is a foundational topic in Algorithms & Data Structures. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Flood Fill on Grids & Graphs
Flood Fill on Grids & Graphs is a foundational topic in Algorithms & Data Structures. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Bellman-Ford Shortest Paths
Bellman-Ford Shortest Paths is a foundational topic in Algorithms & Data Structures. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Floyd-Warshall All-Pairs Shortest Paths
Floyd-Warshall All-Pairs Shortest Paths is a foundational topic in Algorithms & Data Structures. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Kruskal Minimum Spanning Tree
Kruskal Minimum Spanning Tree is a foundational topic in Algorithms & Data Structures. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Prim's Minimum Spanning Tree
Prim's Minimum Spanning Tree is a foundational topic in Algorithms & Data Structures. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Segment Trees for Range Queries
Segment Trees for Range Queries is a foundational topic in Algorithms & Data Structures. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Fenwick Trees (Binary Indexed Trees)
Fenwick Trees (Binary Indexed Trees) is a foundational topic in Algorithms & Data Structures. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Counting & Radix Sort
Counting & Radix Sort is a foundational topic in Algorithms & Data Structures. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Reservoir Sampling
Reservoir Sampling is a foundational topic in Algorithms & Data Structures. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Randomized Algorithms
Randomized Algorithms is a foundational topic in Algorithms & Data Structures. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Amortized Analysis
Amortized Analysis is a foundational topic in Algorithms & Data Structures. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Monotonic Deque Techniques
Monotonic Deque Techniques is a foundational topic in Algorithms & Data Structures. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Sliding Window Maximum Patterns
Sliding Window Maximum Patterns is a foundational topic in Algorithms & Data Structures. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Consistent Hashing
Consistent Hashing is a foundational topic in Distributed Systems & Storage. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Leader Election Patterns
Leader Election Patterns is a foundational topic in Distributed Systems & Storage. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Gossip & Membership Protocols
Gossip & Membership Protocols is a foundational topic in Distributed Systems & Storage. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Two-Phase Commit
Two-Phase Commit is a foundational topic in Distributed Systems & Storage. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Distributed Tracing
Distributed Tracing is a foundational topic in Distributed Systems & Storage. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Service Mesh Fundamentals
Service Mesh Fundamentals is a foundational topic in Distributed Systems & Storage. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Sidecar Proxy Pattern
Sidecar Proxy Pattern is a foundational topic in Distributed Systems & Storage. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
CRDTs & Conflict-Free Replicated Data
CRDTs & Conflict-Free Replicated Data is a foundational topic in Distributed Systems & Storage. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Distributed Cron & Scheduling
Distributed Cron & Scheduling is a foundational topic in Distributed Systems & Storage. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Split-Brain Prevention
Split-Brain Prevention is a foundational topic in Distributed Systems & Storage. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Read Repair & Anti-Entropy
Read Repair & Anti-Entropy is a foundational topic in Distributed Systems & Storage. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Hinted Handoff & Repair
Hinted Handoff & Repair is a foundational topic in Distributed Systems & Storage. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Quorum Read/Write Tuning
Quorum Read/Write Tuning is a foundational topic in Distributed Systems & Storage. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Replicated Logs & Sequencing
Replicated Logs & Sequencing is a foundational topic in Distributed Systems & Storage. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Backpressure & Flow Control
Backpressure & Flow Control is a foundational topic in Distributed Systems & Storage. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Graceful Degradation Tiers
Graceful Degradation Tiers is a foundational topic in Distributed Systems & Storage. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Poison Message Handling
Poison Message Handling is a foundational topic in Distributed Systems & Storage. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Dead Letter Queues
Dead Letter Queues is a foundational topic in Distributed Systems & Storage. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Stream Watermarks & Late Data
Stream Watermarks & Late Data is a foundational topic in Distributed Systems & Storage. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Microservices Decomposition
Microservices Decomposition is a foundational topic in System Architecture & Design. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Modular Monolith Design
Modular Monolith Design is a foundational topic in System Architecture & Design. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Strangler Fig Migration
Strangler Fig Migration is a foundational topic in System Architecture & Design. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Hexagonal Architecture
Hexagonal Architecture is a foundational topic in System Architecture & Design. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Onion Architecture
Onion Architecture is a foundational topic in System Architecture & Design. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
DDD Tactical Patterns
DDD Tactical Patterns is a foundational topic in System Architecture & Design. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
DDD Strategic Context Mapping
DDD Strategic Context Mapping is a foundational topic in System Architecture & Design. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Serverless & FaaS Design
Serverless & FaaS Design is a foundational topic in System Architecture & Design. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Multi-Region Active-Active
Multi-Region Active-Active is a foundational topic in System Architecture & Design. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Multi-Region Disaster Recovery
Multi-Region Disaster Recovery is a foundational topic in System Architecture & Design. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Blue-Green Deployment
Blue-Green Deployment is a foundational topic in System Architecture & Design. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Rolling Deployment Strategy
Rolling Deployment Strategy is a foundational topic in System Architecture & Design. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Feature Flags & Progressive Delivery
Feature Flags & Progressive Delivery is a foundational topic in System Architecture & Design. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Observability Golden Signals
Observability Golden Signals is a foundational topic in System Architecture & Design. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Structured Logging & Correlation IDs
Structured Logging & Correlation IDs is a foundational topic in System Architecture & Design. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Metrics Cardinality Control
Metrics Cardinality Control is a foundational topic in System Architecture & Design. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
SLOs, SLAs & Error Budgets
SLOs, SLAs & Error Budgets is a foundational topic in System Architecture & Design. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Chaos Engineering
Chaos Engineering is a foundational topic in System Architecture & Design. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Capacity Planning & Forecasting
Capacity Planning & Forecasting is a foundational topic in System Architecture & Design. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
TCP/IP & Linux Socket Networking Internals
TCP delivers an in-order, guaranteed byte stream across unreliable packet-switched IP networks. The Linux kernel manages this via send/receive socket buffers (SO_SNDBUF/SO_RCVBUF), sliding-window flow control to protect receivers from saturation, and congestion algorithms (CUBIC/BBR) to regulate transmission across shared bottlenecks.
HTTP Semantics & Caching
HTTP Semantics & Caching is a foundational topic in Networking & Protocols. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
REST Resource Modeling
REST Resource Modeling is a foundational topic in Networking & Protocols. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
GraphQL Federation
GraphQL Federation is a foundational topic in Networking & Protocols. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
gRPC & Streaming RPC
gRPC & Streaming RPC is a foundational topic in Networking & Protocols. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
WebSocket Real-Time Scaling
WebSocket Real-Time Scaling is a foundational topic in Networking & Protocols. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
DNS & Traffic Routing
DNS & Traffic Routing is a foundational topic in Networking & Protocols. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
TLS Certificate Lifecycle
TLS Certificate Lifecycle is a foundational topic in Networking & Protocols. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Mutual TLS Between Services
Mutual TLS Between Services is a foundational topic in Networking & Protocols. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
CDN Architecture & Geo-Distributed Edge Caching
A Content Delivery Network (CDN) is a globally distributed network of Points of Presence (PoPs) that terminates client TCP/TLS connections physically close to users via BGP Anycast routing. By serving cached static assets and API responses from the network edge, CDNs reduce origin server load by 80-95% and drop round-trip times from hundreds of milliseconds to under 15ms.
Reverse Proxy Patterns & Edge Load Balancing
A reverse proxy acts as an intermediary gateway positioned between external clients and private backend services. It terminates client TLS handshakes, multiplexes requests across persistent upstream connection pools, distributes traffic via balancing algorithms (Round Robin, Least Connections, P2C), and guards internal services against direct internet exposure.
HTTP/2 Connection Multiplexing
HTTP/2 Connection Multiplexing is a foundational topic in Networking & Protocols. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
ACID Transaction Fundamentals
ACID Transaction Fundamentals is a foundational topic in Databases & Storage Engines. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Document Database Modeling
Document Database Modeling is a foundational topic in Databases & Storage Engines. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Wide-Column Databases
Wide-Column Databases is a foundational topic in Databases & Storage Engines. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Key-Value Store Patterns
Key-Value Store Patterns is a foundational topic in Databases & Storage Engines. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
PostgreSQL Query Planner
PostgreSQL Query Planner is a foundational topic in Databases & Storage Engines. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
MySQL Replication Topologies
MySQL Replication Topologies is a foundational topic in Databases & Storage Engines. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Database Connection Pool Tuning
Database Connection Pool Tuning is a foundational topic in Databases & Storage Engines. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Optimistic Concurrency Control
Optimistic Concurrency Control is a foundational topic in Databases & Storage Engines. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Pessimistic Locking Strategies
Pessimistic Locking Strategies is a foundational topic in Databases & Storage Engines. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Materialized View Refresh Strategies
Materialized View Refresh Strategies is a foundational topic in Databases & Storage Engines. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Online Schema Migrations
Online Schema Migrations is a foundational topic in Databases & Storage Engines. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Change Data Capture (CDC)
Change Data Capture (CDC) is a foundational topic in Databases & Storage Engines. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Columnar Analytics Engines
Columnar Analytics Engines is a foundational topic in Databases & Storage Engines. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Full-Text Inverted Indexes
Full-Text Inverted Indexes is a foundational topic in Databases & Storage Engines. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Point-in-Time Recovery
Point-in-Time Recovery is a foundational topic in Databases & Storage Engines. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
OAuth2 Authorization Flows
OAuth2 Authorization Flows is a foundational topic in Security & Identity. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
OpenID Connect Identity
OpenID Connect Identity is a foundational topic in Security & Identity. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
JWT Validation Pitfalls
JWT Validation Pitfalls is a foundational topic in Security & Identity. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
CSRF Defense Patterns
CSRF Defense Patterns is a foundational topic in Security & Identity. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
XSS & Content Security Policy
XSS & Content Security Policy is a foundational topic in Security & Identity. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
SQL Injection Prevention
SQL Injection Prevention is a foundational topic in Security & Identity. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Secrets Management & Vaults
Secrets Management & Vaults is a foundational topic in Security & Identity. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Encryption at Rest & in Transit
Encryption at Rest & in Transit is a foundational topic in Security & Identity. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Zero Trust Networking
Zero Trust Networking is a foundational topic in Security & Identity. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
MFA & Risk-Based Authentication
MFA & Risk-Based Authentication is a foundational topic in Security & Identity. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
RBAC Policy Design
RBAC Policy Design is a foundational topic in Security & Identity. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Supply Chain Security & SBOMs
Supply Chain Security & SBOMs is a foundational topic in Security & Identity. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Transformer Self-Attention
Transformer Self-Attention is a foundational topic in AI & Machine Learning. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
LLM Fine-Tuning & LoRA
LLM Fine-Tuning & LoRA is a foundational topic in AI & Machine Learning. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
RAG Retrieval Pipelines
RAG Retrieval Pipelines is a foundational topic in AI & Machine Learning. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Embedding Model Selection
Embedding Model Selection is a foundational topic in AI & Machine Learning. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
LLM Evaluation Harnesses
LLM Evaluation Harnesses is a foundational topic in AI & Machine Learning. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Prompt Injection Defenses
Prompt Injection Defenses is a foundational topic in AI & Machine Learning. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Model Serving & GPU Batching
Model Serving & GPU Batching is a foundational topic in AI & Machine Learning. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Feature Stores for ML
Feature Stores for ML is a foundational topic in AI & Machine Learning. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
ML Pipeline Orchestration
ML Pipeline Orchestration is a foundational topic in AI & Machine Learning. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Reinforcement Learning Basics
Reinforcement Learning Basics is a foundational topic in AI & Machine Learning. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Hybrid Vector & Keyword Search
Hybrid Vector & Keyword Search is a foundational topic in AI & Machine Learning. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Semantic Caching for LLMs
Semantic Caching for LLMs is a foundational topic in AI & Machine Learning. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
LLM Agent Tool Use
LLM Agent Tool Use is a foundational topic in AI & Machine Learning. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Multi-Agent Orchestration
Multi-Agent Orchestration is a foundational topic in AI & Machine Learning. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Context Compression for RAG
Context Compression for RAG is a foundational topic in AI & Machine Learning. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Kubernetes Workloads & Services
Kubernetes Workloads & Services is a foundational topic in DevOps & Infrastructure. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Docker Images & Layers
Docker Images & Layers is a foundational topic in DevOps & Infrastructure. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
CI/CD Quality Gates
CI/CD Quality Gates is a foundational topic in DevOps & Infrastructure. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Terraform Modules & State
Terraform Modules & State is a foundational topic in DevOps & Infrastructure. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Argo CD GitOps
Argo CD GitOps is a foundational topic in DevOps & Infrastructure. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Helm Chart Releases
Helm Chart Releases is a foundational topic in DevOps & Infrastructure. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Config vs Secrets Separation
Config vs Secrets Separation is a foundational topic in DevOps & Infrastructure. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Immutable Infrastructure
Immutable Infrastructure is a foundational topic in DevOps & Infrastructure. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Container Image Scanning
Container Image Scanning is a foundational topic in DevOps & Infrastructure. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Release Train Cadence
Release Train Cadence is a foundational topic in DevOps & Infrastructure. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
On-Call Escalation Policies
On-Call Escalation Policies is a foundational topic in DevOps & Infrastructure. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Artifact Registry Versioning
Artifact Registry Versioning is a foundational topic in DevOps & Infrastructure. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Thread Pool Design
Thread Pool Design is a foundational topic in Concurrency & Runtime. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Goroutine Worker Pools
Goroutine Worker Pools is a foundational topic in Concurrency & Runtime. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Async/Await & Deadlock Avoidance
Async/Await & Deadlock Avoidance is a foundational topic in Concurrency & Runtime. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Lock-Free Atomics
Lock-Free Atomics is a foundational topic in Concurrency & Runtime. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Memory Models & Happens-Before
Memory Models & Happens-Before is a foundational topic in Concurrency & Runtime. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Deadlock Detection & Prevention
Deadlock Detection & Prevention is a foundational topic in Concurrency & Runtime. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Actor Model Concurrency
Actor Model Concurrency is a foundational topic in Concurrency & Runtime. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Reactive Streams Backpressure
Reactive Streams Backpressure is a foundational topic in Concurrency & Runtime. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Unit Testing Pyramid
Unit Testing Pyramid is a foundational topic in Software Quality & Testing. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Consumer-Driven Contract Testing
Consumer-Driven Contract Testing is a foundational topic in Software Quality & Testing. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Property-Based Testing
Property-Based Testing is a foundational topic in Software Quality & Testing. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Load, Soak & Spike Testing
Load, Soak & Spike Testing is a foundational topic in Software Quality & Testing. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Test Doubles & Mocks
Test Doubles & Mocks is a foundational topic in Software Quality & Testing. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Mutation Testing
Mutation Testing is a foundational topic in Software Quality & Testing. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
E2E Flake Reduction
E2E Flake Reduction is a foundational topic in Software Quality & Testing. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Observability-Driven Testing
Observability-Driven Testing is a foundational topic in Software Quality & Testing. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
ETL vs ELT Pipelines
ETL vs ELT Pipelines is a foundational topic in Data Engineering. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Data Mesh Principles
Data Mesh Principles is a foundational topic in Data Engineering. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Lambda Architecture (Batch + Stream)
Lambda Architecture (Batch + Stream) is a foundational topic in Data Engineering. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Kappa Stream-Only Architecture
Kappa Stream-Only Architecture is a foundational topic in Data Engineering. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Data Quality Checks
Data Quality Checks is a foundational topic in Data Engineering. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Airflow DAG Orchestration
Airflow DAG Orchestration is a foundational topic in Data Engineering. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Dimensional Modeling & Star Schemas
Dimensional Modeling & Star Schemas is a foundational topic in Data Engineering. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Memory Allocators
Memory Allocators is a foundational topic in Programming Languages & Runtime. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Garbage Collection Algorithms
Garbage Collection Algorithms is a foundational topic in Programming Languages & Runtime. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
JIT & Hotspot Optimization
JIT & Hotspot Optimization is a foundational topic in Programming Languages & Runtime. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Error Handling with Result Types
Error Handling with Result Types is a foundational topic in Programming Languages & Runtime. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Dependency Injection
Dependency Injection is a foundational topic in Programming Languages & Runtime. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Type Systems & Generics
Type Systems & Generics is a foundational topic in Programming Languages & Runtime. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
CPU Profiling & Flame Graphs
CPU Profiling & Flame Graphs is a foundational topic in Programming Languages & Runtime. Engineers use it to make predictable trade-offs under load, failure, and evolving requirements.
Design a URL Shortener
Design a URL shortening service similar to bit.ly or TinyURL. Users submit a long URL and receive a short alias (e.g., https://short.ly/aB3x…
Design a Distributed Rate Limiter
Design a rate limiter for a public API that enforces per-user and per-IP request limits at scale. The service must handle high throughput, b…
Design a Notification Service
Design a notification service for a social media platform. The service must deliver notifications to users via push (mobile), email, and in-…
Implement an LRU Cache
Design a data structure that follows the constraints of a Least Recently Used (LRU) cache. Implement get(key) and put(key, value) operations…
Top K Frequent Elements
Given an integer array nums and an integer k, return the k most frequent elements. The algorithm's time complexity must be better than O(N l…
Design a Distributed Unique ID Generator
Design a globally distributed unique ID generation service (similar to Twitter Snowflake). Generated IDs must be 64-bit integers, globally u…
Design a Thread-Safe Bounded Blocking Queue
Design and implement a thread-safe Bounded Blocking Queue with put(element) and get() methods. When the queue is full, producer threads call…
Design a Distributed Key-Value Store
Design a distributed, highly available key-value store similar to DynamoDB or Cassandra. The system must support put(key, value) and get(key…
Design a Circuit Breaker for Microservices
Design a resilient Circuit Breaker pattern to protect distributed microservices from cascading failures when downstream dependencies degrade…
Course Schedule & Cycle Detection
There are numCourses courses you have to take, labeled from 0 to numCourses - 1. You are given an array prerequisites where prerequisites[i]…
Cache-Aside & Read-Through Pattern
Mitigating high database latency under read-heavy workloads while maintaining consistency.
Token Bucket Rate Limiting Pattern
Preventing service degradation and cascading resource exhaustion under sudden bursts of incoming client traffic.
Probabilistic Membership Testing (Bloom Filter)
Eliminating expensive authoritative database round-trips for non-existent keys with zero false negatives.
Circuit Breaker Fault Isolation Pattern
Failing fast and isolating cascading downstream service latency before exhaustion of connection pools.
Horizontal Database Sharding Pattern
Scaling relational storage throughput and capacity beyond the physical constraints of a single database node.
Distributed Locking with Fencing Tokens
Enforcing mutual exclusion across distributed stateless workers accessing shared non-atomic resources.
Log-Structured Merge-Tree (LSM) Write Buffering
Optimizing high-throughput sequential write ingestion without stalling on random disk seeks.
Saga with Compensating Transactions
Coordinating multi-service business workflows without distributed two-phase commit locks.
Transactional Outbox
Publishing integration events reliably after local database commits without dual-write races.
CQRS Read/Write Separation
Scaling asymmetric read and write workloads with independent models and projections.
Bulkhead Resource Isolation
Preventing one slow dependency from exhausting shared thread pools and connection limits.
Idempotent API Handlers
Making retries safe under at-least-once delivery from gateways, queues, and mobile clients.
System Design Interview Prep Roadmap
Structured curriculum for system design interviews — from fundamentals to trade-offs.
Why build a space shuttle when all you need is a bicycle? Meet the KISS principle!
Foundational engineering principle for distributed system design.
How do systems check if usernames exist instantly without slow database calls? | Bloom Filters
Core probabilistic data structure used in distributed databases.
Standard chains break when agents need loops or coordination: LangGraph vs LangChain
Agentic system design patterns for enterprise LLM systems.
How do browsers and servers establish a secure connection in milliseconds? | SSL/TLS Handshake
Essential transport security protocol for distributed web services.
How do distributed cluster nodes scale to millions of users without losing data? | Consistent Hashing
Core partitioning algorithm for distributed caches and key-value stores.
How do giant systems track millions of real-time events without crashing? | Kafka
Gold standard event streaming engine for microservices decoupling.