Discover the Art of

System Design

Exploring the fascinating world of algorithms, data structures, and software engineering through clear explanations and practical examples.

System Design Distributed Systems Architecture Llm

abstract-algo — bash

$

Start Here

New to System Design Interview Prep?

Read these foundational posts in order to build a strong mental model before diving into advanced topics.

View full series

1
The Ultimate Guide to Acing the System Design Interview
Don't panic. System Design interviews are open-ended discussions. This framework (Requirements, API, DB, Scale) will help you structure your answer.
14 min
2
System Design Core Concepts: Scalability, CAP, and Consistency
The building blocks of distributed systems. Learn about Vertical vs Horizontal scaling, the CAP Theorem, and ACID vs BASE.
13 min
3
System Design Networking: DNS, CDNs, and Load Balancers
The internet's traffic control system. We explain how DNS resolves names, CDNs cache content, and Load Balancers distribute traffic.
16 min
4
System Design Protocols: REST, RPC, and TCP/UDP
How do servers talk to each other? This guide explains the key protocols: REST vs RPC for APIs, TCP vs UDP for transport.
17 min
5
System Design Databases: SQL vs NoSQL and Scaling
The eternal debate: SQL or NoSQL? We break down ACID vs BASE, Sharding vs Replication, and when to use MongoDB vs PostgreSQL.
14 min

Series

LLM Engineering

5 posts

View all

Series

How It Works: Internals Explained

5 posts

View all

Featured Articles

AiMachine Learning

Machine Learning Fundamentals: A Beginner-Friendly Guide to AI Concepts

What is the difference between AI, ML, and Deep Learning? We break down the jargon and explain Supervised vs. Unsupervised learning.

Abstract Algorithms·Feb 7, 2026·16 min read

Read article

ArchitectureDeep Learning

Sparse Mixture of Experts: How MoE LLMs Do More With Less Compute

How MoE replaces the dense FFN with N expert layers and a learned router — GPT-4-scale capacity at a fraction of inference cost

Apr 17, 2026·28 min read

ArchitectureDeep Learning

Dense LLM Architecture: How Every Parameter Works on Every Token

Inside the dense transformer block — attention heads, FFN layers, and why scaling dense models hits a wall

Apr 17, 2026·24 min read

Browse by topic

Topic Clusters

System Design90 posts

View all

Partitioning Approaches in SQL and NoSQL: Horizontal, Vertical, Range, Hash, and List Partitioning

Apr 12, 2026·40 min read

Data Anomalies in Distributed Systems: Split Brain, Clock Skew, Stale Reads, and More

Apr 5, 2026·42 min read

Sharding Approaches in SQL and NoSQL: Range, Hash, and Directory-Based Strategies Compared

Apr 5, 2026·29 min read

Distributed Systems60 posts

View all

Compare-and-Swap and Optimistic Locking: How Every Database Implements It

Apr 17, 2026·34 min read

Change Feed vs Change Stream: CDC Internals, Reliability, and When to Avoid Each

Apr 17, 2026·50 min read

Dirty Write Explained: When Uncommitted Data Gets Overwritten

Apr 11, 2026·30 min read

Architecture50 posts

View all

Llm48 posts

View all

Sparse Mixture of Experts: How MoE LLMs Do More With Less Compute

Apr 17, 2026·28 min read

Dense LLM Architecture: How Every Parameter Works on Every Token

Apr 17, 2026·24 min read

LLM Software Development Pitfalls: What to Avoid and When to Simplify

Apr 17, 2026·20 min read

Ai46 posts

View all

How AI Coding Agents Work: Models, Context, Sessions, and Memory

Apr 10, 2026·34 min read

Reinforcement Learning: Agents, Environments, and Rewards in Practice

Mar 29, 2026·17 min read

Types of LLM Quantization: By Timing, Scope, and Mapping

Mar 14, 2026·17 min read

Interview Prep35 posts

View all

Key Terms in Distributed Systems: The Definitive Glossary

Apr 5, 2026·47 min read

Real-Time Communication: WebSockets, SSE, and Long Polling Explained

Mar 28, 2026·23 min read

Microservices Architecture: Decomposition, Communication, and Trade-offs

Mar 28, 2026·22 min read

Recent Articles

Browse all posts

NewRecently Added

Sparse Mixture of Experts: How MoE LLMs Do More With Less Compute

Apr 17, 2026

Dense LLM Architecture: How Every Parameter Works on Every Token

Apr 17, 2026

Managed API LLMs vs Self-Hosted Models: When to Switch and When Not To

Apr 17, 2026

UpdatedRecently Updated

All refreshed posts sorted by last update.

View all

Sparse Mixture of Experts: How MoE LLMs Do More With Less Compute

Today·28 min read

Managed API LLMs vs Self-Hosted Models: When to Switch and When Not To

Today·17 min read

LLM Software Development Pitfalls: What to Avoid and When to Simplify

Today·20 min read

PopularTop Posts

Browse every post by popularity.

View all

1

LLM Skills vs Tools: The Missing Layer in Agent Design

240 views·16 min read

2

Little's Law: The Secret Formula for System Performance

107 views·13 min read

3

Machine Learning Fundamentals: A Beginner-Friendly Guide to AI Concepts

85 views·16 min read

Written by

Abstract Algorithms

@abstractalgorithms · 1 followers

Exploring the fascinating world of algorithms, data structures, and software engineering through clear explanations and practical examples.

Full bio

Discover the Art of

New to System Design Interview Prep?

The Ultimate Guide to Acing the System Design Interview

System Design Core Concepts: Scalability, CAP, and Consistency

System Design Networking: DNS, CDNs, and Load Balancers

System Design Protocols: REST, RPC, and TCP/UDP

System Design Databases: SQL vs NoSQL and Scaling

LLM Engineering

How It Works: Internals Explained

Featured Articles

Machine Learning Fundamentals: A Beginner-Friendly Guide to AI Concepts

Sparse Mixture of Experts: How MoE LLMs Do More With Less Compute

Dense LLM Architecture: How Every Parameter Works on Every Token

Topic Clusters

Partitioning Approaches in SQL and NoSQL: Horizontal, Vertical, Range, Hash, and List Partitioning

Data Anomalies in Distributed Systems: Split Brain, Clock Skew, Stale Reads, and More

Sharding Approaches in SQL and NoSQL: Range, Hash, and Directory-Based Strategies Compared

Compare-and-Swap and Optimistic Locking: How Every Database Implements It

Change Feed vs Change Stream: CDC Internals, Reliability, and When to Avoid Each

Dirty Write Explained: When Uncommitted Data Gets Overwritten

Sparse Mixture of Experts: How MoE LLMs Do More With Less Compute

Dense LLM Architecture: How Every Parameter Works on Every Token

Medallion Architecture: Bronze, Silver, and Gold Layers in Practice

Sparse Mixture of Experts: How MoE LLMs Do More With Less Compute

Dense LLM Architecture: How Every Parameter Works on Every Token

LLM Software Development Pitfalls: What to Avoid and When to Simplify

How AI Coding Agents Work: Models, Context, Sessions, and Memory

Reinforcement Learning: Agents, Environments, and Rewards in Practice

Types of LLM Quantization: By Timing, Scope, and Mapping

Key Terms in Distributed Systems: The Definitive Glossary

Real-Time Communication: WebSockets, SSE, and Long Polling Explained

Microservices Architecture: Decomposition, Communication, and Trade-offs

Recent Articles

Sparse Mixture of Experts: How MoE LLMs Do More With Less Compute

Dense LLM Architecture: How Every Parameter Works on Every Token

Managed API LLMs vs Self-Hosted Models: When to Switch and When Not To

Sparse Mixture of Experts: How MoE LLMs Do More With Less Compute

Managed API LLMs vs Self-Hosted Models: When to Switch and When Not To

LLM Software Development Pitfalls: What to Avoid and When to Simplify

LLM Skills vs Tools: The Missing Layer in Agent Design

Little's Law: The Secret Formula for System Performance

Machine Learning Fundamentals: A Beginner-Friendly Guide to AI Concepts

Abstract Algorithms