Architecture & Systems

Data-Intensive Apps

Designing reliable, scalable data systems

Design reliable, scalable, and maintainable data systems using Martin Kleppmann's comprehensive guide. This skill equips your AI agent with deep knowledge of storage engines, replication, partitioning, consistency models, and stream processing for building data-intensive applications.

Designing Data-Intensive Applications by Martin Kleppmann

Designing Data-Intensive Applications

by Martin Kleppmann

npx skills add wondelai/skills/ddia-systems

What your agent learns

Storage Engines

Understand the trade-offs between B-trees and LSM-trees, row vs columnar storage, and when to use each.

Replication & Partitioning

Choose between single-leader, multi-leader, and leaderless replication. Partition data by key range or hash for scalability.

Consistency & Consensus

Navigate linearizability, causal consistency, eventual consistency, and distributed consensus algorithms like Raft and Paxos.

Batch & Stream Processing

Design data pipelines using MapReduce, dataflow engines, and stream processing with exactly-once semantics.

Distributed System Failures

Design for unreliable networks, clocks, and nodes. Understand the impossibility results and practical workarounds.

Martin Kleppmann

Cambridge researcher, former LinkedIn engineer, definitive data systems author

Martin Kleppmann is a researcher at the University of Cambridge and a former software engineer at LinkedIn and Rapportive. His book has become the definitive reference for understanding the internals of modern data systems.

View Book →

Try these with the skill installed

Recommend a storage engine and replication strategy for our write-heavy workload using ddia-systems skill

Database design

Design a data partitioning scheme that avoids hotspots using ddia-systems skill

Scalability

Evaluate consistency trade-offs for our distributed checkout system using ddia-systems skill

System design

Design a stream processing pipeline for real-time analytics using ddia-systems skill

Data architecture

Install Data-Intensive Apps

Free, open-source, and ready in 30 seconds.

npx skills add wondelai/skills/ddia-systems

MIT Licensed · Works with Claude Code, Cursor, Claude Cowork & OpenClaw · No account needed