01netflixtechblog.com
TimeSeries Tiered Storage Journey: Kafka/Flink Streams to Native Cassandra Cold Reads
Netflix evolved its TimeSeries tiered storage from an Apache Kafka/Flink pipeline writing compacted Parquet to S3 into native Cassandra cold reads from existing S3 backups. Immutable Time Slices use ReadOnlyCompactionStrategy to align SSTables, while custom backup Memtables cache metadata locally and fetch data chunks on demand. An optional separate Cassandra cold cluster protects hot traffic. The system now stores over 15 PB, reduced disk usage from 80% to 7%, improved p90 latency by ~30%, and keeps p99 below 500 ms.