In this talk we look at that collaboration that takes places between storage-devices and open-source system-software. And how this collaboration aims to address variety of problems such as high-latency, cpu-consumption, endurance, noisy-neighbor, TCO etc.
The talk covers few important storage/software advancements that has taken place in recent times:
- New storage interfaces such as streams, zns, and computational-storage. What problems these solve, and open-ecosystem emerging around it
- Fast NVMe SSDs - how these compel refinements in core Linux (io_uring, spdk etc.)
- How the OS (Linux Kernel in this case) abstractions are being revamped to reduce the semantic gap between application and storage interfaces
- New open-source libraries (liburing, xnvme, photon etc.) that make it easy for data-intensive systems (DBs, File-systems etc.) to consume these advancements