Distributed Data Placement for NVMf Scale-out Storage Cluster on AWS

Simplyblock builds a distributed lock storage system, which is fully containerized, runs on most virtualization platforms and clouds and is currently optimized for aws environments. Simplyblock is built to fully utilize local nvme IOPS and provide low storage access latency (less than 200 microseconds over the network). Virtual volumes are highly available and protected by erasure coding. Simplyblock clusters are self-balancing and highly scaleable. For this purpose, we use a distributed data placement algorithm. In this session, we plan to discuss the common challenges of a distributed architecture for reliable, self-balancing storage scale-out, specific challenges in the context of low latency and high IOPS density, nvmf-tcp and nvmf multipathing, and present the design of new algorithm to overcome them.