Inside the Cloud: A Deep Dive into Cold Data Archiving

Thu Sep 21 | 10:10am
Location:
Salon II, Salon III
Abstract

Cold data holds significant value for regulatory compliance, audits, legal necessities, and disaster recovery, even though it's not frequently accessed. Archiving is a strategic approach that enables businesses to manage this data efficiently, balancing cost, scalability, and performance. This presentation will highlight key features of leading cloud-based archival systems like AWS S3/Glacier, Azure Archive Storage, Google Cloud Storage, etc. We’ll delve into asynchronous data access on archives and the role of staging data in this process. Later we will go into intricacies of building an enterprise level archival system and the role of metadata stores on distributed archival storage. Furthermore, we'll confront challenges such as ensuring data integrity and durability, continuous repair services, and managing system boundaries. Join this session for valuable insights into archival strategies, distributed systems, and cloud storage.

Learning Objectives

  • Cold data and archival introduction
  • Dive deep into cloud providers archival features
  • Managing archival storage using distributed systems
  • Scaling archival storage
  • Problems/challenges and best practices on distributed archival systems

Abstract

Cold data holds significant value for regulatory compliance, audits, legal necessities, and disaster recovery, even though it's not frequently accessed. Archiving is a strategic approach that enables businesses to manage this data efficiently, balancing cost, scalability, and performance. This presentation will highlight key features of leading cloud-based archival systems like AWS S3/Glacier, Azure Archive Storage, Google Cloud Storage, etc. We’ll delve into asynchronous data access on archives and the role of staging data in this process. Later we will go into intricacies of building an enterprise level archival system and the role of metadata stores on distributed archival storage. Furthermore, we'll confront challenges such as ensuring data integrity and durability, continuous repair services, and managing system boundaries. Join this session for valuable insights into archival strategies, distributed systems, and cloud storage.

Learning Objectives

  • Cold data and archival introduction
  • Dive deep into cloud providers archival features
  • Managing archival storage using distributed systems
  • Scaling archival storage
  • Problems/challenges and best practices on distributed archival systems


---

Related Sessions