Will Falconer

How Atlassian is migrating 40PB data with 99.99% reliability

Atlassian has recently embarked on a journey to migrate our existing media storage platform to a newly incubated Storage Platform. This required us to move 40+ PB of data across the 2 platforms without compromising Durability or Reliability. Not only is this a daunting engineering challenge but also a very exciting journey with lots of learnings, tradeoffs and architectural choices. The talk is intermediate complexity and will focus on transactional systems that serve the data online while the migration is executed under the hoods. We will cover scale challenges, migration blockers/mitigations, cost implications and techniques to ensure uptime and durability during the migration. Experience Atlassian's exciting and challenging journey as we dive deep into how we are migrating 40PB of data across platforms with 99.99% reliability. Join Yash & Will to uncover the strategies and technologies behind this monumental data transition!