Loading at Hyperscale: Advanced Data Import Techniques for Citus

117 Aufrufe

Danke für die Bewertung! Teile es mit Deinen Freunden!

Danke für Deine Bewertung!

Published Apr 25, 2022

Video of a talk by Colton Shepard delivered at Citus Con: An Event for Postgres. Abstract: Citus’s ability to parallelize write operations is awesome, but it’s not always easy to take it to the extreme. This talk starts with the basics of loading data and when to use \COPY in Postgres versus single-row inserts—and then goes into more advanced topics. Microbatching \COPY operations, a case study in data ordering, Postgres tutorials on direct worker writes, and a discussion of distributed triggers will all be covered in this talk.

Colton Shepard is a Citus and Microsoft alumni, having spent several years as a Solutions Engineer onboarding and migrating customers of the Citus extension to Postgres. Colton now works at TRM Labs, a blockchain intelligence company that helps prevent fraud and financial crime.

► Video bookmarks:
⏩ 01:59 Single row inserts, upserts, & \COPY
⏩ 05:46 Microbatched & parallelized \COPY
⏩ 10:18 Index juggling
⏩ 14:01 Data ordering with case study
⏩ 17:08 Distributed triggers
⏩ 22:38 Direct worker loading

✅ Learn more:
Watch more Citus Con talks: https://aka.ms/cituscon-playlist