Do you face the situation on a daily bases where you data lake queries are slow? updates to the data are nearly impossible? And end users face issues reading or updating data? Then apache iceberg could be the solution you are looking for. Iceberg is an open source table format, that was originally created by Netflix but was handed over to the apache foundation, that allows for fast querying regardless of how the structure in which the data files are stored. Iceberg has native merge into syntax allowing for updates, inserts and delete on petabytes in data. And with ACID transactions it resolves the issue when multi users are trying to access the data simultaneously. In this video we cover the theory of how Apache Iceberg works, and create our own tables in AWS.


LINK TO GITHUB TUTORIAL RESOURCES:
💾 Code Repo: https://github.com/johnny-chivers/ice...


SUPPORT THE CHANNEL:
☕ Buy Me A Coffee: https://www.buymeacoffee.com/johnnych...
🖥️ My VPN: https://go.nordvpn.net/aff_c?offer_id...


▬▬▬▬▬▬ T I M E S T A M P S ⏰ ▬▬▬▬▬▬
00:00 - Intro
01:05 - Iceberg Theory
06:58 - Set Up Work
10:01 - Apache Iceberg Main Tutorial
12:31 - Create CSV table
13:58 - Create Iceberg Table
17:03 - Insert Data Into Iceberg Table
19:46 - Select Data From Iceberg Table
21:28 - Updata Data
22:43 - Time Travel In Iceberg
25:10 - Delet Data
27:23 - Clean Up Resources
27:44 - Outro


OTHER USEFUL LINKS:
📹 Glue Tutorial:    • AWS Glue Tutorial for Beginners [FULL...  
ℹ️ My Website: https://johnnychivers.co.uk
🔗 Linkedin:   / johnny-chivers  


😎 About me
I have spent the last decade being immersed in the world of big data working as a consultant for some the globe's biggest companies.My journey into the world of data was not the most conventional. I started my career working as performance analyst in professional sport at the top level's of both rugby and football. I then transitioned into a career in data and computing. This journey culminated in the study of a Masters degree in Software


Enjoy 🤘