Andreea Olaru

Sinopsis In this talk we will walk you through our journey of experimenting with different ETL solutions for creating and updating a dataset in the new AWS service: Table Buckets. Source data resides in glue tables and RDS. We start experimentation with Athena and eventually select Glue with Apache Spark as a solution. The presentation is focused on exploring the upsides and limitations of each solution, costs, challenges we faced, solutions we considered and local setup of an apache spark job.