Made by Team Atkinson
We put the terra in terraform
We worked on a etl data pipeline that extracts data from a database and loads it into a data warehouse.
The Team
AL-Amin
Al-Amin, 27, previously worked as a data technician…
training to be a data engineer
Myles
Myles, Accounting turned data engineer
Deep
Deep Khadka – Data Engineer in Progress
Vadym
Vadym – QA engineer with medical background
Oleksii
Oleksii web developer
Tech Stack
We used VScode, AWS, Python, PSQL, Terraform. It was because it was convenient as well as something we wanted to learn about.
Challenges Faced
There was a problem using terraform that we all struggled with. Especially, using terraform for multiple machine. We also struggle transforming the data for the data warehouse.