Data Engineering Projects
Hotel Reviews
Developed a Data Engineering project for Hotel Reviews, employing Prefect for workflow management, Spark for distributed processing, SQL for data querying, dbt for data transformations, Terraform for infrastructure provisioning, Looker for data exploration and visualization, and implemented CI/CD pipelines. Deployed the project on Google Cloud Platform (GCP) for scalable data processing and analytics
Air Quality Switzerland
Implemented a Data Engineering project for Air Quality in Switzerland. This project uses Mage for efficient workflow management, dbt for seamless data transformations, Terraform for setting up infrastructure, and Looker for comprehensive data exploration and visualization. Deployed the project on Google Cloud Platform (GCP) for scalable data processing and analytics