Projects

We aim to identify patterns and trends that will enhance our understanding of the topic.

ELT Pipeline: GCS to Big Query

https://www.linkedin.com/posts/kazimdfarhan_gcp-healthcareproject-elt-activity-7314669592860114945-skEC?utm_source=share&utm_medium=member_desktop&rcm=ACoAACgWo0wB8IpD7th51ZHVl5RA6Rf0QCtNx9A

project focuses on building an ELT (Extract, Load, Transform) pipeline Apache Airflow to efficiently transfer health data from Google Cloud Storage (GCS) to BigQuery. The pipeline automates the extraction of data from GCS, loads it into BigQuery, and then transforms the data for analysis. By leveraging Airflow's orchestration capabilities, the project ensures reliable and timely data processing, enabling stakeholders to make informed based on accurate health data insights.