Amzad Khan – Azure Cloud Data Pipeline for Retail Sales Analytics – Personal / Academic Project
I built an Azure cloud data pipeline for retail sales analytics, ingesting CSV and REST API data with Azure Data Factory into Azure Data Lake Storage Gen2.
I organized the data in a Bronze/Silver/Gold medallion architecture and developed cleansing and transformation logic with PySpark and Python. This project reduced manual processing time by an estimated 40%.
I automated pipeline scheduling and monitoring, then loaded curated data into Azure SQL Database and modeled star-schema tables for reporting and Power BI dashboards.
I also applied Git and GitHub for version control and explored incremental loading strategies. I’m seeking a Data Engineer role designing and optimizing scalable cloud data solutions.
Read more here: Source link
