Amzad Khan – Azure Cloud Data Pipeline for Retail Sales Analytics – Personal / Academic Project

I built an Azure cloud data pipeline for retail sales analytics, ingesting CSV and REST API data with Azure Data Factory into Azure Data Lake Storage Gen2.

I organized the data in a Bronze/Silver/Gold medallion architecture and developed cleansing and transformation logic with PySpark and Python. This project reduced manual processing time by an estimated 40%.

I automated pipeline scheduling and monitoring, then loaded curated data into Azure SQL Database and modeled star-schema tables for reporting and Power BI dashboards.

I also applied Git and GitHub for version control and explored incremental loading strategies. I’m seeking a Data Engineer role designing and optimizing scalable cloud data solutions.

Read more here: Source link