Bangalore, Karnataka, India
Summary
Currently serving as a Data Engineer at KPMG, designing and orchestrating scalable data pipelines and developing robust ETL workflows for critical data solutions.
Highlights
Designed and orchestrated scalable big data pipelines leveraging Apache Airflow and Apache Spark to process high-volume datasets.
Developed Python-based ETL workflows, integrating robust data quality validation to ensure data integrity and accuracy.
Automated deployments using AWS CodeBuild and managed infrastructure with Git-based CI/CD, streamlining release cycles.
Utilized AWS S3, EMR, Lambda, and CloudWatch to build and monitor scalable, cloud-native data solutions.
Optimized Directed Acyclic Graph (DAG) performance for time-sensitive batch data workflows, enhancing data delivery efficiency.