shaik's CV

Message
WhatsAppLinkedIn

Profile summary

Data Engineer with nearly 4 years building and operating production ETL/ELT pipelines on the Microsoft Azure stack - Microsoft Fabric, Azure Data Factory, Azure Databricks, PySpark, and Delta Lake - for enterprise clients across the UK and North America, including pipelines processing 750M+ records monthly. Within cross-functional teams, owned the metadata-driven ingestion design, automated data quality checks, and Spark performance tuning behind a Lakehouse migration that cut regulatory audit findings by ~30% and manual pipeline maintenance by up to ~60%. Picks up new platforms fast - currently building hands-on Snowflake experience alongside core Azure work. Open to data engineering roles across industries; available immediately in Riyadh.

Career highlights

Microsoft Fabric Migration: Contributed to migrating a legacy enterprise data warehouse to Microsoft Fabric Lakehouse while owning data lineage tracking and governance controls.

ETL Pipeline Development: Developed ETL and ELT pipelines using Fabric Notebooks, PySpark, and SQL to process millions of records monthly.

Metadata Driven Ingestion: Built a metadata-driven ingestion framework handling multiple source tables across full-load, incremental, and change data capture patterns.

Key skills

TechnicalSpark SQL Python SQL T-SQL SQL Server Oracle SQL
ProfessionalMicrosoft Azure Microsoft Fabric Azure Data Lake Gen2 Azure Data Factory (ADF) Azure Databricks Data Ingestion Metadata-Driven Ingestion ETL/ELT Data Validation Medallion Architecture (Bronze-Silver-Gold) Lakehouse Architecture Data Lineage Metadata Management Data Quality Frameworks Schema Enforcement Audit Readiness Apache Spark Delta Lake PySpark

Professional experience

Data Engineer (Software Engineer - Data Engineering)Jul 2022 - May 2026
CGIBangalore, India

Managed data engineering operations as part of a cross-functional team, overseeing the execution of cloud migrations, pipeline development, and data quality frameworks across enterprise reporting environments.

  • Migrated a legacy enterprise data warehouse to Microsoft Fabric Lakehouse as part of a 5-member team, owning data lineage tracking to cut regulatory audit findings by 30%.
  • Built a secure hybrid ingestion layer migrating 500 GB of on-premises operational data into Microsoft Fabric on schedule within a broader migration structure.
  • Developed ETL and ELT pipelines using Fabric Notebooks, PySpark, and SQL to process 750M+ monthly records, improving downstream analytics throughput by 25%.
  • Implemented Medallion Architecture on Delta Lake with schema enforcement, deduplication, incremental loading, and ACID compliance to address audit consistency issues.
  • Built 15+ automated data quality and reconciliation checks in Python and PySpark, improving consistency by 20% across finance and operations reporting datasets.

Projects

github.com/mahammadadilshaik382-max — one production-style data engineering project, built end-to-end and verified

with real run results Medallion Architecture Lakehouse — PySpark · Delta Lake | End-to-end Bronze-Silver-Gold pipeline on a 7,000+ row

public dataset, built to mirror production patterns from the Bell Canada and TalkTalk engagements above. View repo.

Metadata-driven ingestion (config/pipeline_config.json, src/bronze_ingestion.py) — source tables, load type, and primary keys are all config-driven via a JSON control file rather than hardcoded, the same pattern used to onboard 30+ source

tables in production without rewriting pipeline code.

Automated data quality framework (src/utils/data_quality.py) — reusable validation library (null thresholds, duplicate key detection, schema checks, row-count reconciliation) that ran 9/9 checks passing with 0% row loss end-to-end on this dataset.

Education

Bachelor of Engineering, Electrical & Electronics Engineering (EEE)Jan 2018 - Jan 2022
New Horizon College of Engineering, Bangalore · Visvesvaraya Technological University (VTU)

Foundation in systems design and analytical problem-solving, applied directly to large-scale pipeline architecture and Spark optimization.

Certifications

Microsoft Certified: Fabric Analytics Engineer Associate (DP-700) In ProgressDP-700

Languages

English · Professional

Hindi · Professional

Telugu · Native

Kannada · Intermediate