Overview

Senior Data Engineer based in Mumbai with 7+ years of experience designing, developing, and operating data platforms for enterprise analytics and reporting.

At a glance

7+ Years in data engineering
4+ Domains
100+ Pipelines Delivered
60% Faster platform setup time

What I build

  • Data platforms using Azure, AWS and GCP based tools liek Databricks, Synapse, Data Factory, and .
  • Orchestrated pipelines with monitoring, alerts, and runbook-ready telemetry.
  • Metadata, governance, and row-level security controls.

Core platforms

Databricks Azure Synapse Azure Data Factory Snowflake

Recent impact

  • Built a command and control application for managing 30+ manufacturing plants with 40+ KPI drilldowns.
  • Implemented metadata and data quality monitoring with alerts and escalations in Synapse.
  • Automated platform deployments with GitHub Actions, Azure DevOps, and Terraform to cut setup time by 60%.

Experience

  • YipitData - Senior Data Engineer, Aug 2025 to Present (Remote)
  • Neudesic - Senior Data Engineer, Dec 2021 to July 2025 (Remote)
  • TCS - Data Engineer, Nov 2018 to Dec 2021 (Mumbai)

See projects for a deeper look at platforms delivered and optimizations shipped.

Projects

Project highlights from client platforms and internal accelerators.

Command and Control Data Platform

Designed an Azure Synapse platform with ingestion and transformation across SAP CDC, API, and SFTP sources, modeling data in Databricks for KPI reporting.

  • Client: Leading Indian cement manufacturer
  • Outcome: 30+ plants and 40+ KPI drilldowns

Metadata and Data Quality Framework

Built metadata services in Cosmos DB with serverless Azure Functions for configuration, scheduling, and logging, plus Synapse monitoring for benchmarks and alerts.

  • Security: Custom row-level security for fine-grained access
  • Delivery: CI/CD for Synapse, Cosmos DB, and Azure Functions

IT Infrastructure Provider Data Platform

Led a pilot using Delta Live Tables and Auto Loader for bronze and silver layers, contributing to an ingestion and processing framework on Azure Data Factory and Databricks.

In-House Data Platform Accelerator

Automated deployment of Azure Data Factory or Synapse, Databricks, and Storage using GitHub Actions, Azure DevOps pipelines, and Terraform templates.

  • Impact: 60% reduction in configuration time
  • Innovation: Delta tables for metadata and Delta Catalog POC for RBAC

Command and Control Data Platform

Delivered a command and control data platform for a leading Indian cement manufacturer, enabling unified visibility across manufacturing, sales, and logistics.

What I delivered

  • Architected an Azure Synapse platform with pipelines orchestrating ingestion and transformation.
  • Partnered with stakeholders to map manufacturing, sales, and logistics processes into a tailored data model.
  • Integrated SAP CDC, API, and SFTP sources into a unified data model using PySpark notebooks on Databricks.
  • Delivered 40+ KPI drilldowns spanning 30+ manufacturing plants.
  • Led a team of three data engineers and one analytics engineer to deliver the pilot within the first month.

Platform capabilities

  • Built a metadata framework with Cosmos DB and serverless Azure Functions for source configuration, scheduling, and logging.
  • Implemented data quality monitoring in Synapse with benchmark deviation alerts and escalations.
  • Set up CI/CD for Synapse, Cosmos DB, and Azure Functions using Azure DevOps pipelines.
  • Designed a custom row-level security framework for fine-grained access control.

Metadata and Data Quality Framework

Designed a governance and quality layer to keep the platform reliable, observable, and secure.

Highlights

  • Implemented a metadata framework using Cosmos DB with a serverless Azure Function interface.
  • Centralized source configuration, scheduling, and pipeline logging.
  • Monitored quality benchmarks in Synapse with deviation alerts and escalations.
  • Contributed to custom row-level security for role-based access across business units.

Delivery

  • Configured CI/CD for Synapse components, Cosmos DB, and Azure Functions.

IT Infrastructure Provider Data Platform

Built a pilot data platform to monitor incident resolution time and analyze turnaround metrics for service requests.

Highlights

  • Evaluated Delta Live Tables with Auto Loader as bronze and silver layers in the lakehouse.
  • Contributed to an ingestion and processing framework on Azure Data Factory and Databricks.

In-House Data Platform Accelerator

Built an accelerator to deploy standardized Azure data platforms rapidly based on user inputs.

What it automated

  • Provisioned Azure Data Factory or Synapse, Databricks, and Storage resources with reusable templates.
  • Supported deployments with GitHub Actions, Azure DevOps pipelines, and Terraform templates.

Impact and innovations

  • Reduced configuration time by 60% through automation.
  • Evaluated hosting the metadata database as Delta tables to decouple storage and compute.
  • Built a Delta Catalog POC to improve data sharing and RBAC control.

Skills

Hands-on tooling and methods used across ingestion, transformation, governance, and delivery automation.

Technologies

Azure Synapse Azure Data Factory Databricks Snowflake Azure Data Lake Azure Storage SQL Python Azure DevOps GitHub Actions

Techniques

Data pipeline design Database modeling Data wrangling Data normalization CI/CD

Certifications

Academic Achievement

Technical paper publication (2019): "Machine Learning Based Autonomous Road Maintenance System Using Cold Lay Asphalt" in the international journal Helix, Vol. 8(5): 4002-4006.

Education

University of Mumbai, Mumbai - Bachelor of Engineering in Electronics and Telecommunication (Jun 2018). CGPA 7.94/10.

Elements

Text

This is bold and this is strong. This is italic and this is emphasized. This is superscript text and this is subscript text. This is underlined and this is code: for (;;) { ... }. Finally, this is a link.


Heading Level 2

Heading Level 3

Heading Level 4

Heading Level 5
Heading Level 6

Blockquote

Fringilla nisl. Donec accumsan interdum nisi, quis tincidunt felis sagittis eget tempus euismod. Vestibulum ante ipsum primis in faucibus vestibulum. Blandit adipiscing eu felis iaculis volutpat ac adipiscing accumsan faucibus. Vestibulum ante ipsum primis in faucibus lorem ipsum dolor sit amet nullam adipiscing eu felis.

Preformatted

i = 0;

while (!deck.isInOrder()) {
    print 'Iteration ' + i;
    deck.shuffle();
    i++;
}

print 'It took ' + i + ' iterations to sort the deck.';

Lists

Unordered

  • Dolor pulvinar etiam.
  • Sagittis adipiscing.
  • Felis enim feugiat.

Alternate

  • Dolor pulvinar etiam.
  • Sagittis adipiscing.
  • Felis enim feugiat.

Ordered

  1. Dolor pulvinar etiam.
  2. Etiam vel felis viverra.
  3. Felis enim feugiat.
  4. Dolor pulvinar etiam.
  5. Etiam vel felis lorem.
  6. Felis enim et feugiat.

Icons

Actions

Table

Default

Name Description Price
Item One Ante turpis integer aliquet porttitor. 29.99
Item Two Vis ac commodo adipiscing arcu aliquet. 19.99
Item Three Morbi faucibus arcu accumsan lorem. 29.99
Item Four Vitae integer tempus condimentum. 19.99
Item Five Ante turpis integer aliquet porttitor. 29.99
100.00

Alternate

Name Description Price
Item One Ante turpis integer aliquet porttitor. 29.99
Item Two Vis ac commodo adipiscing arcu aliquet. 19.99
Item Three Morbi faucibus arcu accumsan lorem. 29.99
Item Four Vitae integer tempus condimentum. 19.99
Item Five Ante turpis integer aliquet porttitor. 29.99
100.00

Buttons

  • Disabled
  • Disabled

Form