Overview

Senior Data Engineer based in Mumbai with hands-on experience designing, building, and operating enterprise multi-cloud data platforms and analytics infrastructure.

At a glance

7+ Years in data engineering
100+ Pipelines Architected
4+ Data Architecture Migrations
60% Faster platform setup time
500+ TB Data Volume Handled
3+ Legacy Systems Modernized
5x Faster Vector Search Performance
2 High-Level Design (HLD) Blueprints

What I build

  • Enterprise Data Infrastructure Implementing high-performance architectures utilizing modern cloud storage, distributed compute (Spark/Databricks), and unified analytics platforms to handle complex, large-scale data requirements across multi-cloud ecosystems.

  • End-to-End Pipeline Lifecycle Building sophisticated ETL/ELT workflows with integrated observability and escalation logic to ensure high data quality and maintain strict enterprise SLAs for data pipelines.

  • Framework-First Engineering Developing automated deployment workflows and metadata-led ingestion engines that incorporate granular row-level security and scalable access controls.

Core platforms

Databricks Postgres Azure Synapse Azure Data Factory Snowflake

See experience and projects for implementation details and delivery outcomes.

Experience

Recent roles and delivery ownership across multi-cloud data platform architecture, ingestion frameworks, governance, and production operations.

YipitData

Senior Data Engineer | Aug 2025 - Present | Remote

  • Stakeholder Partnership: Partnering with cross-functional Investor and Corporate teams to engineer high-fidelity data products that drive institutional decision-making.
  • Production-Grade Engineering: Developing enterprise-grade ingestion architectures and analytics-ready datasets for high-concurrency internal and external consumption across data platforms.
  • Operational Excellence: Enhancing platform resilience through automated observability, standardized data quality frameworks, and proactive operational runbooks.
  • Velocity Optimization: Optimizing transformation design patterns and collaborative workflows, resulting in measurable improvements to engineering delivery velocity.

Neudesic

Senior Data Engineer | Dec 2021 - Jul 2025 | Remote

  • Multi-Source Architecture: Architected scalable data platforms using Azure Synapse and Databricks, orchestrating complex integrations across SAP CDC, APIs, and legacy SFTP systems for enterprise data pipelines.
  • Technical Leadership: Led an agile squad of four engineers to rapidly prototype and deliver a 40+ KPI pilot within the first month of engagement.
  • Framework-Driven Design: Engineered an extensible, metadata-driven framework utilizing Cosmos DB and Azure Functions for dynamic scheduling, logging, and configuration management.
  • Governance & CI/CD: Standardized data governance and automated CI/CD workflows via Azure DevOps, ensuring consistent delivery quality and high environment stability.

Tata Consultancy Services

Data Engineer | Nov 2018 - Dec 2021 | Mumbai

  • Cloud-Native ELT: Developed scalable workflows using Azure Data Factory and Azure SQL to power mission-critical business intelligence and reporting.
  • Automated Deployments: Established automated CI/CD pipelines to streamline deployment cycles and ensure repeatable, environment-agnostic code promotion.
  • Mentorship & Growth: Cultivated a culture of technical excellence by me

Projects

Project highlights from client platforms and internal accelerators aligned to production impact.

Transaction Intelligence & Consumer Analytics Feed

Architected an LLM-powered Databricks data platform to transform raw credit and debit card data into high-fidelity vendor panels for market health and spend analytics.

  • Sector: Alternative Data / Market Research
  • Outcome: Daily production feed delivering granular vendor-level growth and health insights.

Command and Control Data Platform

Architected an Azure Synapse and Databricks data platform to unify SAP CDC, API, and SFTP data into a high-concurrency analytics layer.

  • Client: Leading Indian cement manufacturer
  • Outcome: 40+ KPI drilldowns across 30+ manufacturing plants

Metadata and Data Quality Framework

Designed an extensible data governance and observability layer to ensure the integrity, security, and reliability of enterprise data assets.

  • Security: Custom granular row-level security for role-based access
  • Delivery: Standardized CI/CD for serverless and warehousing components

In-House Data Platform Accelerator

Engineered a “Platform-as-a-Service” accelerator to automate the deployment of standardized, production-ready multi-cloud data platform environments.

  • Impact: 60% reduction in platform configuration and setup time
  • Innovation: Evaluated Delta-based metadata catalogs for compute-storage decoupling

Transaction Intelligence & Consumer Analytics Feed

Engineered a high-scale data intelligence engine that leverages Large Language Models to normalize fragmented card transactions, providing institutional investors with daily insights into company health and consumer spend patterns.

What I delivered

  • Designed an LLM-driven normalization engine to clean and resolve unstructured transaction descriptions into a standardized format.
  • Built a sophisticated vendor-tagging system that maps cleaned transactions to an enterprise “Vendor Universe” using semantic entity resolution.
  • Developed a panelization framework to transform raw transactional data into statistically significant cohorts for trend analysis.
  • Delivered a high-velocity daily feed providing granular metrics on company growth, spend velocity, and market-share shifts.
  • Partnered with research analysts to define KPIs that quantify company health and consumer loyalty from raw financial signals.

Platform capabilities

  • Scaled processing on Databricks to handle millions of daily records using distributed PySpark workflows.
  • Orchestrated LLM integration for automated text classification and entity mapping at scale, significantly reducing manual tagging.
  • Implemented panel-based normalization logic to account for data bias and ensure accurate representative spend modeling.
  • Built automated data quality gates and drift monitoring to ensure the integrity and reliability of the daily financial feed.

Command and Control Data Platform

Delivered a centralized “Command and Control” platform that provided stakeholders with real-time visibility across manufacturing, sales, and logistics workflows.

What I delivered

  • Architected an Azure Synapse environment with complex pipelines orchestrating end-to-end ingestion and transformation journeys.
  • Strategized with business stakeholders to map disparate manufacturing and logistics workflows into a cohesive, unified data model.
  • Engineered high-performance integration patterns for SAP CDC and API sources using PySpark on Databricks.
  • Scaled the pilot to support 40+ critical KPIs, providing granular drilldowns for over 30 manufacturing plants.
  • Led a cross-functional squad of four engineers to successfully deliver the production pilot within the first month.

Platform capabilities

  • Governance Framework: Built a metadata-driven engine using Cosmos DB and serverless Azure Functions for automated scheduling and configuration.
  • Automated Observability: Implemented proactive data quality monitoring with benchmark deviation alerts and automated escalation routing.
  • Secure DevOps: Established robust CI/CD workflows for the entire stack and designed a custom row-level security (RLS) framework for fine-grained access.

Metadata and Data Quality Framework

Built a reusable framework-first operating model that transformed raw infrastructure into an observable and governed data platform.

Highlights

  • Metadata Engine: Developed a centralized source configuration and scheduling hub using Cosmos DB with a serverless Function API.
  • Quality Observability: Engineered automated quality benchmark monitoring in Synapse, featuring deviation alerting and intelligent escalation logic.
  • Unified Security: Designed a custom row-level security architecture to enforce strict data privacy across diverse business units.
  • Centralized Logging: Consolidated pipeline logging and audit trails to improve troubleshooting speed and platform transparency.

Delivery & Automation

  • Automated Lifecycle: Configured end-to-end CI/CD pipelines for Synapse, Cosmos DB, and Azure Functions to ensure reliable, repeatable deployments.

In-House Data Platform Accelerator

Designed a reusable deployment accelerator that allows teams to provision standardized data platforms in minutes rather than weeks.

What it automated

  • Infrastructure-as-Code: Provisioned integrated Azure stacks (Synapse/ADF, Databricks, and ADLS) using reusable Terraform templates.
  • Environment Orchestration: Enabled seamless multi-environment deployments via GitHub Actions and Azure DevOps pipelines.
  • Standardized Architecture: Baked in best-practice security and networking configurations by default for every new deployment.

Impact and innovations

  • Operational Efficiency: Slashed configuration and deployment time by 60%, significantly accelerating project kickoff phases.
  • Architecture Exploration: Evaluated the use of Delta tables for metadata storage to further decouple compute from governance databases.
  • Future-Proofing: Built a Delta Catalog POC to explore advanced data sharing and enhanced RBAC controls within the Databricks ecosystem.

Skills

Tools and methods used across ingestion, transformation, governance, and delivery automation.

Technologies

Azure Synapse Azure Data Factory Databricks Snowflake Azure Data Lake Azure Storage SQL Python Azure DevOps GitHub Actions

Techniques

Data pipeline design Database modelling Data wrangling Data normalisation CI/CD

Certifications

Academic Achievement

Technical paper publication (2019): “Machine Learning Based Autonomous Road Maintenance System Using Cold Lay Asphalt” in the international journal Helix, Vol. 8(5): 4002-4006.

Education

University of Mumbai, Mumbai - Bachelor of Engineering in Electronics and Telecommunication (Jun 2018).

Elements

Text

This is bold and this is strong. This is italic and this is emphasized. This is superscript text and this is subscript text. This is underlined and this is code: for (;;) { ... }. Finally, this is a link.


Heading Level 2

Heading Level 3

Heading Level 4

Heading Level 5
Heading Level 6

Blockquote

Fringilla nisl. Donec accumsan interdum nisi, quis tincidunt felis sagittis eget tempus euismod. Vestibulum ante ipsum primis in faucibus vestibulum. Blandit adipiscing eu felis iaculis volutpat ac adipiscing accumsan faucibus. Vestibulum ante ipsum primis in faucibus lorem ipsum dolor sit amet nullam adipiscing eu felis.

Preformatted

i = 0;

while (!deck.isInOrder()) {
    print 'Iteration ' + i;
    deck.shuffle();
    i++;
}

print 'It took ' + i + ' iterations to sort the deck.';

Lists

Unordered

  • Dolor pulvinar etiam.
  • Sagittis adipiscing.
  • Felis enim feugiat.

Alternate

  • Dolor pulvinar etiam.
  • Sagittis adipiscing.
  • Felis enim feugiat.

Ordered

  1. Dolor pulvinar etiam.
  2. Etiam vel felis viverra.
  3. Felis enim feugiat.
  4. Dolor pulvinar etiam.
  5. Etiam vel felis lorem.
  6. Felis enim et feugiat.

Icons

Actions

Table

Default

Name Description Price
Item One Ante turpis integer aliquet porttitor. 29.99
Item Two Vis ac commodo adipiscing arcu aliquet. 19.99
Item Three Morbi faucibus arcu accumsan lorem. 29.99
Item Four Vitae integer tempus condimentum. 19.99
Item Five Ante turpis integer aliquet porttitor. 29.99
100.00

Alternate

Name Description Price
Item One Ante turpis integer aliquet porttitor. 29.99
Item Two Vis ac commodo adipiscing arcu aliquet. 19.99
Item Three Morbi faucibus arcu accumsan lorem. 29.99
Item Four Vitae integer tempus condimentum. 19.99
Item Five Ante turpis integer aliquet porttitor. 29.99
100.00

Buttons

  • Disabled
  • Disabled

Form