RK
Portrait of Rohit Kumar

Rohit Kumar

Data Engineer · Moody's Ratings

I build data platforms that run themselves.

I design ingestion frameworks, lakehouses and data APIs that stay correct when nobody is watching — and, more and more, the MCP servers and services that hand that data to AI.

In data engineering & analytics
4+ yrs
Ingested from 10+ sources
80+ feeds
Under data-quality governance
100+ TB
Served by APIs I shipped
30K+ req/day

About

Started in analytics at Axis Bank, moved into engineering to fix data problems at the source. Today I build ingestion frameworks, an Iceberg lakehouse with an MCP server, and the APIs that feed agentic-AI workflows at Moody's.

  • Data platforms
  • Applied ML
  • AI × Data

01/Experience · 4+ years

Where I've worked.

Data Engineer · Moody's Ratings

Apr 2025 — Present · Bengaluru

  • −60% infra cost

    Built and led deployments of the AIDE ingestion framework — 80+ feeds from 10+ heterogeneous sources (JDBC, APIs, S3) — and cut deployment time by 75%.

  • 100+ TB governed

    Operationalised data quality and governance with Great Expectations across 95%+ of feeds, with CloudWatch dashboards giving stakeholders one view of data health and faster debugging.

  • −95% index buildData × AI

    Improved DB indexing for unstructured data on pgvector, enabling fast similarity search and cutting index build time by ~95% for agentic-AI workloads.

  • −50% data prepData × AI

    Led development of an Apache Iceberg lakehouse with ACID transactions and lineage for 30+ data scientists, and built an MCP server for fast data access and exploration.

  • 30K+ req/dayData × AI

    Architected and shipped two Spring Boot / MongoDB services delivering relevance-scored news and issuer sentiment to an analyst workbench and agentic-AI workflows — manual triage down 90% at p95 < 20 ms.

02/Recognition & learning

Awards, education, certifications.

Awards

swipe →
  1. Sep 2026

    IM'PACT Award — Lead with Curiosity · DB indexing

    Moody's

    For optimizing DB indexing for agentic AI on pgvector — cutting document insert time from 2 days to ~90 minutes.

  2. Sep 2026

    IM'PACT Award — Lead with Curiosity

    Moody's

    For leading application-level APIs that integrated CLEANews with internal systems, beyond core data-engineering scope.

  3. Mar 2025

    Platinum Learner Award (2×)

    Axis Bank · BIU

    Top learners in the Business Intelligence Unit, FY'24 and FY'25.

  4. Nov 2023

    Star Award

    Axis Bank · BIU

    Repeat-complaint insights that cut bank-wide repeats by 40%.

03/Selected work

Built on my own time, for the craft.

FlagshipAnalytics & Unified Research for Market

AURUM solo.

The entire stack an investment data team builds. Built alone.

S&P 500 symbols
503
Daily history to today
2000→
Feature rows in gold
~2.9M

Case studies

swipe →
02 · 2026Completed
pgvector Index Benchmark

A reproducible benchmark of pgvector's IVFFlat and HNSW against pgvectorscale's DiskANN on a real Wikipedia embedding corpus — build cost, disk size, latency, recall and concurrency.

HNSW 91× faster than exact search at 0.972 recall@10 (328K vectors)

PostgreSQLpgvectorpgvectorscalePython+2
03 · 2025Completed
Data Feed Engine

A config-driven ingestion framework: a new feed is one JSON config plus one class, and the engine runs extract, processing, quality checks, load and run metrics the same way every time.

Factory + registry — feeds and datasources plug in by decorator

PythonpandasSQLAlchemyMySQL+3
04 · 2024Completed
TransitFlow Realtime Event Stream

A real-time transit pipeline: simulated events stream through Kafka, get processed by Spark, and land as analytics-ready datasets in AWS.

Kafka + Spark streaming vehicle and weather events into S3

KafkaSparkAWS GlueAthena+2
05 · 2024Completed
Reddit Sentiment ETL

An Airflow-orchestrated ETL that extracts Reddit posts, scores sentiment with PySpark, and loads results for BI dashboards.

Airflow DAGs for scheduling and retries

AirflowPySparkMySQLPostgreSQL+1
4 more buildsIceberg · Realtime · Analytics · WhatsApp
  • Iceberg Lakehouse POC2026

    A personal deep-dive into the open-table-format pattern I use at work: Apache Iceberg tables on S3, registered in Glue and queried through Athena, with a tested dbt layer on top.

  • Realtime Voting System2024

    A streaming aggregation system that processes live voting events and surfaces real-time counts to a dashboard.

  • Analytics API2024

    A lightweight serving layer that exposes time-series data from TimescaleDB to downstream consumers through a clean API.

  • WhatsApp Chat Analyzer2023

    A deployed app that turns exported WhatsApp chats into interactive activity, word and sentiment insights.

04/Toolbox

Tools I reach for, layer by layer.

01Ingest & Stream

  • Kafka
  • Spark Streaming
  • REST APIs
  • JDBC
  • AWS Glue

02Process & Transform

  • Python
  • PySpark
  • SQL
  • dbt
  • Spark MLlib
  • Hadoop

03Store & Query

  • Apache Iceberg
  • S3
  • Athena
  • Redshift
  • PostgreSQL
  • MongoDB
  • Cassandra

04Orchestrate & Ship

  • Airflow
  • Step Functions
  • ECS Fargate
  • Lambda
  • EMR
  • Docker
  • Terraform
  • GitHub Actions

05Quality & Services

  • Great Expectations
  • CloudWatch
  • Java
  • Spring Boot
  • FastAPI

06AI & ML

  • MCP
  • LangChain
  • LangGraph
  • SageMaker
  • LightGBM
  • SHAP

05/Contact

Let's build something that moves data.

Open to conversations about data platforms, lakehouses, and data-for-AI work.