data & ai platforms · regulated finance · Gurugram, India
Prashant Singh
Lead AI / Data Engineer — GenAI, ML & Data Platforms
I build and run data and AI platforms for regulated finance. Twelve years across banking and asset management — currently owning curated datasets and regulatory disclosure pipelines at Nomura Asset Management, and prototyping GenAI capabilities that hold up to audit: LLM integration and evaluation, RAG, and agentic workflows with LangGraph and MCP. Deep in Python, Snowflake, Airflow, Spark, and AWS; hands-on ML across credit scoring and fraud detection.
01Skills
Generative AI & LLM
- Agentic AI (LangGraph, MCP)
- RAG & Vector Search (ChromaDB, BGE)
- LLM Integration & Evaluation
- Prompt Engineering & Guardrails
- Knowledge Graphs (Neo4j)
Bankopedia's RBI circular summarizer runs as a LangGraph agent over a RAG pipeline. See the project →
Machine Learning
- Predictive Modeling (credit, fraud)
- scikit-learn / XGBoost
- Feature Engineering & Evaluation
- PyTorch
Built credit-scoring and fraud models at Indian Overseas Bank; now writing that up as a series. Financial ML from zero →
Languages & Frameworks
- Python
- SQL
- Java
- PySpark / Scala
- FastAPI / Django
Six Python packages on PyPI, from NSE market data to a quantitative-finance library. Open source →
Data Platforms & Pipelines
- Snowflake (Snowpipe, Cortex, Dynamic Tables)
- Apache Spark
- Databricks
- dbt
- Kafka
Built a bank's enterprise Snowflake warehouse; wrote the Spark UI walkthrough my team onboards with. How to read the Spark UI →
Orchestration & Cloud
- Apache Airflow
- AWS (Glue, EMR, MWAA, Lambda)
- Docker & CI/CD
- Temporal
Migrated Control-M and AutoSys batch workloads to Airflow at Macquarie. The migration patterns that held up →
Databases & Storage
- PostgreSQL
- SQL Server / T-SQL
- Redis (caching, pub/sub)
Warehouse procs with an explicit error path: TRY…CATCH, ROLLBACK, THROW. The T-SQL post →
02Experience
Nomura Asset Management International
Dec 2025 — PresentLead Software Engineer
Own curated data products and regulatory disclosure pipelines for US funds; prototyping AI and analytics automation with Snowflake Cortex ML and Dynamic Tables.
Macquarie Asset Management
Oct 2024 — Dec 2025Senior Data Engineer, Assistant Manager
Migrated legacy batch workflows from AutoSys and Control-M to Airflow; evaluated LLM, RAG, and MCP patterns for workflow automation.
Indian Overseas Bank
Jun 2014 — Oct 2024Python Developer → Senior Data Engineer, Manager
Built credit-scoring and fraud ML models, AML analytics pipelines, and the bank's enterprise Snowflake warehouse; led a six-member engineering team.
03AI Projects
RBI Circular Summarizer — Bankopedia
Agentic AI · LiveAn agentic AI application that ingests Reserve Bank of India circulars and publishes Claude-generated summaries on bankopedia.co.in. Orchestrated as a LangGraph agent workflow over a RAG pipeline — document chunking, BGE embeddings stored in ChromaDB — with prompt engineering, output validation, and guardrails keeping every summary faithful to the source regulatory text.
Project Synapse
Knowledge GraphA knowledge graph of a codebase in Neo4j, modeling code structure and relationships, that translates a production error directly into the pinpointed source of the issue and a suggested fix. Combines graph traversal with semantic retrieval over BGE embeddings in ChromaDB, linking error signatures to the relevant code and fix context.
04Open Source
Python packages published on PyPI — market data, quantitative finance, and tooling for regulated-AI workflows.
pybhav
pypi ↗Download NSE bhavcopy (end-of-day market data) for Indian equities and derivatives.
Last release · Jul 2026
quantra
pypi ↗An open-source Python library for quantitative finance — covering time value of money, credit lifecycle, risk analytics, derivatives pricing, and portfolio optimization.
Last release · Jun 2026
atomingest
pypi ↗A metadata-driven data ingestion framework for AtomSQL with fintech-grade security and compliance features.
Last release · Mar 2026
atomsql
pypi ↗A lightweight Object-Relational Mapping (ORM) library for Python with support for SQLite and PostgreSQL.
Last release · Feb 2026
regchain
pypi ↗Governance, audit, evaluation, and controls for AI workflows in regulated finance.
Last release · Dec 2025
qfinbox
pypi ↗A Python library for quantitative finance, offering tools for risk management, portfolio optimization, and financial modeling.
Last release · Oct 2025
05Certifications
AWS Certified AI Practitioner
Amazon Web Services
AWS Certified Cloud Practitioner
Amazon Web Services
DAG Authoring for Apache Airflow 3
Astronomer · 2026
Microsoft Certified: Azure Data Fundamentals
Microsoft · 2024
Course certificates
- ›Building Adaptive AI AgentsDeepLearning.AI · 2026
- ›Build AI Apps with MCP ServerDeepLearning.AI · 2026
- ›Developing LLM Applications with LangChain (RAG)DataCamp · 2026
- ›JavaScript RAG Web Apps with LlamaIndexDeepLearning.AI · 2026
- ›Generative AI with LLMsDeepLearning.AI
06Education
- Executive Development Program in Applied Financial Risk Management2025
Indian Institute of Management Kashipur
- M.Tech in Computer Science (three semesters; discontinued)2011 — 2012
Madhav Institute of Technology & Science, Gwalior
- B.Tech in Computer Science2007 — 2011
Anand Engineering College, Agra
07Writing
Notes from production — all 11 posts →
08Get in Touch
Whether it's a role, a data-platform problem, or a question about something I wrote — drop me a line and it lands straight in my inbox.