Samir SenguptaOpen to work

Samir SenguptaAI/ML Engineer & Data Scientist in New York, USA

Samir Sengupta, AI/ML Engineer and Data Scientist based in New York.

I frame the problem, build the model, and ship the system.

Multi-agent systems, RAG, and LLM pipelines, engineered onto Kubernetes with the data and evaluation infrastructure to keep them honest.

  • 500K+events/dayKafka pipeline
  • <100ms p50ML serving on K8s
  • ~40%reductionmanual triage · NLP
  • ~32%liftconversion · A/B tests

measured output · systems in production

  • 500K+events/day
    Kafka pipeline
  • <100ms p50
    ML serving on K8s
  • ~40%reduction
    manual triage · NLP
  • ~32%lift
    conversion · A/B tests
  • Python
  • PyTorch
  • LangGraph
  • vLLM
  • Kubernetes
  • AWS Bedrock
  • Apache Beam
  • Kafka
  • FastAPI
  • Azure OpenAI
  • FAISS
  • MLflow

Taking production AI to the stage.

In 2026 I took the hard part of applied AI to two New York stages — not the demo, but making it run reliably, cheaply, and at scale.

  • 06.10.262026Lightning talk
    KCD New York 2026recording live

    Scaling Production RAG Systems with Kubernetes

    Kubernetes Community Days · New York CityJune 10, 2026

    How retrieval-augmented generation earns its uptime: autoscaling vLLM, vector search, and observability on Kubernetes so a RAG system stays fast and affordable when traffic stops being a benchmark and starts being real.

    KubernetesvLLMRAGObservability
  • 06.22.262026Technical session
    Apache Beam Summit 2026recording live

    Real-Time AI Pipelines at Scale: Embedding LLMs into Apache Beam

    New York CityJune 22, 2026

    Bringing LLM inference and RAG inside the pipeline itself — embedding models directly into Apache Beam transforms so streaming data can reason in real time, delivering low-latency intelligence on high-velocity data without ever leaving the stream.

    Apache BeamStreamingLLMReal-time

One engineer, the full ML lifecycle.

Samir Sengupta, AI/ML Engineer and Data Scientist based in New York.
portrait.jpgslot awaiting its assetratio 4 : 5
Samir Sengupta · New York40.7128°N · 74.0060°W

Most engineers pick a lane research, modeling, or infrastructure. I work the whole line. Across 3+ years I’ve framed problems as a data scientist, built the models, and engineered them into reliable software: Kafka pipelines and FastAPI services on Kubernetes at sub-100ms latency, and predictive models that cut churn and lifted conversion for the teams that shipped them.

I’m the author of a research preprint on efficient long-context LLMs, spoke at KCD New York and the Apache Beam Summit in 2026, and hold an MS in Data Science (GPA 3.9) plus industry certifications from AWS, Google, NVIDIA, and IBM.

the_whole_line
framemodelship

  • Agentic AI & LLMs

    Autonomous agents, multi-agent orchestration, RAG, and fine-tuning.

    LangGraphLangChainLlamaIndexvLLMLoRA / QLoRAQuantization
  • ML & Data Science

    Forecasting, anomaly detection, churn and predictive modeling, A/B testing.

    scikit-learnXGBoostPyTorchTensorFlow
  • Python & MLOps

    FastAPI services, event-driven microservices, CI/CD, and observability.

    KubernetesDockerMLflowAWS BedrockAzure OpenAI

Measured, not vibes.

Numbers from systems that shipped and stayed up. Every one of them came with a dashboard someone else had to trust.

  • multi-agent + retriesHigher is better.
    ~95%

    enrichment success

  • Kafka pipelineHigher is better.
    500K+

    events / day

  • FastAPI on KubernetesLower is better.
    <100ms

    prediction latency

  • NLP ticket routingLower is better.
    ~40%

    manual triage cut

  • predictive MLLower is better.
    ~25%

    monthly churn reduction

  • A/B testing programmeHigher is better.
    ~32%

    conversion lift

How a model becomes a system.

A production LLM/RAG pipeline I design and operate — from raw data to a served, monitored endpoint that stays fast and cheap under load. Pick a stage.

stages 07 · edges 09 · feedback 01
stage_detail
Ingest01 / 07

Ingest & stream

metric500K events/day

Event-driven intake that survives the real world: external APIs behind rate limits, retries with backoff, schema normalisation. ~500K events a day arrive without anyone getting paged.

KafkaApache BeamAirflow

Where I’ve shipped.

  1. Software DeveloperSynRadar

    Aug 2023 – Jul 2024Mumbai, India

    • Deployed FastAPI backend services on Kubernetes via CI/CD pipelines, serving ML predictions at sub-100ms latency while handling ~50K daily API calls.
    • Engineered a Kafka-based data pipeline integrating external security APIs — managing rate limits, retries, and normalisation to process ~500K daily events.
    • Integrated a Llama-based LLM into the automated review workflow, with structured logging and tracing to monitor model decisions and detect regressions.
    PythonFastAPIKubernetesKafkaCI/CDLLM
  2. Data ScientistNeural Thread

    Jan 2021 – Jul 2023Mumbai, India

    • Built a Python NLP pipeline classifying support tickets and integrating with business systems to automate routing, cutting manual triage time ~40%.
    • Trained churn-prediction models on SQL-extracted usage data, helping retention teams flag at-risk accounts and reduce monthly attrition ~25%.
    • Ran A/B testing infrastructure for targeted campaigns, measuring predictive-model impact to drive a ~32% improvement in conversion rates.
    PythonNLPSQLA/B TestingChurn ModelingSpark

education
  • M.S. Data Science

    Saint Peter’s University

    New JerseySep 2024 — May 2026GPA 3.9 / 4.0
  • B.S. Data Science

    University of Mumbai

    Mumbai2020 — 2023GPA 3.95 / 4.0

Projects, shipped on GitHub.

Nine of them, all public on GitHub.

Published, in the open.

Preprint · TechRxivJanuary 2026

HLST: Democratizing Long-Context LLMs on Edge Devices via Hierarchical Latent State-Space Recurrence

A transformer alternative built on hierarchical latent state-space recurrence — trading quadratic attention for recurrence that holds long context on hardware that fits in a pocket.

  • Long-context
  • State-space models
  • Edge inference
  • Efficiency
doi10.36227/techrxiv.176948384.49791660/v1

Presented this line of work on stage in 2026 — see above.

credentials

10+ certifications.

AWSGoogleMicrosoftNVIDIATensorFlowIBMPyTorchStanford

  • AWSAWS ML — Specialty
  • GoogleProfessional ML Engineer
  • MicrosoftAzure AI Engineer
  • NVIDIAAgentic AI
  • NVIDIAGenAI & LLMs
  • TensorFlowTensorFlow Developer
  • IBMAI Engineering
  • PyTorchDeep Learning
  • StanfordAI Graduate Program
  • IBMRAG & Agentic AI

The toolkit.

Grouped the way the system is layered, not alphabetically.

  • agentic_ai_llms

    10 items
    • LangChain
    • LangGraph
    • LlamaIndex
    • CrewAI
    • RAG
    • Fine-Tuning
    • LoRA / QLoRA
    • vLLM
    • DSPy
    • Guardrails.ai
  • ml_data_science

    10 items
    • PyTorch
    • TensorFlow
    • scikit-learn
    • XGBoost
    • Pandas
    • Forecasting
    • Anomaly Detection
    • A/B Testing
    • NLP
    • Computer Vision
  • mlops_infra

    8 items
    • Kubernetes
    • Docker
    • Terraform
    • MLflow
    • Ray Serve
    • Ollama
    • CI/CD
    • Model Monitoring
  • data_cloud

    8 items
    • Apache Spark
    • Apache Beam
    • Airflow
    • Snowflake
    • AWS Bedrock
    • SageMaker
    • Azure OpenAI
    • GCP Vertex AI
  • 6 items
    • FAISS
    • Pinecone
    • ChromaDB
    • Elasticsearch
    • Hybrid Search
    • Embeddings
  • languages

    7 items
    • Python
    • SQL
    • C++
    • Java
    • TypeScript
    • Rust
    • Go

I write, and people vouch.



recommendations

  • Samir is an inventor. His work with agentic AI, open-source contributions on Hugging Face, and a locally-run IBM Granite LLM app for Android set him apart. There were times you’d be hard-pressed to tell who was the professor.
    Armen PischdotchianMentor · Adjunct Professor, Saint Peter’s University
  • Our team had spent weeks trying to structure a complex agentic-AI workflow. Samir stepped in, grasped the entire system, and had it fully running in under a week.
    Mitesh WaghelaSupport Escalation Engineer, Microsoft
  • LOVED your productivity paradox feature. Just read your Medium article and I loved it — particularly the guilt piece! I talk a lot about maximising our human capacity to thrive in this era, and that was a new one.
    Suzanne RathKeynote Speaker · High Performance Consultant

Let’s ship AI that survives production.

Open to AI/ML Engineering, Data Science, and Python roles, plus research collaborations and consulting. Based in New York, shipping worldwide.

Fastest route — straight to my inbox