Vikash Kumar
I build software that works at scale and models that learn: from training small Transformers from scratch to shipping a satellite-powered lake forecasting app. Currently deepening my work in language models and retrieval.
A bit about me
I'm a software engineer pursuing an M.Tech in Computer Science and Engineering at IIIT Hyderabad. Before that I worked in industry as an intern at Odessa Technology and as a software engineer at GirnarSoft Finserv, where I shipped a payout module, faster APIs and a compliance-driven KYC integration.
These days I spend my time on language models, retrieval and geospatial machine learning: pretraining Transformers from scratch, building RAG systems over official documents, and working on EcoTwin, a research project that forecasts the ecological future of India's lakes.
I like systems that are well tested, measurable and explainable, and I enjoy going down to the low level too: a BitTorrent client and a Unix shell are on my list of things built from scratch.
Studying
M.Tech in CSE at IIIT Hyderabad, July 2025 to present.
Focus
LLMs, retrieval-augmented generation and geospatial ML.
Previously
Software Engineer at GirnarSoft Finserv; Software Engineer Intern at Odessa Technology.
Education
Experience
Software Engineer
- Fully functional new module developed for the payout mechanism (improved the work efficiency of multiple teams)
- Created highly optimised multi-purpose reusable APIs (improved the response time from 18 sec to 2 sec)
- Implemented a high-priority KYC feature integration following new government mandates, ensuring compliance and operational continuity under strict deadlines
Software Engineer Intern
- Wrote highly maintainable code using the C# ASP.NET framework backend to incorporate new features
- Created procedures and wrote queries for DDL and DML operations on the database for migration, backup and optimisation using SQL Server; designed and developed reports and documents using SQL Server
Projects
Things I've built, from low-level systems to language models and a live ecosystem-forecasting app.
EcoTwinEcosystem Forecasting for India's Lakes
A digital twin of lakes: satellite imagery in, auditable 3-year forecasts out. Built in a team of three with Ramachandra Prasad P, IIIT Hyderabad.
- Geospatial pipeline over Sentinel-2 imagery for 829 lakes across 26 states (2016โ2025), producing 8,227 foundation-model embeddings with zero pipeline failures
- Decoder-free forecasting using trajectory-based analog retrieval over pgvector, giving auditable 3-year forecasts with confidence-aware abstention
- Full-stack app (FastAPI, React, PostgreSQL) with automated PDF reports, demonstrated on five Ramsar wetland case studies
GPT-style Language Models from Scratch
Two small Hindi and Nepali language models, built the hard way: from an empty file.
- Implemented a decoder-only Transformer from scratch; pretrained separate Hindi and Nepali 25M-parameter LLMs on ~650M tokens each
- 12-stage corpus pipeline with MinHash/LSH near-dedup and decontamination; SentencePiece BPE tokenizers trained from scratch
- Mixed-precision training, bit-exact checkpoint resume and an LLM evaluation suite; validation perplexity 26.2 (Hindi), 41.5 (Nepali)
- Reasoning fine-tune: 0% โ 41โ43% on seen data, 6โ20% on held-out splits
Government Services RAG Chatbot
Ask questions about Indian government services; get answers grounded in the official PDFs.
- End-to-end Retrieval-Augmented Generation chatbot over 143 official PDFs across five services (passport, voter ID, driving licence, income tax, Ayushman Bharat)
- PyMuPDF โ chunking โ MiniLM embeddings โ FAISS โ top-5 retrieval, with a relevance cutoff that returns "no relevant documents" instead of guessing
- Groq LLM API with citation-backed answers, model fallback and conversation memory
- Streamlit UI with an English/Hindi interface and PDF download
MERGE: Emotion-Driven Lyrics Generation
Looks at a face, feels the emotion, writes the song lyrics, in rhythm.
- Multimodal flow: a face image (MTCNN + DenseNet-121) or text (RoBERTa) is classified into six emotions, then an emotion-conditioned GPT-2 writes lyrics
- Rhythm-aware reranking picks candidate lines by syllable meter and rhyme for better structure
- Full-stack web app (FastAPI, React, MongoDB) with OTP-verified signup, forgot-password, saved chat history and loading and error states
BitTorrent Implementation
A peer-to-peer file sharing system with a tracker, seeders and verified chunks.
- Multi-threaded tracker (users, groups, file and seeder registry) and peers that both download and seed over TCP
- 512 KB chunks with per-chunk SHA-1 verification and multi-seeder download with failover; finished downloads re-register as seeders
- POSIX threads with mutex-protected shared state and a command-line client for accounts, groups, upload and download
POSIX Shell Implementation
A tiny Unix shell: parse it, fork it, pipe it.
- Interactive shell in C++ that parses commands, runs pipelines and command sequences, and keeps persistent history
- Process management: foreground and background jobs, process groups, and Ctrl+C and Ctrl+Z forwarding
- Pipes and I/O redirection, plus built-ins such as cd, ls, echo, pwd, history and recursive search
Technical Skills
โจ๏ธLanguages
๐ง Generative AI & NLP
๐๏ธDatabases
๐ ๏ธMLOps & Tools
Achievements
Secured in IIIT-H PGEE '25
GATE CS 2024 percentile
GATE DA 2025 percentile
Let's build something great.
Have a role, a project or an idea you'd like to talk about? My inbox is open.