DB-Syncer
Database sync tool β PythonA cross-database sync tool built for large tables, where a naive script would either time out or eat all the RAM. Uses parallel processing to split work across cores, SQLite-backed checkpointing so a sync can resume exactly where it left off after a failure, and server-side cursor streaming to keep memory flat regardless of table size. Ships with a FastAPI web UI, a Docker Compose test environment, and a full unit test suite.
Daily Automation Pipeline
Production automation β Python + Docker + Pentaho
An automation system running on AWS EC2 that pulls data from MySQL into PostgreSQL
every day, then triggers Pentaho (PDI) transformation jobs inside Docker containers.
Includes a Flask monitoring dashboard, Slack notifications on success or failure, and
a --skip-phase1 flag so I can iterate on the transform stage without
re-running the full data pull. Debugged through real production issues β JVM heap
sizing, silent queue hangs, dynamic Docker volume paths, and OOM kills from unbuffered
MySQL cursors.
Legacy ETL β Spark/Hadoop Migration
Data platform migration β Zakipoint HealthMigrated a legacy MySQL/Pentaho processing workflow to Apache Spark and Hadoop running on AWS EC2, cutting processing time by more than 90%. This is the kind of work that doesn't show up as a repo link β it shows up as a report that used to take hours finishing before the team's coffee got cold.
writing
From the blog
Notes on pipelines, debugging sessions, and things I had to learn the hard way.
contact
Let's talk data.
Open to new roles, freelance ETL/automation work, or just a conversation about pipelines that broke in interesting ways. Based in Kathmandu, working remote.