My Blog

Technical Articles & Insights

Exploring data engineering, machine learning, and production-grade systems

Production-Grade Data Tools: The Beauty of Engineered Workflows

March 8, 2026 Rajveer Rathod 9 min read

There is a class of software that reveals its quality not in a demo, but six months into production — when your pipeline hasn't failed once at 3am, when a new engineer inherits your DAG and immediately understands it, when a model retrain that used to take two weeks now takes two hours...

Databricks, Apache Airflow, MLflow, and OpenSearch belong to this category. Each has become the quiet infrastructure beneath some of the most ambitious data systems in the world. And together, they form something greater: a fully engineered workflow stack where every handoff is accounted for, every failure is observable, and every piece of compute is deliberate.

This is not a comparison post. This is an appreciation post.

Read More

AutoResearch by Andrej Karpathy: The AI That Does Science While You Sleep

March 17, 2026 Rajveer Rathod 12 min read

On March 7, 2026, Andrej Karpathy — OpenAI co-founder, former Tesla AI director, and man who coined "vibe coding" — pushed a new project to GitHub. No launch event. No press release. No 20-page technical report. Just a repo called "autoresearch" and a few words on X.

The post gathered 8.6 million views in two days and repo hit 30,000 stars in a week — one of the fastest-growing repositories in GitHub history. Why? Because what Karpathy built is deceptively small and philosophically enormous: a system where an AI agent conducts machine learning research autonomously, without any human involvement, running experiments, evaluating outcomes, and continuously improving a model — indefinitely.

The goal is to engineer your agents to make the fastest research progress indefinitely and without any of your own involvement. This is not just about improving LLM training. It's about demonstrating a generalizable pattern for autonomous optimization in any domain where you can define a single scalar metric and a mutable artifact.

Read More