A curated magazine-style view of my latest writing — technical essays, stories, and case studies.
Learn Alembic from scratch with this beginner-friendly guide. Understand database migrations, installation, initialization, creating revisions, upgrading databases, downgrades, and best practices using SQLAlchemy. Perfect for Python developers building production-ready applications.
Set up a serverless Medallion Architecture on AWS for reliable data pipelines from raw data to analytics-ready insights
Instead of lighting a cigarette, I shipped my first public PyPI package:
A few months ago I built a pipeline for a logistics analytics team that collects package events—delivery scans, route status updates, warehouse entries, etc. The events come from 11 distributed warehouses across India, aggregating to ~40M records/day.
AWS Glue is a fully serverless ETL service used to discover, prepare, and transform data for analytics. It includes components like the Data Catalog, Crawlers, and Spark-based ETL jobs, enabling automated schema discovery, scalable data processing, and seamless integration with AWS analytics services.
Most frequently asked questions in data engineering interview. Go through all and clear your doubts in the comment box
Slowly Changing Dimensions (SCD) Type-2 is the go-to pattern when you need full historical tracking of your dimensional tables. But running a naïve column-by-column comparison becomes messy fast. A much cleaner way?
You’re in a client call. The architect asks: “Explain Snowflake architecture in 2 minutes – and why should we choose it over Redshift?”
Have you ever wondered what happens behind the scenes when you type something in your browser and it takes you to the correct website? The magic behind it is the Domain Name System (DNS).
Stateful applications require stable identities, persistent storage, and predictable networking. Kubernetes provides StatefulSets to handle these requirements efficiently. In this guide, you’ll learn what a StatefulSet is, when to use it, and how to deploy a MySQL StatefulSet step by step.
Learn how to set up Elasticsearch and Kibana on Docker for local development and testing. Step-by-step guide with Docker networking and security setup.
Start your Kubernetes journey by understanding Kubernetes architecture, including master and worker nodes and their core components, explained simply for beginners.
In today’s rapidly evolving tech landscape, Terraform has emerged as the de-facto tool for Infrastructure as Code (IaC). It’s not just another DevOps skill—it’s a career accelerator for cloud engineers. In this guide, you’ll learn Terraform fundamentals and how to provision an AWS EC2 instance using a clean, modular Terraform structure.
Learn how to build a complete CI/CD pipeline using GitHub Actions to deploy a Dockerized application to AWS EC2 with secrets, environments, and automation.
Learn how to harden Jenkins for production with security, performance, and reliability best practices. Protect your CI/CD pipelines from failures and attacks.
Learn how to install and configure Jenkins for production on Ubuntu, Red Hat, and Docker. This step-by-step guide covers setup, security, and best practices.
In this modern world where most of the workload runs on containers and as a microservices, Nginx is an essential tool to include in your skillset.
In this Blog We will learn how to get started with docker. Be it windows, Mac or Linux, and learn all the basics command which we required to run and troubleshoot any running containers.
Learn how to securely connect to a remote server using SSH. This beginner-friendly guide covers SSH installation, passwordless login using keys, and file transfer with SCP.
AWS Glue is a fully serverless ETL service used to discover, prepare, and transform data for analytics. It includes components like the Data Catalog, Crawlers, and Spark-based ETL jobs, enabling automated schema discovery, scalable data processing, and seamless integration with AWS analytics services.
Most frequently asked questions in data engineering interview. Go through all and clear your doubts in the comment box
Slowly Changing Dimensions (SCD) Type-2 is the go-to pattern when you need full historical tracking of your dimensional tables. But running a naïve column-by-column comparison becomes messy fast. A much cleaner way?
You’re in a client call. The architect asks: “Explain Snowflake architecture in 2 minutes – and why should we choose it over Redshift?”
Have you ever wondered what happens behind the scenes when you type something in your browser and it takes you to the correct website? The magic behind it is the Domain Name System (DNS).
Stateful applications require stable identities, persistent storage, and predictable networking. Kubernetes provides StatefulSets to handle these requirements efficiently. In this guide, you’ll learn what a StatefulSet is, when to use it, and how to deploy a MySQL StatefulSet step by step.
Learn how to set up Elasticsearch and Kibana on Docker for local development and testing. Step-by-step guide with Docker networking and security setup.
Start your Kubernetes journey by understanding Kubernetes architecture, including master and worker nodes and their core components, explained simply for beginners.
In today’s rapidly evolving tech landscape, Terraform has emerged as the de-facto tool for Infrastructure as Code (IaC). It’s not just another DevOps skill—it’s a career accelerator for cloud engineers. In this guide, you’ll learn Terraform fundamentals and how to provision an AWS EC2 instance using a clean, modular Terraform structure.
Learn how to build a complete CI/CD pipeline using GitHub Actions to deploy a Dockerized application to AWS EC2 with secrets, environments, and automation.
Learn how to harden Jenkins for production with security, performance, and reliability best practices. Protect your CI/CD pipelines from failures and attacks.
Learn how to install and configure Jenkins for production on Ubuntu, Red Hat, and Docker. This step-by-step guide covers setup, security, and best practices.
In this modern world where most of the workload runs on containers and as a microservices, Nginx is an essential tool to include in your skillset.
In this Blog We will learn how to get started with docker. Be it windows, Mac or Linux, and learn all the basics command which we required to run and troubleshoot any running containers.
Learn how to securely connect to a remote server using SSH. This beginner-friendly guide covers SSH installation, passwordless login using keys, and file transfer with SCP.