Karan Patel

Karan Patel

Cloud Data Engineering · AWS · Azure

Toronto, Canada

Cloud data engineer building reliable pipelines and analytics systems across AWS and Azure. I design scalable data platforms, dimensional models, and automated workflows that turn raw data into trustworthy decisions.

Cloud

AWS, Azure

Pipelines

Airflow, ETL/ELT, orchestration

Data

SQL, PostgreSQL, Cassandra, dimensional modelling

Infrastructure

CloudFormation, Docker, Git

Latest Projects

View all

Clean analytics dashboard with charts

Cloud Data Warehouse

An AWS data warehouse project for scalable music streaming analytics.

AWS

AWS

Dark code editor for automated data workflows

Data Pipeline with Airflow

A scalable Apache Airflow ETL pipeline for automating data workflows.

AIRFLOW

AIRFLOW

Abstract data points on a dark network field

Data Modelling with Cassandra

Designed query-first Cassandra tables for music-event analysis using denormalisation and deliberate partition-key selection.

CASSANDRA

CASSANDRA

Latest Posts

View all

I share practical notes and open projects to help others learn, build, and solve real data problems.

SQL

PostgreSQL IN vs JOIN vs Correlated Subquery: A Practical Performance Test

PostgreSQL IN vs JOIN vs Correlated Subquery: A Practical Performance Test

PostgreSQL IN vs JOIN vs Correlated Subquery: A Practical Performance Test

SQL

SQL

How to Read a PostgreSQL EXPLAIN ANALYZE Plan Without Getting Lost

How to Read a PostgreSQL EXPLAIN ANALYZE Plan Without Getting Lost

How to Read a PostgreSQL EXPLAIN ANALYZE Plan Without Getting Lost

SQL

SQL

How a PostgreSQL Index Turned a 231 ms Query into 0.8 ms

How a PostgreSQL Index Turned a 231 ms Query into 0.8 ms

How a PostgreSQL Index Turned a 231 ms Query into 0.8 ms

SQL

AWS

Build a Three-Zone AWS Data Lake Using S3 and CloudShell

Build a Three-Zone AWS Data Lake Using S3 and CloudShell

Build a Three-Zone AWS Data Lake Using S3 and CloudShell

AWS

Let’s build reliable data systems.

View GitHub

hiker in nature

Subscribe to my Newsletter

Sign up to stay updated about my latest work and adventures. No Spam, No BS. Promise!

hiker in nature

Subscribe to my Newsletter

Sign up to stay updated about my latest work and adventures. No Spam, No BS. Promise!