As a Data Engineer, I collect, extract and transform raw data in order to provide clean, reliable and usable data.
📘Introduction In this hands-on dbt tutorial, we’ll walk you step-by-step through how to make your SQL cleaner and more maintainable by using CTEs (Common Table Expressions) instead of deeply nested subqueries. ✅ Prerequisites ☑️ A dbt project set up ☑️ Source data loaded into your data warehouse ☑️ Source configurations defined in sources....
📘Introduction In this hands-on dbt tutorial, we’ll walk step by step through how to apply the Medallion Architecture to a real dataset using dbt. We’ll explore a sample dataset, visualize the dataflow, and move through all layers of the architecture: 1️⃣ 🛬 Landing Layer – Raw data ingestion 2️⃣ 🥉 Bronze...
📘 Introduction In this hands-on dbt tutorial, we’ll walk you step-by-step through how to create, use, and understand macros — one of dbt’s most powerful features for reusing logic and keeping your SQL clean, modular, and DRY (Don’t Repeat Yourself). By the end, you’ll be able to write...
📘 Introduction In the age of data-driven decision making, a well-structured and scalable data architecture is essential. The Medallion Architecture is a proven framework that organizes data into multiple layers of refinement — ensuring clarity, governance, and trust as data flows from raw ingestion to business-ready insights. When combined with Databricks and...
📘 Introduction FastAPI is a powerful Python framework for building APIs that is both fast and modern. But sometimes you want more than just an API—you also want a user-friendly interface. Instead of running React and FastAPI on two separate servers, you can bundle your React frontend inside FastAPI and...
📘 Introduction In this hands-on dbt tutorial, we’ll walk you step-by-step through how to connect dashboards and reports to your dbt DAG using exposures. This makes your data lineage more transparent, keeps stakeholders aligned, and ensures you know exactly how data assets are being consumed. 📌 This is a must-know topic...
📘 Introduction In this hands-on tutorial, we’ll walk step-by-step through scheduling dbt models with Dagster. By integrating Dagster, you can easily orchestrate your dbt workflows and automating model runs. ✅ Prerequisites 🐍☑️ Installed Python 📦☑️Installed Pip 🌐☑️ Created a virtual environment (venv) 🗂️☑️ A dbt project set up 🧪☑️ Existing dbt models defined in your...
📘 Introduction In this hands-on tutorial, we’ll walk you step-by-step through running dbt models directly from the Dagster UI. By integrating dbt with Dagster, you gain an easy way to orchestrate, run, and monitor your models — all from a clean web interface. ✅ Prerequisites 🐍☑️ Installed Python 📦☑️Installed Pip 🌐☑️ Created a virtual...
📘 Introduction n this hands-on tutorial, we’ll walk you step-by-step through the Dagster UI and show you where to find your dbt models, along with important details such as column descriptions, SQL code, and data lineage. ✅ Prerequisites 🐍☑️ Installed Python 📦☑️Installed Pip 🌐☑️ Created a virtual environment (venv) 🗂️☑️ A dbt project set...