Data Engineering

Data Engineering

82 posts
Writing Singular Tests in dbt: A Practical Example
Academy Membership dbtData Engineering

Writing Singular Tests in dbt: A Practical Example

📘 Introduction In this hands-on dbt tutorial, you’ll learn step-by-step how to create a singular test to validate custom business rules using SQL. Unlike built-in generic tests (like unique or not_null), singular tests allow you to write fully customizable SQL logic to enforce strict data quality checks. ✅ Prerequisites ☑️ A...

CTEs vs Subqueries in dbt: Why CTEs make your SQL cleaner
Academy Membership dbtData Engineering

CTEs vs Subqueries in dbt: Why CTEs make your SQL cleaner

📘Introduction In this hands-on dbt tutorial, we’ll walk you step-by-step through how to make your SQL cleaner and more maintainable by using CTEs (Common Table Expressions) instead of deeply nested subqueries.  ✅ Prerequisites ☑️ A dbt project set up ☑️ Source data loaded into your data warehouse ☑️ Source configurations defined in sources....

Set up Medallion Architecture in Databricks: From Raw Data to Gold Standard
Academy Membership DatabricksData Engineering

Set up Medallion Architecture in Databricks: From Raw Data to Gold Standard

📘 Introduction In the age of data-driven decision making, a well-structured and scalable data architecture is essential. The Medallion Architecture is a proven framework that organizes data into multiple layers of refinement — ensuring clarity, governance, and trust as data flows from raw ingestion to business-ready insights. When combined with Databricks and...

How to Serve a React App with FastAPI Using Static Files
Academy Membership PythonFastAPI

How to Serve a React App with FastAPI Using Static Files

📘 Introduction FastAPI is a powerful Python framework for building APIs that is both fast and modern. But sometimes you want more than just an API—you also want a user-friendly interface. Instead of running React and FastAPI on two separate servers, you can bundle your React frontend inside FastAPI and...

Scheduling dbt models with Dagster: A Step-by-Step Guide
Academy Membership Dagsterdbt

Scheduling dbt models with Dagster: A Step-by-Step Guide

📘 Introduction In this hands-on tutorial, we’ll walk step-by-step through scheduling dbt models with Dagster. By integrating Dagster, you can easily orchestrate your dbt workflows and automating model runs. ✅ Prerequisites 🐍☑️ Installed Python 📦☑️Installed Pip 🌐☑️ Created a virtual environment (venv) 🗂️☑️ A dbt project set up 🧪☑️ Existing dbt models defined in your...

You’ve successfully subscribed to Deep Learning Nerds | The ultimate Learning Platform for AI and Data Science
Welcome back! You’ve successfully signed in.
Great! You’ve successfully signed up.
Success! Your email is updated.
Your link has expired
Success! Check your email for magic link to sign-in.