Premium

A list of premium posts for academy members containing hands-on tutorials, best practices, career advices and learning paths.

284 premium posts
PySpark coalesce() Function Explained
Academy Membership PySparkPython

PySpark coalesce() Function Explained

📘 Introduction In many real-world datasets, the same type of information can appear in more than one column. A customer may provide an email address, a phone number, or a backup contact, and different systems may populate different fields. When you want to select the first available non-null value from several...

Using pre-hooks in dbt: A Hands-On Guide
Academy Membership dbtData Engineering

Using pre-hooks in dbt: A Hands-On Guide

📘Introduction In this hands-on dbt tutorial, you'll learn how to use pre-hooks to automate tasks such as creating backup tables before a model runs. Pre-hooks allow you to execute SQL before your dbt model builds, which is useful for auditing, data quality checks, or preparing the environment. 🎓 Preparing...

Kafka Producers and Consumers Explained: How Data Flows in Apache Kafka
Academy Membership Kafka

Kafka Producers and Consumers Explained: How Data Flows in Apache Kafka

📘 Introduction Modern systems produce endless streams of real-time data — from app events and online purchases to sensor readings and transactions. To handle this flow efficiently, applications need a fast, reliable way to move data between services as it happens. That’s where Apache Kafka comes in. Kafka is a distributed...

How to Ingest Data from Kafka Streams to Delta Tables Using PySpark in Databricks
Academy Membership DatabricksPySpark

How to Ingest Data from Kafka Streams to Delta Tables Using PySpark in Databricks

📘 Introduction Real-time data ingestion is a critical part of modern data architectures. Organizations need to process and store continuous streams of information for analytics, monitoring, and machine learning. Databricks, with the combined power of PySpark and Delta Lake, provides an efficient way to build end-to-end streaming pipelines that handle data...

Overview of all important YAML Files in dbt
Academy Membership dbtData Engineering

Overview of all important YAML Files in dbt

📘Introduction When working with dbt (data build tool), YAML files are the backbone of your project’s configuration. They define how dbt behaves, how your models connect to data sources, and how metadata, documentation, and tests are managed. Understanding these YAML files and knowing where they are located within your...

How to Generate a Hash from Multiple Columns in PySpark
Academy Membership PySparkData Engineering

How to Generate a Hash from Multiple Columns in PySpark

📘 Introduction When processing massive datasets in PySpark, it’s often necessary to uniquely identify rows or efficiently detect changes across records. Using multiple columns as a composite key can quickly become cumbersome and inefficient — especially during joins or deduplication. A better solution is to generate a single hash value derived...

Configuring DEV and PROD Environments in dbt
Academy Membership dbtData Engineering

Configuring DEV and PROD Environments in dbt

📘Introduction In this hands-on dbt tutorial, you’ll learn how to configure separate development (DEV) and production (PROD) environments to safely build, test, and deploy your data models. We’ll walk through why environment separation matters and how to configure your profiles.yml so you can switch between environments with...

Using Jinja loops for flexible Aggregations in dbt
Academy Membership dbtData Engineering

Using Jinja loops for flexible Aggregations in dbt

📘Introduction In this hands-on dbt tutorial, you’ll learn how to make your aggregations dynamic and flexible using Jinja loops inside your SQL models. Instead of writing multiple aggregation functions, you’ll see how to dynamically generate aggregation logic — saving time and reducing repetitive SQL code. 🎓 Preparing for dbt Analytics...

Making CASE Statements dynamic with Jinja Loops in dbt
Academy Membership dbtData Engineering

Making CASE Statements dynamic with Jinja Loops in dbt

📘Introduction In this hands-on dbt tutorial, you’ll learn how to make your SQL transformations dynamic and reusable by using Jinja loops inside CASE statements. This approach helps you replace repetitive SQL logic with concise, maintainable code — a valuable skill for any Data Engineer. 🎓 Preparing for dbt Analytics Engineering Certification?...

Using For Loops in your dbt models with Jinja
Academy Membership dbtData Engineering

Using For Loops in your dbt models with Jinja

📘Introduction In this hands-on dbt tutorial, you'll learn how to use Jinja for loops inside your dbt models to make your SQL code more dynamic and automated. Instead of manually repeating similar SQL logic for multiple columns, tables, or conditions — you can use for loops with Jinja to...

Overwriting Project Variables at Runtime in dbt
Academy Membership dbtData Engineering

Overwriting Project Variables at Runtime in dbt

📘 Introduction In this hands-on dbt tutorial, you'll learn how to overwrite project variables at runtime — a powerful feature that lets you dynamically change your dbt model behavior without modifying your code or dbt_project.yml. This is especially useful when you need to run the same transformation logic...

GraphQL vs. REST: Understanding the Key Differences
Academy Membership APIData Engineering

GraphQL vs. REST: Understanding the Key Differences

📘Introduction In this tutorial, you'll learn how GraphQL and REST differ and why developers choose one over the other. Whether you’re building modern web apps or managing large datasets, understanding these differences is essential for efficient, scalable applications. 🟣 GraphQL GraphQL (Graph Query Language) is a query language...

How to use variables in your dbt models with Jinja
Academy Membership dbtData Engineering

How to use variables in your dbt models with Jinja

📘 Introduction In this hands-on dbt tutorial, you’ll learn how to use Jinja variables inside your dbt models to make your SQL code more dynamic, flexible, and reusable. Instead of hardcoding values directly into your SQL logic, Jinja allows you to define variables that can be adjusted at runtime or...

Create Interactive Multiselect Columns in Streamlit
Academy Membership StreamlitPython

Create Interactive Multiselect Columns in Streamlit

📘 Introduction Streamlit makes it easy to build interactive apps — and its st.data_editor() widget lets users edit data directly inside your app. But what if a single cell needs multiple selections, like tags, skills, or categories? 🤔 That’s where st.column_config.MultiselectColumn comes in! It allows you to...

Writing Singular Tests in dbt: A Practical Example
Academy Membership dbtData Engineering

Writing Singular Tests in dbt: A Practical Example

📘 Introduction In this hands-on dbt tutorial, you’ll learn step-by-step how to create a singular test to validate custom business rules using SQL. Unlike built-in generic tests (like unique or not_null), singular tests allow you to write fully customizable SQL logic to enforce strict data quality checks. ✅ Prerequisites ☑️ A...

CTEs vs Subqueries in dbt: Why CTEs make your SQL cleaner
Academy Membership dbtData Engineering

CTEs vs Subqueries in dbt: Why CTEs make your SQL cleaner

📘Introduction In this hands-on dbt tutorial, we’ll walk you step-by-step through how to make your SQL cleaner and more maintainable by using CTEs (Common Table Expressions) instead of deeply nested subqueries.  ✅ Prerequisites ☑️ A dbt project set up ☑️ Source data loaded into your data warehouse ☑️ Source configurations defined in sources....

Getting Started with OpenAI Agent Builder: Build Multi-Agent Workflows with Drag-and-Drop Interface
Academy Membership OpenAIAgentic AI

Getting Started with OpenAI Agent Builder: Build Multi-Agent Workflows with Drag-and-Drop Interface

📘 Introduction Welcome to this hands-on guide to OpenAI Agent Builder — a revolutionary no-code tool that lets you design and deploy multi-agent workflows using a drag-and-drop interface. In this post, we’ll walk you through how to access the Agent Builder and create your first agent workflow step-by-step. 💡 What is OpenAI...

Set up Medallion Architecture in Databricks: From Raw Data to Gold Standard
Academy Membership DatabricksData Engineering

Set up Medallion Architecture in Databricks: From Raw Data to Gold Standard

📘 Introduction In the age of data-driven decision making, a well-structured and scalable data architecture is essential. The Medallion Architecture is a proven framework that organizes data into multiple layers of refinement — ensuring clarity, governance, and trust as data flows from raw ingestion to business-ready insights. When combined with Databricks and...

Add a Background Image to your Streamlit App
Academy Membership StreamlitPython

Add a Background Image to your Streamlit App

📘 Introduction Streamlit makes it super easy to build interactive data apps in Python — without needing HTML, CSS, or JavaScript. But sometimes, you want your app to look more polished and visually appealing. One simple way to achieve that is by adding a background image. Whether you want to match your...

Speed up your Streamlit App with Caching
Academy Membership StreamlitPython

Speed up your Streamlit App with Caching

📘 Introduction Streamlit makes it super easy to build interactive apps in Python. But as your app grows — loading datasets, running expensive computations, or calling APIs — you might notice it slows down. The good news: Streamlit has a built-in caching system that stores results of expensive operations and reuses them instead...

How to deploy a Docusaurus Website to GitHub Pages
Academy Membership DocusaurusGit

How to deploy a Docusaurus Website to GitHub Pages

📘 Introduction Welcome to this hands-on Docusaurus deployment tutorial! In this guide, we’ll walk you step-by-step through deploying your Docusaurus site to GitHub Pages — a simple and free hosting solution for websites. Perfect for open-source projects, documentation sites, or personal projects that you want to share with the world. 💡 What...

How to build an interactive Documentation Website with Docusaurus: A Step-by-Step Guide
Academy Membership DocusaurusReact

How to build an interactive Documentation Website with Docusaurus: A Step-by-Step Guide

📘 Introduction Welcome to this hands-on Docusaurus tutorial! In this guide, we’ll walk you step-by-step through creating your first interactive documentation site using Docusaurus — perfect for developers, startups, or teams who want to provide clean, user-friendly, and dynamic documentation. 💡 What is Docusaurus? Docusaurus is a static site generator built by...

Build an AI Agent with LangChain, LangGraph and OpenAI Models
Academy Membership Agentic AILangChain

Build an AI Agent with LangChain, LangGraph and OpenAI Models

📘 Introduction Welcome to this hands-on LangChain + LangGraph tutorial! In this guide, we’ll walk you step-by-step through creating your first AI agent using LangChain, LangGraph, and OpenAI models — perfect for beginners who want to build intelligent, autonomous assistants with flexible workflows. 💡 What are LangChain and LangGraph? * LangChain is a powerful...

How to Serve a React App with FastAPI Using Static Files
Academy Membership PythonFastAPI

How to Serve a React App with FastAPI Using Static Files

📘 Introduction FastAPI is a powerful Python framework for building APIs that is both fast and modern. But sometimes you want more than just an API—you also want a user-friendly interface. Instead of running React and FastAPI on two separate servers, you can bundle your React frontend inside FastAPI and...

How to style your Streamlit App with Custom Themes
Academy Membership StreamlitPython

How to style your Streamlit App with Custom Themes

📘 Introduction Streamlit makes it easy to turn Python scripts into interactive web apps — no front-end coding needed. But what if you want to adjust the look and feel? Maybe you want a dark theme, different fonts, or brand colors. The good news: Streamlit has a built-in theme system that lets...

How to deploy your FastMCP Server on FastMCP Cloud
Academy Membership MCPAgentic AI

How to deploy your FastMCP Server on FastMCP Cloud

📘Introduction Welcome to this hands-on FastMCP tutorial! In this guide, we’ll walk you step by step through deploying and testing your first FastMCP server on FastMCP Cloud. Deploying is a crucial step because it makes your FastMCP server accessible, usable, and ready for real-world applications. ✅ Prerequisites Before you begin,...

How to build a Chatbot with Gradio and the OpenAI Python SDK
Academy Membership Agentic AIOpenAI

How to build a Chatbot with Gradio and the OpenAI Python SDK

📘 Introduction Chatbots are no longer just futuristic concepts—they’re now powering customer service, virtual assistants, and productivity tools everywhere. With the OpenAI Python SDK, you can build a powerful conversational model in just a few lines of code. And when paired with Gradio, you get a clean, interactive web...

Understanding JSON-RPC: The Backbone of MCP Communication
Academy Membership DataMCP

Understanding JSON-RPC: The Backbone of MCP Communication

📘Introduction In this guide, we’ll walk through the basics of JSON-RPC, a lightweight protocol for structured communication between systems. It’s widely used in APIs, blockchain, and even newer standards like the Model Context Protocol (MCP). 💡 What is JSON-RPC? JSON-RPC is a remote procedure call (RPC) protocol encoded in...

Scheduling dbt models with Dagster: A Step-by-Step Guide
Academy Membership Dagsterdbt

Scheduling dbt models with Dagster: A Step-by-Step Guide

📘 Introduction In this hands-on tutorial, we’ll walk step-by-step through scheduling dbt models with Dagster. By integrating Dagster, you can easily orchestrate your dbt workflows and automating model runs. ✅ Prerequisites 🐍☑️ Installed Python 📦☑️Installed Pip 🌐☑️ Created a virtual environment (venv) 🗂️☑️ A dbt project set up 🧪☑️ Existing dbt models defined in your...

Running your dbt models via Dagster UI
Academy Membership Dagsterdbt

Running your dbt models via Dagster UI

📘 Introduction In this hands-on tutorial, we’ll walk you step-by-step through running dbt models directly from the Dagster UI. By integrating dbt with Dagster, you gain an easy way to orchestrate, run, and monitor your models — all from a clean web interface. ✅ Prerequisites 🐍☑️ Installed Python 📦☑️Installed Pip 🌐☑️ Created a virtual...

Exploring your dbt models in the Dagster UI
Academy Membership Dagsterdbt

Exploring your dbt models in the Dagster UI

📘 Introduction n this hands-on tutorial, we’ll walk you step-by-step through the Dagster UI and show you where to find your dbt models, along with important details such as column descriptions, SQL code, and data lineage. ✅ Prerequisites 🐍☑️ Installed Python 📦☑️Installed Pip 🌐☑️ Created a virtual environment (venv) 🗂️☑️ A dbt project set...

Defining dbt models as Assets in Dagster
Academy Membership Dagsterdbt

Defining dbt models as Assets in Dagster

📘 Introduction In this hands-on tutorial, we’ll walk you step-by-step through adding your dbt models as assets to your Dagster projects. Once done, your dbt models will appear in the Dagster UI, making it easy to orchestrate, run, and monitor them. ✅ Prerequisites 🐍☑️ Installed Python 📦☑️Installed Pip 🌐☑️ Created a virtual environment...

Running Dagster with your dbt project locally
Academy Membership Dagsterdbt

Running Dagster with your dbt project locally

📘 Introduction In this hands-on tutorial, we’ll walk you step-by-step through how to run Dagster with your dbt project, so you can orchestrate, monitor, and manage your data pipelines in the Dagster UI. ✅ Prerequisites 🐍☑️ Installed Python 📦☑️Installed Pip 🌐☑️ Created a virtual environment (venv) 🗂️☑️ A dbt project set up 🧪☑️ Existing dbt...

Using Dagster with dbt: A Modern Approach to Data Orchestration
Academy Membership Dagsterdbt

Using Dagster with dbt: A Modern Approach to Data Orchestration

📘 Introduction In this hands-on tutorial, we’ll walk you step-by-step through how to orchestrate your dbt workflows using Dagster. Combining Dagster’s robust orchestration capabilities with dbt’s transformation power allows you to build reliable, maintainable, and observable data pipelines.  ✅ Prerequisites 🐍☑️ Installed Python 📦☑️Installed Pip 🌐☑️ Created a virtual environment (venv)...

How to configure the transport method for your FastMCP server
Academy Membership MCPAgentic AI

How to configure the transport method for your FastMCP server

📘Introduction Welcome to this hands-on FastMCP tutorial! In this guide, we’ll walk you step-by-step through configuring the transport method for your FastMCP server. By the end, you’ll understand the different transport mechanisms available and how to use them in the run() statement. ✅ Prerequisites Before you begin, make sure...

Understanding the Transport Layer in MCP Architecture
Academy Membership MCPAgentic AI

Understanding the Transport Layer in MCP Architecture

📘Introduction Welcome to this MCP tutorial! In this guide, we’ll walk step-by-step through the Transport Layer in Model Context Protocol (MCP) architecture. By the end, you’ll understand how the transport layer facilitates efficient and reliable communication between clients and servers. 💡What is the Transport Layer? In the Model...

How to run your FastMCP Server: A Hands-On Guide
Academy Membership Agentic AIMCP

How to run your FastMCP Server: A Hands-On Guide

📘Introduction Welcome to this hands-on FastMCP tutorial! In this guide, we’ll walk step-by-step through how to run a FastMCP Server. By the end, you’ll have a fully working server with a custom tool that AI clients can call and interact with. ✅ Prerequisites Before you begin, make sure you...

How to add Tools to your FastMCP Server
Academy Membership MCPAgentic AI

How to add Tools to your FastMCP Server

📘Introduction Welcome to this hands-on FastMCP tutorial! In this guide, we’ll walk step-by-step through how to add a tool to your FastMCP Server. By the end, you’ll have a working server with a custom tool that can be called by AI clients. ✅ Prerequisites Before you begin, make sure...

How to build an AI Agent using the OpenAI Agents SDK
Academy Membership Agentic AIGenerative AI

How to build an AI Agent using the OpenAI Agents SDK

📘 Introduction Welcome to this hands-on OpenAI Agents tutorial! In this guide, we’ll walk you step-by-step through creating your first AI agent using the OpenAI Agents SDK — perfect for beginners who want to build intelligent, autonomous assistants quickly. 💡 What is the OpenAI Agents SDK? The OpenAI Agents SDK is a...

How to create your first FastMCP Server: A Beginners Tutorial
Academy Membership MCPAgentic AI

How to create your first FastMCP Server: A Beginners Tutorial

📘Introduction Welcome to this hands-on FastMCP tutorial! In this guide, we’ll walk you step-by-step through creating your first FastMCP server from scratch — perfect for beginners who want to jump into MCP quickly. ✅ Prerequisites Before you begin, make sure you have the following: 🐍☑️ Installed Python 📦☑️ Installed Pip 🌐☑️ Created and activated...

What is FastMCP and how to use it?
Academy Membership PythonMCP

What is FastMCP and how to use it?

📘 Introduction Welcome to this hands-on FastMCP tutorial! In this guide, we’ll take you step-by-step through setting up and using FastMCP to accelerate your AI projects with ease and efficiency. ✅ Prerequisites Before you begin, make sure you have the following: 🐍☑️ Installed Python 📦☑️ Installed Pip 🌐☑️ Created and activated a virtual environment...

Model Context Protocol (MCP): The USB-C Port for AI Agents
Academy Membership MCPAgentic AI

Model Context Protocol (MCP): The USB-C Port for AI Agents

📘 Introduction In the rapidly evolving world of artificial intelligence, interoperability is emerging as a critical challenge. With multiple agents, tools, memory systems, and models working in tandem, the need for a universal “plug-and-play” protocol is greater than ever. Enter the Model Context Protocol (MCP) — a new standard designed to unify...

How to pass the dbt Analytics Engineering Certification Exam: Preparation Tips and Learning Materials

How to pass the dbt Analytics Engineering Certification Exam: Preparation Tips and Learning Materials

📘 Introduction The dbt Analytics Engineering Certification Exam can be challenging—but with the right preparation strategy, you can pass with confidence. This guide brings together the best official resources and practical tutorials to help you stay focused, study smarter, and succeed. 📋1️⃣ Read the official dbt Study Guide Begin with...

Top 10 Streamlit Widgets and How to Use Them
Academy Membership StreamlitPython

Top 10 Streamlit Widgets and How to Use Them

📘 Introduction Creating interactive web apps with Streamlit is incredibly easy — even if you're not a front-end developer. Once you've mastered the basics, Streamlit’s widget system becomes your playground. These widgets let users interact with your data and models in real time. In this post, you&...

Getting Started with Streamlit: Build Your First Data App
Academy Membership StreamlitPython

Getting Started with Streamlit: Build Your First Data App

📘 Introduction Data scientists and analysts often struggle to share their work interactively. Whether it's model results or beautiful visualizations, the gap between code and a usable interface can be frustrating. That's where Streamlit comes in. Streamlit is a powerful Python framework that turns your data scripts...

Smarter Documentation with AI: How to connect Claude with Confluence using an MCP Server

Smarter Documentation with AI: How to connect Claude with Confluence using an MCP Server

📘 Introduction Connecting Claude Desktop with Atlassian Confluence streamlines your workflow by enabling Claude to retrieve, summarize, and publish content directly to Confluence pages. Thanks to the Model Context Protocol (MCP), this integration is seamless. In this tutorial, we’ll show you how to set it up using Atlassian’s remote...

7 Myths About AI You Should Stop Believing

7 Myths About AI You Should Stop Believing

📘 Introduction Artificial Intelligence (AI) is no longer science fiction—it's part of our everyday lives. From personalized content to smart assistants, AI is transforming industries and society. But myths and misconceptions can make AI seem either all-powerful or frighteningly mysterious. This guide cuts through the confusion, revealing the...

10 Easy Ways to Start Using AI Chatbots in Your Daily Life Right Now - No Tech Skills Needed

10 Easy Ways to Start Using AI Chatbots in Your Daily Life Right Now - No Tech Skills Needed

📘Introduction AI chatbots have rapidly evolved into powerful everyday assistants—making tasks easier, faster, and more enjoyable. Whether you're looking to boost productivity, spark creativity, or simply save time, tools like ChatGPT, Claude, and Gemini offer practical support you can tap into right now—no technical skills needed....

You’ve successfully subscribed to Deep Learning Nerds | The ultimate Learning Platform for AI and Data Science
Welcome back! You’ve successfully signed in.
Great! You’ve successfully signed up.
Success! Your email is updated.
Your link has expired
Success! Check your email for magic link to sign-in.