Python

Python

87 posts
PySpark - Create Embedding Vectors with Sentence-Transformers
Academy Membership PySparkPython

PySpark - Create Embedding Vectors with Sentence-Transformers

Introduction In today's data-driven world, understanding text data is crucial across various domains, from data analysis to engineering and architecture. However, dealing with text data often requires converting it into numerical representations for machine learning models to process efficiently. This is where embedding vectors come into play, offering...

PySpark - Concatenate String Columns of a DataFrame
Academy Membership PySparkPython

PySpark - Concatenate String Columns of a DataFrame

Introduction In this tutorial, we will show you how to concatenate multiple string columns of a PySpark DataFrame into a single column. In order to do this, we will use the functions concat() and concat_ws() of PySpark. Import Libraries First, we import the following python modules: from pyspark.sql...

PySpark - Group and Concatenate Strings in a DataFrame
Academy Membership PySparkPython

PySpark - Group and Concatenate Strings in a DataFrame

Introduction In this tutorial, we will show you how to group and concatenate strings in a PySpark DataFrame. In order to do this, we will use the groupBy() method in combination with the functions concat_ws(), collect_list() and array_distinct() of PySpark. Import Libraries First, we import the following...

PySpark - How to use Pandas User Defined Function (UDF)
Academy Membership PySparkPython

PySpark - How to use Pandas User Defined Function (UDF)

Introduction In the realm of big data processing, PySpark has emerged as a powerful tool for handling large-scale datasets. Its distributed computing framework allows for efficient processing of massive volumes of data. However, despite its capabilities, performing certain data transformations in PySpark can sometimes be cumbersome and complex. That'...

Type Hints in Python: A Guide for Beginners
Academy Membership Python

Type Hints in Python: A Guide for Beginners

Introduction As projects grow in size and complexity, it becomes increasingly important to ensure that code remains understandable and easy to work with. One powerful tool for achieving this is the use of type hints. In this tutorial, we will explain why and how to use type hints in Python....

Pandas - Change Column Types of a DataFrame

Pandas - Change Column Types of a DataFrame

Introduction Data manipulation tasks often involve converting column data types to ensure consistency and accuracy in analysis. In this tutorial, we will show you how to change column types of a Pandas DataFrame. In order to do this, we will use the astype() method, the map() method and the to_...

You’ve successfully subscribed to Deep Learning Nerds | The ultimate Learning Platform for AI and Data Science
Welcome back! You’ve successfully signed in.
Great! You’ve successfully signed up.
Success! Your email is updated.
Your link has expired
Success! Check your email for magic link to sign-in.