Introduction In this tutorial, we want to convert a Pandas DataFrame into a PySpark DataFrame with a specific schema. In order to do this, we use the the createDataFrame() function of PySpark. Import Libraries First, we import the following python modules: import pandas as pd from pyspark.sql import...
Introduction In this tutorial, we want to select data from a table by using a SQL Statement. In order to do this, we use the SELECT Statement. We have already created the table student with the following data: Example 1 - SELECT specific columns We want to select the columns...
Introduction In this tutorial, we want to delete specific rows from a table by using a SQL Statement. In order to do this, we use the DELETE Statement. We have already created the table student with the following data: Example 1 We want to delete all rows where the name...
Introduction In this tutorial, we want to update the data in a table by using a SQL Statement. In order to do this, we use the UPDATE Statement. We have already created the table student with the following data: Example 1 We want to update the student with the name...
Introduction In this tutorial, we want to delete all rows from a table by using a SQL Statement. The table itself should remain. In order to do this, we use the TRUNCATE Statement. We have already created the table student with the following data: SQL Statement Now, let's...
Introduction In this tutorial, we want to insert new rows into a table by using a SQL Statement. In order to do this, we use the INSERT Statement. We have already created the table student. As you can see, the table is empty. SQL Statement Now, let's insert...
Introduction In this tutorial, we want to modify an existing table by using a SQL Statement. In order to do this, we use the ALTER TABLE Statement. We have already created a table called student. The table has the following columns: Example 1 - ADD COLUMN We want to add...
Introduction In this tutorial, we want to sort a Pandas DataFrame by specific columns. In order to do this, we use the sort_values() method of Pandas. Import Libraries First, we import the following python modules: import numpy as np import pandas as pd Create Pandas DataFrame Next, we create...
Introduction In this tutorial, we want to create a table by using a SQL Statement. In order to do this, we use the CREATE TABLE Statement. We have already created a server called DLNerdsServer and a database called dlnerdsacademy. Now, we want to create a table called student. SQL Statement...
