Related

Create DataFrame

pyspark

Create DataFrame from list or RDD

Read CSV

pyspark

Load CSV file into DataFrame

Show DataFrame

pyspark

Display rows of DataFrame

pyspark/init

Initialize Spark

Create SparkSession to start PySpark

pyspark
init
spark

Command

from pyspark.sql import SparkSession

Explanation

A SparkSession is the entry point to using PySpark.

Examples

Create SparkSession

spark = SparkSession.builder.appName("App").getOrCreate()

More

Print Schema

pyspark

Print schema of DataFrame

Select Columns

pyspark

Select specific columns from DataFrame

Filter Rows

pyspark

Filter DataFrame based on condition