Related

Create DataFrame

pyspark

Create DataFrame from list or RDD

Initialize Repository

git

Create an empty Git repository in a directory to start version controlling your project

Read CSV

pyspark

Load CSV file into DataFrame

pyspark/init

Initialize Spark

Create SparkSession to start PySpark

pyspark
init
spark

Command

from pyspark.sql import SparkSession

Explanation

A SparkSession is the entry point to using PySpark.

Examples

Create SparkSession

spark = SparkSession.builder.appName("App").getOrCreate()

More

Show DataFrame

pyspark

Display rows of DataFrame

Print Schema

pyspark

Print schema of DataFrame

Select Columns

pyspark

Select specific columns from DataFrame