Related

Create DataFrame

pyspark

Create DataFrame from list or RDD

Show DataFrame

pyspark

Display rows of DataFrame

Print Schema

pyspark

Print schema of DataFrame

pyspark/save

Save DataFrame

Write DataFrame to storage

pyspark
dataframe
save

Command

df.write.format("csv").save("path")

Explanation

Save DataFrame to CSV, Parquet, etc.

Examples

Save DataFrame as parquet

df.write.mode("overwrite").parquet("output.parquet")

More

Select Columns

pyspark

Select specific columns from DataFrame

Filter Rows

pyspark

Filter DataFrame based on condition

Group By

pyspark

Group DataFrame by column(s)