Related

Group By

pyspark

Group DataFrame by column(s)

Create DataFrame

pyspark

Create DataFrame from list or RDD

Show DataFrame

pyspark

Display rows of DataFrame

pyspark/agg

Aggregation

Aggregate with functions like sum, avg, max

pyspark
dataframe
aggregate

Command

df.agg()

Explanation

Perform aggregations on DataFrames.

Examples

Average salary per department

df.groupBy("dept").agg({"salary":"avg"}).show()

More

Print Schema

pyspark

Print schema of DataFrame

Select Columns

pyspark

Select specific columns from DataFrame

Filter Rows

pyspark

Filter DataFrame based on condition