Related

Create DataFrame

pyspark

Create DataFrame from list or RDD

Show DataFrame

pyspark

Display rows of DataFrame

Print Schema

pyspark

Print schema of DataFrame

pyspark/join

Join DataFrames

Join two DataFrames

pyspark
dataframe
join

Command

df1.join(df2, on="col", how="inner")

Explanation

Supports inner, outer, left, right joins.

Examples

Inner join on id column

df1.join(df2, "id", "inner").show()

More

Select Columns

pyspark

Select specific columns from DataFrame

Filter Rows

pyspark

Filter DataFrame based on condition

Where

pyspark

Alternative to filter()