Related

Create DataFrame

pyspark

Create DataFrame from list or RDD

Drop Column

pyspark

Drop column(s) from DataFrame

Show DataFrame

pyspark

Display rows of DataFrame

pyspark/select

Select Columns

Select specific columns from DataFrame

pyspark
dataframe
select

Command

df.select("col1","col2")

Explanation

Retrieve one or more columns.

Examples

Select single column

df.select("name").show()

More

Print Schema

pyspark

Print schema of DataFrame

Filter Rows

pyspark

Filter DataFrame based on condition

Group By

pyspark

Group DataFrame by column(s)