How to use join text with group by in Pyspark?

Question

I have a pyspark dataframe

I am trying to join events by grouping IDs Here's my python code

df_events_userpath = df_events.groupby('id').agg({ 'events': lambda x: ' '.join(x)}).reset_index()

id	events
a0	a-markets-l1 a-markets-watch a-markets-buy a-markets-sell
c7	a-markets-z2 scroll_down
b2	next_screen

Does this answer your question? [Concatenating string by rows in pyspark](https://stackoverflow.com/questions/41788919/concatenating-string-by-rows-in-pyspark) — ScootCork, May 15 '22 at 16:50

score 0 · Accepted Answer · answered May 15 '22 at 05:09

0

I have tried using collect_set

df.groupBy("id").agg(f.collect_set("events").alias("events"))

answered May 15 '22 at 05:09

Shubh

1 Answers1