Sessionize a Clickstream (30-Minute Gap)

PySpark practice question · Hard · Window Functions

Assign a session_id to every event. A user's events are ordered by event_ts (then event_type). A new session starts at a user's first event and whenever the gap from that user's previous event is MORE than 30 minutes (exactly 30 minutes stays in the same session). session_id is 1 for a user's first session, 2 for the second, and so on.

Example 1

Input events
user_idevent_typeevent_ts
1login2024-05-01 10:00:00
1view2024-05-01 10:10:00
1view2024-05-01 11:00:00
2login2024-05-01 09:00:00
2cart2024-05-01 09:20:00
Expected output
user_idevent_typeevent_tssession_id
1login2024-05-01 10:00:001
1view2024-05-01 10:10:001
1view2024-05-01 11:00:002
2login2024-05-01 09:00:001
2cart2024-05-01 09:20:001

Example 2

Input events
user_idevent_typeevent_ts
7view2024-06-01 08:00:00
7view2024-06-01 08:30:00
7view2024-06-01 09:00:01
Expected output
user_idevent_typeevent_tssession_id
7view2024-06-01 08:00:001
7view2024-06-01 08:30:001
7view2024-06-01 09:00:012

Constraints

Return columns user_id, event_type, event_ts, session_id. Row order does not matter.

Solve it in the live editor on this page — run on sample data, then submit against hidden tests.

‹ First and Last Product per Customer · Month-over-Month Product Rank Change ›

Sessionize a Clickstream (30-Minute Gap) – PySpark Interview Question | TechTown
T
Tech Town
Hi, {{ authName }} · Dashboard Log Out Log In Sign Up Free
PySpark Interview Practice

Practice PySpark Online

{{ totalCount }} questions · {{ shHardPct }}% Hard. Real PySpark DataFrame and Spark SQL interview questions. Write PySpark in your browser on TechTown’s Spark engine, run sample tests, then submit against hidden tests.

{{ totalCount }}
Questions
{{ shTopicCount }}
Topics
{{ solvedCount }}
Solved
{{ accuracy }}
Acceptance
Bookmark Question Topic Difficulty Status
{{ r.n }} - {{ r.title }}{{ r.badge }}{{ r.lock }} {{ r.topic }} {{ r.difficulty }} {{ r.statusIcon }}
No questions match these filters.
Showing {{ shRange }} of {{ shFilteredCount }}

Guests can solve {{ freeLimit }} problems for free. Log in or sign up (free) to unlock everything, keep your streak and appear on the leaderboard. New to a topic? Learn it first in the Spark course.

{{ p.num }}. {{ p.title }} {{ p.difficulty }} {{ p.topic }} {{ p.solvedLabel }}
{{ shPointsLabel }} ⏱ {{ shTimer }}
Embed this questionPaste on a blog, course page or LMS. Free to use — educator guide
{{ shEmbedCode }}

{{ p.statement }}

Example {{ ex.n }}
{{ tb.title }}
{{ c.v }}
Expected result
{{ c.v }}
Constraints

{{ p.constraints }}

  1. {{ h }}
Learn the concept first: {{ p.topic }} in the Spark course
Your submissions (last 20, saved on this device)

No submissions yet. Press Submit to judge your code against all tests.

{{ sb.verdict }}
{{ sb.meta }}
🔒 Solution locked

The model solution and step-by-step explanation unlock when you solve this problem or after 3 unsuccessful submissions ({{ shFailsLabel }}). Struggling? Try the hints on the Question tab first.

Why this approach — step by step
  1. {{ st }}
Optimal solution (PySpark)
{{ p.solution }}
Runs in an isolated browser sandbox · {{ engineLabel }}

Write real PySpark: from pyspark.sql import functions as F, Window, spark.sql(...). It runs in your browser on a lightweight Spark engine, and the same code runs unchanged on Databricks or any Spark cluster. Use df.show() or print() to debug.

{{ verdict }} {{ verdictDetail }}
{{ errorText }}
{{ tr.label }} {{ tr.msg }}
Expected
{{ c.v }}
Your output
{{ c.v }}
stdout:
{{ stdout }}

Enjoying your practice journey?

Create your free TechTown account to unlock every problem, track your progress, bookmark questions and keep preparing for interviews.

Log in / Sign up