Assign a session_id to every event. A user's events are ordered by event_ts (then event_type). A new session starts at a user's first event and whenever the gap from that user's previous event is MORE than 30 minutes (exactly 30 minutes stays in the same session). session_id is 1 for a user's first session, 2 for the second, and so on.
| user_id | event_type | event_ts |
|---|---|---|
| 1 | login | 2024-05-01 10:00:00 |
| 1 | view | 2024-05-01 10:10:00 |
| 1 | view | 2024-05-01 11:00:00 |
| 2 | login | 2024-05-01 09:00:00 |
| 2 | cart | 2024-05-01 09:20:00 |
| user_id | event_type | event_ts | session_id |
|---|---|---|---|
| 1 | login | 2024-05-01 10:00:00 | 1 |
| 1 | view | 2024-05-01 10:10:00 | 1 |
| 1 | view | 2024-05-01 11:00:00 | 2 |
| 2 | login | 2024-05-01 09:00:00 | 1 |
| 2 | cart | 2024-05-01 09:20:00 | 1 |
| user_id | event_type | event_ts |
|---|---|---|
| 7 | view | 2024-06-01 08:00:00 |
| 7 | view | 2024-06-01 08:30:00 |
| 7 | view | 2024-06-01 09:00:01 |
| user_id | event_type | event_ts | session_id |
|---|---|---|---|
| 7 | view | 2024-06-01 08:00:00 | 1 |
| 7 | view | 2024-06-01 08:30:00 | 1 |
| 7 | view | 2024-06-01 09:00:01 | 2 |
Return columns user_id, event_type, event_ts, session_id. Row order does not matter.
Solve it in the live editor on this page — run on sample data, then submit against hidden tests.
‹ First and Last Product per Customer · Month-over-Month Product Rank Change ›
{{ totalCount }} questions · {{ shHardPct }}% Hard. Real PySpark DataFrame and Spark SQL interview questions. Write PySpark in your browser on TechTown’s Spark engine, run sample tests, then submit against hidden tests.
Guests can solve {{ freeLimit }} problems for free. Log in or sign up (free) to unlock everything, keep your streak and appear on the leaderboard. New to a topic? Learn it first in the Spark course.
{{ p.statement }}
{{ p.constraints }}
No submissions yet. Press Submit to judge your code against all tests.
The model solution and step-by-step explanation unlock when you solve this problem or after 3 unsuccessful submissions ({{ shFailsLabel }}). Struggling? Try the hints on the Question tab first.
{{ p.solution }}
Write real PySpark: from pyspark.sql import functions as F, Window, spark.sql(...). It runs in your browser on a lightweight Spark engine, and the same code runs unchanged on Databricks or any Spark cluster. Use df.show() or print() to debug.
Create your free TechTown account to unlock every problem, track your progress, bookmark questions and keep preparing for interviews.