PlayStation Interview Question

Sessionise a large batch of web usage data in Spark

Interview Answer

Anonymous

Apr 24, 2017

Actually quite hard to do 'in table', but techniques do exist to do it - think window functions and cumulative sums. And test your results thoroughly: just getting most of the right answer/the right approach ain't going to cut it. You're basically going to have to regenerate the answers in a different way (bit too big for Excel!) and cross-check your final result.