class male female 1 2 1 2 0 2 3 2 0 class gender 1 m 1 f 1 m 2 f 2 f 3 m 3 m Using pyspark take the data from table1 and dump into another table in the format of table2 as given . Also please do vice-versa Question 2: dept salary 1 10 1 20 2 40 2 50 2 90 2 80 1 100 1 70 using pyspark sort the datasets as per salary and print out third highest row for each dept Question 3: How you the offset works in KAFKA , also write the syntax for it
The interviewer asked me what would I do if, they put me in a team of data science and some are much experienced and some are cubs in data science. this is your team and how and what would be my contribution to the team?
Spark Aws Big data SQL Hadoop
Hive partitioning and bucketing with scenarios
Do you have a pulse?
What is hash collision and how to avoid it?
Basic ETL and big data questions.
MR,Spark, scala ,hive, sqoop related questions
Overall technical questions on the resume. Spark, Hadoop, Hive, Kafka, etc. e.g, what did you use transformations in Spark Streaming, how does the spark steaming work, map and flatMap in Spark, Hive optimisations, etc.
Why do you want to work here
Viewing 1481 - 1490 interview questions