Spark Architecture
Big Data Internship Interview Questions
1,784 big data internship interview questions shared by candidates
Sqoop,Spark SQL
First Round Experience He asked me 2 SQL Questions(Questions were based on Join and group byAlso asked to write same code in pyspark) and few basic spark questions like cache and persist, reparation and coalesc, RDD, Dataframe and dataset difference. I cleared first round and HR again scheduled second round Second Round: 2 SQL questions which was based on joins and union, union and union all difference, RDD vs Dataframe vs Dataset, Repartition and coalesce,Spark Architecture, Hive and other project related and basic questions. I cleared second round as well then HR scheduled next round which is HR round. HR round: Introduce yourself, What I know about Impetus, Why changing job and walked me through company info and CTC breakdown. She has some budget constraints or approval constraints so not sure why they called and conducted this whole process.
Mostly ask about hadoop and spark and scala
Reasoning questions include scenario based given 2 statements which of following is true(difficult), picture based( weight problem), one 'for' loop program question,jumbling characters problem, one % based problem. techical include one MR program to print files output based on month and find no of sundays in each month. couple of spark and kafka questions. mostly on rdd . nit sure what it is.
Have you shopped at Aldi?
What is combinebykey SCD1 logic Different between edge node and data node Where the code will be deployed? (edge node or in cluster) YARN architecture What are all the versions of spark you have worked? Diff btw SchemaRDD and df Different ways to create dataframe what is bundle in oozie? fork action in oozie? distcp command how do you decide number of mappers in sqoop job? what is the optimal number of mappers provided there is no restriction in establishing connection to DB? how to do you pull clob,blob datatype in oracle to HDFS? semi join,anti-join in scala diff between logical plan and physical plan where can we see logical plan?
Tell me about your self
About buckets, maps, analytical function, udf etc
Why do we use parquet file format ? Why dataframes are faster than RDD
Viewing 1761 - 1770 interview questions