Select the number of stages that will be generated from the DAG while executing the below code?
val rdd1 = sc.textFile("Customer")
val rdd2 = rdd1.map(_.split(",")).map(arr1 => (arr1(2),arr1(4).toInt))
rdd2.cache()
val rdd3 = rdd2.reduceByKey(_ max _)
rdd3.saveAsTextFile("output1")

Question

Select the number of stages that will be generated from the DAG while executing the below code?

val rdd1 = sc.textFile("Customer")

val rdd2 = rdd1.map(_.split(",")).map(arr1 => (arr1(2),arr1(4).toInt))

rdd2.cache()

val rdd3 = rdd2.reduceByKey(_ max _)

rdd3.saveAsTextFile("output1")

anonymous · Accepted Answer

Correct Solution - b

Select the number of stages that will be generated from the DAG while executing the below code?val rdd1 = sc.textFile("Customer")val rdd2 = rdd1.map(_.split(",")).map(arr1 => (arr1(2),arr1(4).toInt))rdd2.cache()val rdd3 = rdd2.reduceByKey(_ max _)rdd3.saveAsTextFile("output1")