1.Question 1An Apache Spark application has two processes: the driver program and the executor. The driver process can be run on which of the following? 1 pointTaskCluster nodeWorker nodeExecutors2.Question 2Which cluster manager is most suitable for establishing simple clusters?1 pointApache MesosKubernetesSpark StandaloneApache Hadoop YARN3.Question 3The 'spark-submit' script, included with Spark for submitting applications, offers various options/settings. Which option/setting allows you to view available options for a specific cluster manager?1 point`deploy-mode``--class <full-class-name>``--executor-cores` `./bin/spark-submit --help` 4.Question 4What is the advantage of using Spark on IBM Cloud? Select all that apply.1 pointPre-existing default configurationEasy to configure local cluster nodes Enterprise-grade securityBetter communication for local cluster nodes 5.Question 5Spark dynamic configuration avoids hardcoding specific values. Which of the following is an example where dynamic configuration can be appropriately used?1 pointApplication versionSpecifying the number of cores to be utilizedApplication nameProperties related to the application6.Question 6Which of the following statements accurately describes the method used for configuring Spark?1 pointConfiguration Type: PropertiesParameters: Adjust and control application behaviorConfiguration Type: LoggingParameters: Adjust settings on a per-machine basisConfiguration Type: PropertiesParameters: Adjust settings on a per-machine basisConfiguration Type: LoggingParameters: Adjust and control application behavior7.Question 7Which of the following statements is accurate regarding the two driver-deploy modes?1 pointClient mode refers to the mode when the application submitter launches the driver process outside the cluster.Client mode refers to the mode when the framework launches the driver process inside the cluster.Cluster mode refers to the mode when the application submitter launches the driver process outside the cluster.Cluster mode refers to the mode when the application submitter launches the executor process outside the cluster.

Which of the following is a key feature of Apache Spark?

1.Question 1What are the three main components of Apache Spark architecture?1 pointScala; Java; PythonData; compute interface; resource managementStorage; HDFS; PythonMesos; YARN; Kubernetes2.Question 2What are DataFrames in Apache Spark?1 pointDataFrames is a distributed file system in Spark used for storing large data sets efficiently.DataFrames are a distributed collection of data organized into named columns.DataFrames are Spark’s built-in machine learning models for predictive analytics.DataFrames is a data format for storing graph data structures in Spark.3.Question 3What is Apache Spark?1 pointHardware manufacturerIn-memory framework for distributed data processingCloud storage serviceClosed-source data analysis tool4.Question 4What is functional programming?1 pointA programming approach that emphasizes the how to of the solution as opposed to the what of the solutionA programming approach that focuses solely on graphical functions and visual designs A programming method that prioritizes procedural programming over the use of mathematical functionsA style of programming that follows the mathematical function format5.Question 5Which of the following statements defines Resilient Distributed Datasets (RDDs)? Select all that apply.1 pointRDD is a collection of fault-tolerant elements.RDD is capable of receiving parallel operations.RDDs are immutable.RDD is a distributed database management system.6.Question 6What is the primary purpose of parallel programming?1 pointTo employ specific control and coordination mechanismTo run noncontemporary instructionsTo use multiple compute resources to solve a computational problemTo break a problem into discrete parts that can be solved sequentially7.Question 7Which of the following is a benefit of DataFrames?1 pointTo scale from kilobytes of data on multiple laptops to petabytes on a large clusterTo scale small-scale data on a laptopSupports specific data formats and storage systemsTo scale from kilobytes of data on a single laptop to petabytes on a large cluster

Why use Apache Spark?

How does Apache Spark solve read/write problems encountered by other tools?

1.Question 1Which API does Apache Spark Structured Streaming use for processing streaming data? 1 pointDataFrame and Dataset APIs Kafka Streaming API Spark Streaming API Spark SQL API 2.Question 2Which output mode in Spark Structured Streaming is particularly useful for managing late-arriving data points? 1 pointOverwrite mode Append mode Update mode Complete mode 3.Question 3Which Spark feature allows you to query a dataframe? 1 pointPipeline SparkSQL DataFrame RDD 4.Question 4Which transformer/extractor counts the occurrences of each term in the text and constructs a vector representation? 1 pointStringIndexer StopWordsRemover StandardScaler CountVectorizer 5.Question 5In a certain SparkML pipeline, there are these 3 stages StandardScaler, VectorAssembler, and Linear Regression. Which of the following is the correct order? 1 pointVectorAssembler, StandardScaler, Linear Regression Linear Regression, StandardScaler, VectorAssembler StandardScaler, Linear Regression, VectorAssembler StandardScaler, VectorAssembler, Linear Regression 6.Question 6In which phase of the ETL are you likely to encounter "save data to parquet file"? 1 pointLoad Model Building Transform Extract 7.Question 7What does a StringIndexer do? 1 pointConverts categorical string columns into numerical indices. Converts numerical columns into strings. Indexes strings so that they can be accessed quicker. Converts floating point columns into string indices. 8.Question 8What does a Tokenizer do? 1 pointConverts text into words. Converts text into symbols called tokens. Assigns a token to each row of the dataset. Is used to compress text. 9.Question 9Which Pyspark component is used to load a stored model? 1 pointPipelineModel Pipeline Model ModelLoader 10.Question 10In which phase of the ETL process would you typically perform "data validation"? 1 pointLoad Extract Model Building Transform