Hadoop in cloud (EMR, Dataproc, HDInsight) - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is Amazon EMR in the context of Hadoop?

Amazon EMR is a cloud service that makes it easy to run Hadoop and big data frameworks on AWS. It manages the cluster setup, scaling, and maintenance so you can focus on data processing.

beginner

How does Google Cloud Dataproc simplify Hadoop usage?

Google Cloud Dataproc is a managed service that lets you run Hadoop clusters quickly and easily on Google Cloud. It automates cluster creation, scaling, and management, reducing setup time from minutes to seconds.

beginner

What is Azure HDInsight and its role with Hadoop?

Azure HDInsight is a cloud service from Microsoft that provides managed Hadoop clusters. It supports big data processing with Hadoop and other tools, handling cluster management and integration with Azure services.

intermediate

Why use cloud services like EMR, Dataproc, or HDInsight for Hadoop?

Using cloud services for Hadoop removes the need to manage hardware and software manually. They offer easy cluster setup, automatic scaling, and integration with other cloud tools, saving time and reducing complexity.

intermediate

What are common features shared by EMR, Dataproc, and HDInsight?

All three provide managed Hadoop clusters, automatic scaling, integration with cloud storage, support for other big data tools like Spark, and easy cluster management through web consoles or APIs.

Which cloud service is provided by Amazon for managed Hadoop clusters?

A EMR

B Dataproc

C HDInsight

D BigQuery

Amazon EMR is Amazon's managed Hadoop service.

Google Cloud Dataproc is best described as:

A A managed Hadoop and Spark service on Google Cloud

B A Microsoft cloud storage service

C A local Hadoop installation tool

D A database service

Dataproc manages Hadoop and Spark clusters on Google Cloud.

Azure HDInsight supports which of the following?

A Local Hadoop installations

B Only SQL databases

C Managed Hadoop clusters

D Mobile app development

HDInsight provides managed Hadoop clusters on Azure.

A key benefit of using cloud Hadoop services is:

A Manual hardware setup

B Automatic cluster scaling

C No internet needed

D Only works on Windows

Cloud services automatically scale clusters based on demand.

Which of these is NOT a feature of EMR, Dataproc, and HDInsight?

A Managed cluster setup

B Integration with cloud storage

C Automatic cluster scaling

D Requires manual Hadoop installation

These services handle Hadoop installation automatically.

Explain how cloud services like EMR, Dataproc, and HDInsight help simplify Hadoop cluster management.

Think about what tasks you avoid by using these services.

Compare the main cloud providers' Hadoop services: EMR, Dataproc, and HDInsight.

Focus on provider, service name, and key features.