How to Hadoop

Unsplash image by Christopher Alvarenga

Hadoop

Limits of Hadoop

(1+2)+(3+4)+(5+6)+(7+8)+(9+10) = 55
(1+10)+(3+8)+(5+6)+(7+4)+(9+2) = 55
(1+2)x(3+4)x(5+6)x(7+8)x(9+10) = 65,835
(1+10)x(3+8)x(5+6)x(7+4)x(9+2) = 161,051

How it works

  • A distributed file system, like Hadoop Distributed File System (HDFS)
  • A MapReduce Engine — something that can run the MapReduce algorithm — essentially a Java environment (place to run Java files)
  • Some sort of Tracking System, like YARN.

WTF is HDFS

WTF is MapReduce

WTF is YARN

Administration

Adding Nodes to the cluster

Add services to a Node

Remove Nodes

Check health and Disk Space

Configuration

Services/Components

“Why do I have to write a query in Java! It is overly complex for what I want to do!”

Apologies for how creepy they both are.

We are done

--

--

--

Focused on saving our time: everyhour.xyz for your life balance; tree-meals-a-day.earth for our food emissions and compairbnb.info/hello for booking airbnbs.

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Minimal Viable Product by Example

Getting Started with Amazon EKS — Provisioning and Adding Clusters

What is a Data Pipeline and how you can use it?

DESIGN PATTERNS SAGA #14: REAL PROJECT SITUATIONS WITH VISITOR

Covariance, Contravariance, and Invariance — What do they mean? (Part 3)

Pemrograman Android “Testing, debugging, and using support librariesTesting”

My Review of Spring: Spring MVC

Using Packer & Ansible for Configuration and Change Management

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
ACGoff

ACGoff

Focused on saving our time: everyhour.xyz for your life balance; tree-meals-a-day.earth for our food emissions and compairbnb.info/hello for booking airbnbs.

More from Medium

LeetCode SQL| 177. Nth Highest Salary

Stack Data Structure in C++

Prepare your SQL interview in less than 10 minutes — Part 1

Hackerrank: Diagonal Difference | Easy | Java solution