How to Hadoop

Unsplash image by Christopher Alvarenga

Hadoop

Limits of Hadoop

(1+2)+(3+4)+(5+6)+(7+8)+(9+10) = 55
(1+10)+(3+8)+(5+6)+(7+4)+(9+2) = 55
(1+2)x(3+4)x(5+6)x(7+8)x(9+10) = 65,835
(1+10)x(3+8)x(5+6)x(7+4)x(9+2) = 161,051

How it works

  • A distributed file system, like Hadoop Distributed File System (HDFS)
  • A MapReduce Engine — something that can run the MapReduce algorithm — essentially a Java environment (place to run Java files)
  • Some sort of Tracking System, like YARN.

WTF is HDFS

WTF is MapReduce

WTF is YARN

Administration

Adding Nodes to the cluster

Add services to a Node

Remove Nodes

Check health and Disk Space

Configuration

Services/Components

“Why do I have to write a query in Java! It is overly complex for what I want to do!”

Apologies for how creepy they both are.

We are done

--

--

--

Focused on climate: treemeals.co ; time: everyhour.xyz for your life balance

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

How to Move the Windows 10 Taskbar in 4 Possible Locations

MIMYO Project FAQ

Debugging MediaWiki

How To Stand Up Zowe on z/OS in Minutes?

Quick Edits

Top magento2 website development company

Redis with Python

Your company life before and after accounting automation

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
ACGoff

ACGoff

Focused on climate: treemeals.co ; time: everyhour.xyz for your life balance

More from Medium

Stack Data Structure

Tree Data structure

Hadoop in 2 minutes

Weather Observation Station 6 Solution

01. One SQL A Day (15/06/22)