Hadooping: MapReduce and YARN

*MapReduce can save the day.

MapReduce v1

A day in the life

Credit: Kayla Farmer
Credit: Edgar Chapparo. Note: Each location as a workers office — not the main warehouse.

Factory Faults

Writing MapReduce instructions

hdfs dfs -put ~/theDataFilesName.dat sampledata
hdfs dfs -cat sampledata/SumnerCountyTemp.dat | more
hdfs dfs -rm -R sampledata/locationOfResults

Problems with MapReduce v1 and Hadoop v1

YARN

YARN in all its glory. Source: HDFS Tutorial

--

--

--

Focused on saving our time: everyhour.xyz for your life balance; tree-meals-a-day.earth for our food emissions and compairbnb.info/hello for booking airbnbs.

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Integrating an HTTPS interface in hospitals using Mirth Connect communication server

Sink data from Kafka to ElasticSearch

Jira Expression of the Week — Separation of Concerns

Adding a Jira Expression as a Workflow Condition

Events and Logging in Solidity

My Software Career at FiveYears

How programmers get disqualified from doing everything else

What Factors Affect The Liquid Filling Machine?

[Write-up] [TAMUctf — 2018] Miscellaneous (All challenges)

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
ACGoff

ACGoff

Focused on saving our time: everyhour.xyz for your life balance; tree-meals-a-day.earth for our food emissions and compairbnb.info/hello for booking airbnbs.

More from Medium

How to deal with a cyclic foreign key constraint using PostgreSQL?

Oracle RMAN Compression

SQL and database for newbie by newbie.

Database Normalization