akhil's hadoop

Post on 15-Jan-2017

23 Views

Category:

Education

1 Downloads

Preview:

Click to see full reader

TRANSCRIPT

A NEW FILE SYSTEM TECHNOLOGY BASED ON

HADOOP

Presented byM.V.AKHIL PREM KUMAR

Appendix

1. Hadoop’s history

2. Architecture in detail

3. Hadoop in industry

4. Advantages

What is

HaDooP

Brief History of HadoopDesigned to answer the question:

“How to process big data with reasonable cost and time?”

Search engines in 1990s

1996

1996

1997

1996

Google search engines

1998

2013

Google Origins2003

2004

2006

Hadoop’s Developers

Doug Cutting

2005: Doug Cutting and  Michael J. Cafarella developed Hadoop to support distribution for the Nutch search engine project.

The project was funded by Yahoo.

2006: Yahoo gave the project to Apache Software Foundation.

Hadoop Framework Tools

Hadoop’s Architecture

HDFS ARCHITECTURE

Hadoop MapReduce

Hadoop in the Wild• Advertisement (Mining user behavior to generate

recommendations

• Hadoop is in use at most organizations that handle big data:

o Yahoo! o Facebooko Amazono Netflixo Etc…

Security (search for uncommon patterns)

Why use Hadoop?

Some Hadoop Milestones

CONCLUSION:•Distributed by the user all the world

•Efficently used for job tracker and task tracker in its map reduce engine

•Top level apache project

•Having more capabilites by adapting cloud computing too

QUERIES

Developer(s) Apache Software FoundationInitial release December 10, 2011; 3 years ago[1]

Stable release 2.7.1 / July 6, 2015[2]

Development status ActiveWritten in JavaOperating system Cross-platformType Distributed file systemLicense Apache License 2.0Website hadoop.apache.org

The name "Hadoop" was given by one of Doug Cutting's sons to that son's toy elephant. Doug used the name for his open source project because it was easy to pronounce and to Google. If you have 2 minutes, you can watch a video [1] with more details.

top related