HDFS(Hadoop Distributed File System) is designed to run on commodity hardware – Low cost hardware
CK300 
Created at Feb 28, 2012 10:06:03 
 179   0   0   0  

The Hadoop Distributed File System (HDFS) is a distributed file system designed to run on commodity hardware. It has many similarities with existing distributed file systems. However, the differences from other distributed file systems are significant.

HDFS(Hadoop Distributed File System) is designed to run on commodity hardware – Low cost hardware

HDFS is highly fault-tolerant and is designed to be deployed on low-cost hardware.

HDFS provides high throughput access to application data and is suitable for applications that have large data sets. HDFS relaxes a few POSIX requirements to enable streaming access to file system data.

HDFS was originally built as infrastructure for the Apache Nutch web search engine project. HDFS is now an Apache Hadoop subproject. The project URL is http://hadoop.apache.org/hdfs/.

HDFS(Hadoop Distributed File System) is designed to run on commodity hardware – Low cost hardware

The goal of HDFS

  • Hardware failure is the norm rather than the exception.
  • Streaming Data Access
  • Large Data Sets
  • Simple Coherency Model
  • Moving Computation is Cheaper than Moving Data
  • Portability Across Heterogeneous Hardware and Software Platforms

 

Data Replication

HDFS is designed to reliably store very large files across machines in a large cluster.

HDFS(Hadoop Distributed File System) is designed to run on commodity hardware – Low cost hardware

MapReduce Software Framework

Offers clean abstraction between data analysis tasks and the underlying systems challenges involved in ensuring reliable large-scale computation.

HDFS(Hadoop Distributed File System) is designed to run on commodity hardware – Low cost hardware

- Processes large jobs in parallel across many nodes and combines results.
- Eliminates the bottlenecks imposed by monolithic storage systems.
- Results are collated and digested into a single output after each piece has been analyzed.

 

References

http://hadoop.apache.org/common/docs/current/hdfs_design.html

http://www.cloudera.com/what-is-hadoop/hadoop-overview/

http://www.infoq.com/articles/data-mine-cloud-hadoop



Tags: Blob Computers & Internet HBase Hadoop Mascot Java NoSQL TaskTracker Share on Facebook Share on X
◀ PREVIOUS
Hadoop MapReduce is a software framework for processing vast amounts of data in-parallel on large clusters		 ▶ NEXT
Apache HBase is a storage system, with roots in Hadoop, and uses HDFS for underlying storage.
  Comments 0
Login for comment
SIMILAR POSTS

Hadoop MapReduce is a software framework for processing vast amounts of data in-parallel on large clusters (created at Feb 28, 2012)

Apache Hadoop is designed to scale up from single servers to thousands of machines (created at Feb 28, 2012)

Apache HBase is a storage system, with roots in Hadoop, and uses HDFS for underlying storage. (created at Mar 01, 2012)

Hive provides SQL-like query language on HDFS(Hadoop Distributed File System) (created at Mar 14, 2012)

If you want to copy clipboard image on livewriter as local image, use Clipboard Capture or Clipboard Live – Live Writer Plug-in (created at Jul 25, 2012)

Web Cache function in Network Gateway could cause internet service trouble (created at Oct 15, 2010)

Samsung Movies and TV Shows User Interface (created at Aug 13, 2014)

FNC Batch Renames Digital Photos by Date (created at Aug 21, 2009)

OTHER POSTS IN THE SAME CATEGORY

Flash Memory has lifetime, so you have to consider backup just in case (updated at Apr 27, 2024)

Samsung Movies and TV Shows User Interface (created at Aug 13, 2014)

The way can see the picture on the received email in outlook (updated at Apr 27, 2024)

If you want to copy clipboard image on livewriter as local image, use Clipboard Capture or Clipboard Live – Live Writer Plug-in (created at Jul 25, 2012)

With AWS cloud,we met our reliability and performance objectives at a fraction of the cost – Mr. Chun Kang – Pricipal Engineer, Samsung (updated at Apr 27, 2024)

Hive provides SQL-like query language on HDFS(Hadoop Distributed File System) (created at Mar 14, 2012)

Apache HBase is a storage system, with roots in Hadoop, and uses HDFS for underlying storage. (created at Mar 01, 2012)

Hadoop MapReduce is a software framework for processing vast amounts of data in-parallel on large clusters (created at Feb 28, 2012)

Apache Hadoop is designed to scale up from single servers to thousands of machines (created at Feb 28, 2012)

Table of International Country Code, Time Zones, And Dialing prefix lookup (updated at Apr 27, 2024)

Web Cache function in Network Gateway could cause internet service trouble (created at Oct 15, 2010)

How to add groups to active resistered user in phpBB ? (updated at Apr 27, 2024)

The simplest and most reliable application or method for editing digital photo EXIF data (created at Aug 25, 2009)

FNC Batch Renames Digital Photos by Date (created at Aug 21, 2009)

Enhancing Online Privacy: Special Tools for Hiding Your IP Address (updated at Apr 27, 2024)

Anonymous Proxy Servers for hiding IP address (updated at Apr 27, 2024)

Online Gaming IP Ban Proxy Servers Internet Security Digital Identity (updated at Apr 27, 2024)

Simple Steps to Mask Your IP Address on Home Networks (updated at Apr 27, 2024)

Hiding Your IP Address Made Easy: Using HTTP Proxy Servers (updated at Apr 27, 2024)

Changing Your IP Address: Easy Methods for Privacy Protection (updated at Apr 27, 2024)

UPDATES

Table of International Country Code, Time Zones, And Dialing prefix lookup (updated at Apr 27, 2024)

Enhancing Online Privacy: Special Tools for Hiding Your IP Address (updated at Apr 27, 2024)

Changing Your IP Address: Easy Methods for Privacy Protection (updated at Apr 27, 2024)

Hiding Your IP Address Made Easy: Using HTTP Proxy Servers (updated at Apr 27, 2024)

Simple Steps to Mask Your IP Address on Home Networks (updated at Apr 27, 2024)

Online Gaming IP Ban Proxy Servers Internet Security Digital Identity (updated at Apr 27, 2024)

The history of the excimer laser (updated at Apr 27, 2024)

Anonymous Proxy Servers for hiding IP address (updated at Apr 27, 2024)

How to add groups to active resistered user in phpBB ? (updated at Apr 27, 2024)

With AWS cloud,we met our reliability and performance objectives at a fraction of the cost – Mr. Chun Kang – Pricipal Engineer, Samsung (updated at Apr 27, 2024)

Flash Memory has lifetime, so you have to consider backup just in case (updated at Apr 27, 2024)

The way can see the picture on the received email in outlook (updated at Apr 27, 2024)

How do you choose a color scheme? (updated at Apr 27, 2024)

Curtain quality (updated at Apr 27, 2024)

What is the best material for shower curtains? (updated at Apr 27, 2024)

How often should I change my shower curtains? (updated at Apr 27, 2024)

The Art of Sweet Talk: How to Flatter with Words and Navigate Its Nuances (updated at Apr 20, 2024)

Unraveling the Mystery: Bones in the Words (updated at Apr 20, 2024)

Crafting the Right Reasons for Leaving Your Job in Your Resume (updated at Apr 17, 2024)

Navigating Employee Performance Evaluations with a Positive Approach (updated at Apr 17, 2024)

Evaluating Intangible Traits in Employee Performance Reviews (updated at Apr 17, 2024)

The example Turning a Negative into a Positive (updated at Apr 17, 2024)

Unveiling Heroic Legacies: Joan of Arc and Zandark (created at Mar 09, 2024)

Unveiling the Epic Saga: France's Hundred Years' War (created at Mar 09, 2024)

Zandark: The Forgotten Heroine of France (updated at Mar 08, 2024)

How to Work Smarter not Harder (updated at Mar 03, 2024)

Creative Ways to Gift Concert Tickets When You Haven't Received Them Yet (updated at Mar 03, 2024)

How to write the Romantic Love Letter ? (updated at Mar 03, 2024)

Should I Give Out Financial Information to People I Don't Know? (updated at Mar 03, 2024)

Decoding the Diagnosis: How Doctors Detect Pancreatic Cancer (updated at Mar 02, 2024)