Hive provides SQL-like query language on HDFS(Hadoop Distributed File System)

CK404 
Created at Mar 14, 2012 12:27:17 
  320   0   0  

Hive defines a simple SQL-like query language, called QL, that enables users familiar with SQL to query the data. At the same time, this language also allows programmers who are familiar with the MapReduce framework to be able to plug in their custom mappers and reducers to perform more sophisticated analysis that may not be supported by the built-in capabilities of the language. QL can also be extended with custom scalar functions (UDF's), aggregations (UDAF's), and table functions (UDTF's).

Hive provides SQL-like query language on HDFS(Hadoop Distributed File System)

Hive Query Language provides following features

Basic SQL

  • From clause subquery
  • ANSI JOIN (euqi-joini only)
  • Multi-table Insert
  • Multi group-by
  • Sampling
  • Objects traversal

Extensibility

  • Pluggable MapReduce scripts in the language of your choice using TRANSFORM (Syntax changing soon!!)
  • Pluggable User Defined Functions
  • Pluggable User Defined Types
  • Pluggable SerDes to read different konds of Data Formats

 

See below example of Hive query language. Amaging thing is Hiveis compatible with standard SQL.

SELECT pageid, COUNT(DISTINCT userid)
FROM page_view GROUP BY pageid

It is almost the same as the usual RDB SQL. This is really great feature of Hive so programmers having experiences in RDB can implement software easily.

Hive does not mandate read or written data be in the "Hive format"---there is no such thing. Hive works equally well on Thrift, control delimited, or your specialized data formats. Please see File Format and SerDe in the Developer Guide for details.

Hive is not designed for OLTP workloads and does not offer real-time queries or row-level updates. It is best used for batch jobs over large sets of append-only data (like web logs). What Hive values most are scalability (scale out with more machines added dynamically to the Hadoop cluster), extensibility (with MapReduce framework and UDF/UDAF/UDTF), fault-tolerance, and loose-coupling with its input formats.

Hive provides SQL-like query language on HDFS(Hadoop Distributed File System)

Following is Data Model for Hive.

Hive provides SQL-like query language on HDFS(Hadoop Distributed File System)

References

https://cwiki.apache.org/confluence/display/Hive/Home

Hive ApacheCon 2008, New Oreleans, LA (Ashish Thusoo, Facebook)



Tags: AWS Amazon Blob Chun Computers & Internet HBase Hadoop Mascot Java NoSQL TRANSFORM TaskTracker UDAF UDF UDTF Share on Facebook Share on X

◀ PREVIOUS
Apache HBase is a storage system, with roots in Hadoop, and uses HDFS for underlying storage.

▶ NEXT
With AWS cloud,we met our reliability and performance objectives at a fraction of the cost – Mr. Chun Kang – Pricipal Engineer, Samsung

  Comments 0
SIMILAR POSTS

Apache HBase is a storage system, with roots in Hadoop, and uses HDFS for underlying storage.

(created at Mar 01, 2012)

HDFS(Hadoop Distributed File System) is designed to run on commodity hardware – Low cost hardware

(created at Feb 28, 2012)

Hadoop MapReduce is a software framework for processing vast amounts of data in-parallel on large clusters

(created at Feb 28, 2012)

Apache Hadoop is designed to scale up from single servers to thousands of machines

(created at Feb 28, 2012)

If you want to copy clipboard image on livewriter as local image, use Clipboard Capture or Clipboard Live – Live Writer Plug-in

(created at Jul 25, 2012)

Web Cache function in Network Gateway could cause internet service trouble

(created at Oct 15, 2010)

Samsung Movies and TV Shows User Interface

(created at Aug 13, 2014)

FNC Batch Renames Digital Photos by Date

(created at Aug 21, 2009)

OTHER POSTS IN THE SAME CATEGORY

Microsoft and Qualcomm Collaborate to Bring On-Device AI to Windows Devices

(updated at May 22, 2024)

Flash Memory has lifetime, so you have to consider backup just in case

(updated at Apr 27, 2024)

Samsung Movies and TV Shows User Interface

(created at Aug 13, 2014)

The way can see the picture on the received email in outlook

(updated at Apr 27, 2024)

If you want to copy clipboard image on livewriter as local image, use Clipboard Capture or Clipboard Live – Live Writer Plug-in

(created at Jul 25, 2012)

With AWS cloud,we met our reliability and performance objectives at a fraction of the cost – Mr. Chun Kang – Pricipal Engineer, Samsung

(updated at Apr 27, 2024)

Apache HBase is a storage system, with roots in Hadoop, and uses HDFS for underlying storage.

(created at Mar 01, 2012)

HDFS(Hadoop Distributed File System) is designed to run on commodity hardware – Low cost hardware

(created at Feb 28, 2012)

Hadoop MapReduce is a software framework for processing vast amounts of data in-parallel on large clusters

(created at Feb 28, 2012)

Apache Hadoop is designed to scale up from single servers to thousands of machines

(created at Feb 28, 2012)

Web Cache function in Network Gateway could cause internet service trouble

(created at Oct 15, 2010)

How to add groups to active resistered user in phpBB ?

(updated at Apr 27, 2024)

The simplest and most reliable application or method for editing digital photo EXIF data

(created at Aug 25, 2009)

FNC Batch Renames Digital Photos by Date

(created at Aug 21, 2009)

Enhancing Online Privacy - Special Tools for Hiding Your IP Address

(updated at Apr 28, 2024)

Anonymous Proxy Servers for hiding IP address

(updated at Apr 27, 2024)

Online Gaming IP Ban Proxy Servers Internet Security Digital Identity

(updated at Apr 27, 2024)

Simple Steps to Mask Your IP Address on Home Networks

(updated at Apr 27, 2024)

Hiding Your IP Address Made Easy: Using HTTP Proxy Servers

(updated at Apr 27, 2024)

Changing Your IP Address: Easy Methods for Privacy Protection

(updated at Apr 27, 2024)

UPDATES

REPORTBANK migration from Wordpress

(updated at Aug 13, 2024)

Why Maintenance is never ending in the Interenet-based Service?

(created at Jun 28, 2024)

Employer Requirements under California Labor Code Section 6401.9

(created at Jun 26, 2024)

Adding a Personal Touch - Embed Your Copyright into Your Nikon’s EXIF Data

(updated at May 31, 2024)

Microsoft and Qualcomm Collaborate to Bring On-Device AI to Windows Devices

(updated at May 22, 2024)

Crafting the Right Reasons for Leaving Your Job in Your Resume

(updated at May 16, 2024)

12 Proven Strategies to Work Smarter, Not Harder

(updated at May 16, 2024)

Evaluating Intangible Traits in Employee Performance Reviews

(updated at May 16, 2024)

The Example Turning a Negative into a Positive - How to Make Criticism Count?

(updated at May 16, 2024)

What is Sexual Harassment? It's Never Okay!

(updated at May 16, 2024)

The AI Revolution of 2024: Gemini vs. ChatGPT-4o

(updated at May 16, 2024)

To keep my mascara from rubbing off underneath my eyes throughout the day

(updated at May 15, 2024)

Understanding Cataracts

(updated at May 15, 2024)

Can cataract surgery be done with laser?

(updated at May 15, 2024)

About ReportBank

(updated at May 15, 2024)

Navigating the Realm of Copyright: Safeguarding Creativity in the Digital Age

(updated at May 15, 2024)

How to Tackle Post-Meal Sleepiness: Understanding Blood Sugar Spikes

(updated at May 13, 2024)

What is an Optician?

(updated at May 08, 2024)

Understanding the Link: Cirrhosis and Liver Cancer Risk

(updated at Apr 29, 2024)

Choosing Between Glucosamine and Chondroitin: Which Is Better for Joint Health?

(created at Apr 29, 2024)

Enhancing Online Privacy - Special Tools for Hiding Your IP Address

(updated at Apr 28, 2024)

How to Flatter with Words and Navigate Its Nuances

(updated at Apr 28, 2024)

Joan of Arc and Zandark

(updated at Apr 28, 2024)

France's Hundred Years' War

(updated at Apr 28, 2024)

Changing Your IP Address: Easy Methods for Privacy Protection

(updated at Apr 27, 2024)

Hiding Your IP Address Made Easy: Using HTTP Proxy Servers

(updated at Apr 27, 2024)

Simple Steps to Mask Your IP Address on Home Networks

(updated at Apr 27, 2024)

Online Gaming IP Ban Proxy Servers Internet Security Digital Identity

(updated at Apr 27, 2024)

The history of the excimer laser

(updated at Apr 27, 2024)

Anonymous Proxy Servers for hiding IP address

(updated at Apr 27, 2024)