Hive provides SQL-like query language on HDFS(Hadoop Distributed File System)

CK3366 
Created at  

  1,734   0   0  

Hive defines a simple SQL-like query language, called QL, that enables users familiar with SQL to query the data. At the same time, this language also allows programmers who are familiar with the MapReduce framework to be able to plug in their custom mappers and reducers to perform more sophisticated analysis that may not be supported by the built-in capabilities of the language. QL can also be extended with custom scalar functions (UDF's), aggregations (UDAF's), and table functions (UDTF's).

Hive provides SQL-like query language on HDFS(Hadoop Distributed File System)

Hive Query Language provides following features

Basic SQL

  • From clause subquery
  • ANSI JOIN (euqi-joini only)
  • Multi-table Insert
  • Multi group-by
  • Sampling
  • Objects traversal

Extensibility

  • Pluggable MapReduce scripts in the language of your choice using TRANSFORM (Syntax changing soon!!)
  • Pluggable User Defined Functions
  • Pluggable User Defined Types
  • Pluggable SerDes to read different konds of Data Formats

 

See below example of Hive query language. Amaging thing is Hiveis compatible with standard SQL.

SELECT pageid, COUNT(DISTINCT userid)
FROM page_view GROUP BY pageid

It is almost the same as the usual RDB SQL. This is really great feature of Hive so programmers having experiences in RDB can implement software easily.

Hive does not mandate read or written data be in the "Hive format"---there is no such thing. Hive works equally well on Thrift, control delimited, or your specialized data formats. Please see File Format and SerDe in the Developer Guide for details.

Hive is not designed for OLTP workloads and does not offer real-time queries or row-level updates. It is best used for batch jobs over large sets of append-only data (like web logs). What Hive values most are scalability (scale out with more machines added dynamically to the Hadoop cluster), extensibility (with MapReduce framework and UDF/UDAF/UDTF), fault-tolerance, and loose-coupling with its input formats.

Hive provides SQL-like query language on HDFS(Hadoop Distributed File System)

Following is Data Model for Hive.

Hive provides SQL-like query language on HDFS(Hadoop Distributed File System)

References

https://cwiki.apache.org/confluence/display/Hive/Home

Hive ApacheCon 2008, New Oreleans, LA (Ashish Thusoo, Facebook)



Tags: AWS Amazon Blob Chun Computers & Internet HBase Hadoop Mascot Java NoSQL TRANSFORM TaskTracker UDAF UDF UDTF Share on Facebook Share on X

◀ PREVIOUS
Apache HBase is a storage system, with roots in Hadoop, and uses HDFS for underlying storage.

▶ NEXT
With AWS cloud,we met our reliability and performance objectives at a fraction of the cost – Mr. Chun Kang – Pricipal Engineer, Samsung

  Comments 0
SIMILAR POSTS

Apache HBase is a storage system, with roots in Hadoop, and uses HDFS for underlying storage.

(created at )

HDFS(Hadoop Distributed File System) is designed to run on commodity hardware – Low cost hardware

(created at )

Hadoop MapReduce is a software framework for processing vast amounts of data in-parallel on large clusters

(created at )

Apache Hadoop is designed to scale up from single servers to thousands of machines

(created at )

Web Cache function in Network Gateway could cause internet service trouble

(created at )

Samsung Movies and TV Shows User Interface

(created at )

FNC Batch Renames Digital Photos by Date

(created at )

The Making of OpenAI: Birth, Battles, and Breakthroughs

(updated at )

OTHER POSTS IN THE SAME CATEGORY

Microsoft and Qualcomm Collaborate to Bring On-Device AI to Windows Devices

(updated at )

Flash Memory has lifetime, so you have to consider backup just in case

(updated at )

Samsung Movies and TV Shows User Interface

(created at )

The way can see the picture on the received email in outlook

(updated at )

If you want to copy clipboard image on livewriter as local image, use Clipboard Capture or Clipboard Live – Live Writer Plug-in

(updated at )

With AWS cloud,we met our reliability and performance objectives at a fraction of the cost – Mr. Chun Kang – Pricipal Engineer, Samsung

(updated at )

Apache HBase is a storage system, with roots in Hadoop, and uses HDFS for underlying storage.

(created at )

HDFS(Hadoop Distributed File System) is designed to run on commodity hardware – Low cost hardware

(created at )

Hadoop MapReduce is a software framework for processing vast amounts of data in-parallel on large clusters

(created at )

Apache Hadoop is designed to scale up from single servers to thousands of machines

(created at )

Web Cache function in Network Gateway could cause internet service trouble

(created at )

How to add groups to active resistered user in phpBB ?

(updated at )

The simplest and most reliable application or method for editing digital photo EXIF data

(created at )

FNC Batch Renames Digital Photos by Date

(created at )

Enhancing Online Privacy - Special Tools for Hiding Your IP Address

(updated at )

Anonymous Proxy Servers for hiding IP address

(updated at )

Online Gaming IP Ban Proxy Servers Internet Security Digital Identity

(updated at )

Simple Steps to Mask Your IP Address on Home Networks

(updated at )

Hiding Your IP Address Made Easy: Using HTTP Proxy Servers

(updated at )

Changing Your IP Address: Easy Methods for Privacy Protection

(updated at )

UPDATES

The Harmful Effects of Squeezing Blemishes: Why You Should Avoid It

(updated at )

Finding Your Path to Clear Skin: The Best Way to Treat Acne

(updated at )

Choosing the Right Cosmetics and Cleansers for Acne-Prone Skin

(updated at )

Why Does Vietnamese Cable TV Have Almost No Ads? A Look at the Rules

(created at )

In 2026, Advertising Is Converging on the TV Screen - 5 Opportunities OTT Operators Should Be Watching

(updated at )

Musk's Masterclass: Prioritizing, Delegating & Verifying

(created at )

Life is Short: HubSpot Founder's Cliff-Edge Wisdom for Leaders

(updated at )

The Making of OpenAI: Birth, Battles, and Breakthroughs

(updated at )

Brazil's Digital & Demographic Deep Dive: Economy & Top Streaming Services

(updated at )

World Population Top 30 (2016-2025)

(created at )

SouthEast Asia Advertising Market - Comprehensive Analysis by Country, Company, Platform & Revenue

(created at )

Comprehensive Report on Portugal: Demographics, Digital Usage, and Top Streaming Companies

(updated at )

Mongolia Unpacked: Demographics, Digital Economy, and Leading Streaming Services

(updated at )

Italy: A Comprehensive Guide to Demographics, Digital Trends, and Its Top 10 Video Streaming Companies

(updated at )

Spain: Demographics, Digital Usage, Economic Insights & Top 10 Streaming Services

(updated at )

France's Digital Economy: Demographics, Trends, and Streaming Leaders

(updated at )

Germany's Digital Deep Dive: Demographics, Internet Usage, Market Trends, and Top 10 Video Streaming Powerhouses

(updated at )

United Kingdom: Demographics, Digital Life, and Streaming's Top 10 Players

(updated at )

Russia's Digital Blueprint: Economy, Demographics, and Streaming Landscape

(updated at )

Singapore's Top 10 Video Streaming Companies

(updated at )

Canada's Digital Pulse: Demographics, Connectivity & Top 10 Streaming Services Unveiled

(created at )

Korea's Streaming Story: Top 10 Platforms in a Digital Nation

(updated at )

Malaysia's Top 10 Video Streaming Companies 2026

(updated at )

Indonesia's Top 10 Video Streaming Companies

(updated at )

Japan's Top 10 Video Streaming Companies

(updated at )

United States's Top 10 Video Streaming Companies

(updated at )

The Evolving Role of Engineering Organizations in the AI Era

(created at )

exif_filename - a Powerful Command-Line Tool Designed for Automatically Renaming Image Files based on EXIF metadata

(updated at )

The Correlation between Income Level and Television Viewing Time

(updated at )

Problem-Solving Narratives in Startup Programs

(created at )

Vietnamese Top 10 Video Streaming Companies 2026

(updated at )

Thailand's Top 10 Video Streaming Companies 2026

(updated at )

Phillippine's Top 10 Video Streaming Companies 2026

(updated at )

Business Structure Comparison: Sole Proprietorship vs S-Corporation

(updated at )

Affordable Payroll Solutions for Family-Based Businesses in the US

(updated at )

Vietnam Television (aka VTV)

(updated at )

Pre-Departure Google Workspace Personal Data Cleanup

(created at )

Do we know what causes endometrial cancer?

(updated at )

What should you ask your physician about endometrial cancer?

(updated at )

How is cancer of the cervix treated?

(updated at )

Navigating Startup Funding Rounds: Expectations and Investment Sizes

(updated at )

What is hot water steam cleaning and aren't all steam cleaners the same?

(updated at )

To Pad or Not to Pad: The Lowdown on Carpet Padding

(updated at )

Decoding the Pelvic Exam: A Comprehensive Women's Health Assessment

(updated at )

How do they put people to sleep for an oral surgery?

(updated at )

Unveiling the Link: Helicobacter pylori Infection and the Risk of Stomach Cancer

(updated at )

Steve Jobs' Battle with Pancreatic Cancer and His Unconventional Dietary Choices

(updated at )

Surgery for Colorectal Cancer

(updated at )