Hive provides SQL-like query language on HDFS(Hadoop Distributed File System)

CK 3370 
Created at  
1,825 0 0

Hive defines a simple SQL-like query language, called QL, that enables users familiar with SQL to query the data. At the same time, this language also allows programmers who are familiar with the MapReduce framework to be able to plug in their custom mappers and reducers to perform more sophisticated analysis that may not be supported by the built-in capabilities of the language. QL can also be extended with custom scalar functions (UDF's), aggregations (UDAF's), and table functions (UDTF's).

Hive provides SQL-like query language on HDFS(Hadoop Distributed File System)

Hive Query Language provides following features

Basic SQL

  • From clause subquery
  • ANSI JOIN (euqi-joini only)
  • Multi-table Insert
  • Multi group-by
  • Sampling
  • Objects traversal

Extensibility

  • Pluggable MapReduce scripts in the language of your choice using TRANSFORM (Syntax changing soon!!)
  • Pluggable User Defined Functions
  • Pluggable User Defined Types
  • Pluggable SerDes to read different konds of Data Formats

 

See below example of Hive query language. Amaging thing is Hiveis compatible with standard SQL.

SELECT pageid, COUNT(DISTINCT userid)
FROM page_view GROUP BY pageid

It is almost the same as the usual RDB SQL. This is really great feature of Hive so programmers having experiences in RDB can implement software easily.

Hive does not mandate read or written data be in the "Hive format"---there is no such thing. Hive works equally well on Thrift, control delimited, or your specialized data formats. Please see File Format and SerDe in the Developer Guide for details.

Hive is not designed for OLTP workloads and does not offer real-time queries or row-level updates. It is best used for batch jobs over large sets of append-only data (like web logs). What Hive values most are scalability (scale out with more machines added dynamically to the Hadoop cluster), extensibility (with MapReduce framework and UDF/UDAF/UDTF), fault-tolerance, and loose-coupling with its input formats.

Hive provides SQL-like query language on HDFS(Hadoop Distributed File System)

Following is Data Model for Hive.

Hive provides SQL-like query language on HDFS(Hadoop Distributed File System)

References

https://cwiki.apache.org/confluence/display/Hive/Home

Hive ApacheCon 2008, New Oreleans, LA (Ashish Thusoo, Facebook)

Tags AWS Amazon Blob Chun Computers & Internet HBase Hadoop Mascot Java NoSQL TRANSFORM TaskTracker UDAF UDF UDTF Facebook X
Comments 0
Similar posts
  1. Apache HBase is a storage system, with roots in Hadoop, and uses HDFS for underlying storage.
    1,811
  2. HDFS(Hadoop Distributed File System) is designed to run on commodity hardware – Low cost hardware
    1,817
  3. Hadoop MapReduce is a software framework for processing vast amounts of data in-parallel on large clusters
    1,982
  4. Apache Hadoop is designed to scale up from single servers to thousands of machines
    1,778
  5. Web Cache function in Network Gateway could cause internet service trouble
    1,592
  6. Samsung Movies and TV Shows User Interface
    1,916
  7. FNC Batch Renames Digital Photos by Date
    1,782
  8. The Making of OpenAI: Birth, Battles, and Breakthroughs
    752
  1. Discovering OpenBugBounty: A Free Tool for Website Security Insights
    983
  2. Microsoft and Qualcomm Collaborate to Bring On-Device AI to Windows Devices
    2,136
  3. Flash Memory has lifetime, so you have to consider backup just in case
    3,511
  4. Samsung Movies and TV Shows User Interface
    1,916
  5. The way can see the picture on the received email in outlook
    2,969
  6. If you want to copy clipboard image on livewriter as local image, use Clipboard Capture or Clipboard Live – Live Writer Plug-in
    1,763
  7. With AWS cloud,we met our reliability and performance objectives at a fraction of the cost – Mr. Chun Kang – Pricipal Engineer, Samsung
    2,191
  8. Apache HBase is a storage system, with roots in Hadoop, and uses HDFS for underlying storage.
    1,811
  9. HDFS(Hadoop Distributed File System) is designed to run on commodity hardware – Low cost hardware
    1,817
  10. Hadoop MapReduce is a software framework for processing vast amounts of data in-parallel on large clusters
    1,982
  11. Apache Hadoop is designed to scale up from single servers to thousands of machines
    1,778
  12. Web Cache function in Network Gateway could cause internet service trouble
    1,592
  13. How to add groups to active resistered user in phpBB ?
    3,422
  14. The simplest and most reliable application or method for editing digital photo EXIF data
    1,746
  15. FNC Batch Renames Digital Photos by Date
    1,782
  16. Enhancing Online Privacy - Special Tools for Hiding Your IP Address
    2,057
  17. Anonymous Proxy Servers for hiding IP address
    1,963
  18. Online Gaming IP Ban Proxy Servers Internet Security Digital Identity
    2,074
  19. Simple Steps to Mask Your IP Address on Home Networks
    3,944
  20. Hiding Your IP Address Made Easy: Using HTTP Proxy Servers
    2,410
  21. Changing Your IP Address: Easy Methods for Privacy Protection
    2,367
Recently updated
  1. Good Company to Work For, but Pretty Pathetic once you Look Inside
    701
  2. Discovering OpenBugBounty: A Free Tool for Website Security Insights
    983
  3. Pre-Departure Google Workspace Personal Data Cleanup
    2,051
  4. The Harmful Effects of Squeezing Blemishes: Why You Should Avoid It
    1,744
  5. Finding Your Path to Clear Skin: The Best Way to Treat Acne
    1,989
  6. Choosing the Right Cosmetics and Cleansers for Acne-Prone Skin
    2,111
  7. Why Does Vietnamese Cable TV Have Almost No Ads? A Look at the Rules
    1,940
  8. In 2026, Advertising Is Converging on the TV Screen - 5 Opportunities OTT Operators Should Be Watching
    2,709
  9. Musk's Masterclass: Prioritizing, Delegating & Verifying
    625
  10. Life is Short: HubSpot Founder's Cliff-Edge Wisdom for Leaders
    2,734
  11. The Making of OpenAI: Birth, Battles, and Breakthroughs
    752
  12. Brazil's Digital & Demographic Deep Dive: Economy & Top Streaming Services
    1,032
  13. World Population Top 30 (2016-2025)
    865
  14. SouthEast Asia Advertising Market - Comprehensive Analysis by Country, Company, Platform & Revenue
    1,282
  15. Comprehensive Report on Portugal: Demographics, Digital Usage, and Top Streaming Companies
    716
  16. Mongolia Unpacked: Demographics, Digital Economy, and Leading Streaming Services
    1,191
  17. Italy: A Comprehensive Guide to Demographics, Digital Trends, and Its Top 10 Video Streaming Companies
    712
  18. Spain: Demographics, Digital Usage, Economic Insights & Top 10 Streaming Services
    1,092
  19. France's Digital Economy: Demographics, Trends, and Streaming Leaders
    645
  20. Germany's Digital Deep Dive: Demographics, Internet Usage, Market Trends, and Top 10 Video Streaming Powerhouses
    675
  21. United Kingdom: Demographics, Digital Life, and Streaming's Top 10 Players
    630
  22. Russia's Digital Blueprint: Economy, Demographics, and Streaming Landscape
    793
  23. Singapore's Top 10 Video Streaming Companies
    701
  24. Canada's Digital Pulse: Demographics, Connectivity & Top 10 Streaming Services Unveiled
    648
  25. Korea's Streaming Story: Top 10 Platforms in a Digital Nation
    1,488
  26. Malaysia's Top 10 Video Streaming Companies 2026
    1,110
  27. Indonesia's Top 10 Video Streaming Companies
    1,075
  28. Japan's Top 10 Video Streaming Companies
    707
  29. United States's Top 10 Video Streaming Companies
    558
  30. The Evolving Role of Engineering Organizations in the AI Era
    2,413
  31. exif_filename - a Powerful Command-Line Tool Designed for Automatically Renaming Image Files based on EXIF metadata
    616
  32. The Correlation between Income Level and Television Viewing Time
    1,715
  33. Problem-Solving Narratives in Startup Programs
    633
  34. Vietnamese Top 10 Video Streaming Companies 2026
    1,520
  35. Thailand's Top 10 Video Streaming Companies 2026
    1,456
  36. Phillippine's Top 10 Video Streaming Companies 2026
    1,160
  37. Business Structure Comparison: Sole Proprietorship vs S-Corporation
    6881
  38. Affordable Payroll Solutions for Family-Based Businesses in the US
    679
  39. Vietnam Television (aka VTV)
    852
  40. Do we know what causes endometrial cancer?
    1,632
  41. What should you ask your physician about endometrial cancer?
    2,029
  42. How is cancer of the cervix treated?
    2,075
  43. Navigating Startup Funding Rounds: Expectations and Investment Sizes
    2,046
  44. What is hot water steam cleaning and aren't all steam cleaners the same?
    1,889
  45. To Pad or Not to Pad: The Lowdown on Carpet Padding
    1,973
  46. Decoding the Pelvic Exam: A Comprehensive Women's Health Assessment
    1,656
  47. How do they put people to sleep for an oral surgery?
    3,441
  48. Unveiling the Link: Helicobacter pylori Infection and the Risk of Stomach Cancer
    1,571