HCatalog Create View and Index
Apache HCatalog is a table management layer that exposes Hive metadata to other Hadoop applications. HCatalog's table abstraction presents users with a relational view of data in the Hadoop Distributed File System (HDFS) and ensures that users need not worry about where or in what format their data is stored. HCatalog displays data from RCFile format, text files, or sequence files in a tabular view. It also provides REST APIs so that external systems can access these table's metadata.
HCatalog is built on top of the Hive metastore and incorporates components from the Hive DDL. HCatalog provides read and write interfaces for Pig and MapReduce and uses Hive's command line interface for issuing data definition and metadata exploration commands. It also presents a REST interface to allow external tools access to Hive DDL (Data Definition Language) operations, such as "create table" and "describe table".
1) A machine with Ubuntu 14.04 LTS operating system installed.
2) Apache Hive 2.1.0 Pre Installed (How to Install Hive on Ubuntu 14.04)
3) Apache HCatalog merged with Hive (in March of 2013) HCatalog is now released as part of Hive. Here we are using latest version of HCatalog merged with Hive. (How to Install Hcatalog on Ubuntu 14.04)
Creating View and Indexes
This post describes how to create, manage a view and indexes in HCatalog. Database views are created using the CREATE VIEW statement. Views can be created from a single table, multiple tables, or another view. To create a view, a user must have appropriate system privileges according to the specific implementation.
Step 1 - Open a new terminal (CTRL + ALT + T) and Change the directory to /usr/local/hive/hcatalog/bin
Step 2 - Creating a new employee table
Step 3 - Check whether it is created or not. It shows all the tables that are present.
Step 4 - Create a new sample.txt file to load into employee table.
Add the following lines to sample.txt save and close.
Step 5 - Execute the load operation. In my case the sample.txt file is saved in /home/hduser/Desktop/HCATALOG/ folder.
Step 6 - Create View
Step 7 - Drop View
An Index is nothing but a pointer on a particular column of a table. Creating an index means creating a pointer on a particular column of a table.
Step 8 - Create Index
Step 10 - Drop Index
Please share this blog post and follow me for latest updates on
Previous Post Next Post