暂无图片
暂无图片
暂无图片
暂无图片
暂无图片

实战系列:最新版本Hive-3.1.2源码编译

大数据从业者 2021-04-17
3366

前言

继之前完成最新版本的HadoopFlinkKafka编译安装部署实战(详细参看之前的发文)之后,本文笔者编译安装最新版本的Hive-3.1.2

PS:之所以搞这些组件的源码编译,是因为笔者在实际工作中接触使用太频繁了。


环境准备

    root@felixzh:/opt/sourceCode# java -version
    java version "1.8.0_221"
    Java(TM) SE Runtime Environment (build 1.8.0_221-b11)
    Java HotSpot(TM) 64-Bit Server VM (build 25.221-b11, mixed mode)
    root@felixzh:/opt/sourceCode# mvn -version
    Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-18T02:33:14+08:00)
    Maven home: /opt/pkg/mvn
    Java version: 1.8.0_221, vendor: Oracle Corporation, runtime: /opt/pkg/jdk1.8.0_221/jre
    Default locale: en_US, platform encoding: UTF-8
    OS name: "linux", version: "4.4.0-31-generic", arch: "amd64", family: "unix"


    源码下载

      root@felixzh:/opt/sourceCode# wget https://github.com/apache/hive/archive/rel/release-3.1.2.tar.gz


      源码解压

        root@felixzh:/opt/sourceCode# tar -zxvf release-3.1.2.tar.gz


        源码编译

        参考文档:https://cwiki.apache.org/confluence/display/Hive/GettingStarted

          root@felixzh:/opt/sourceCode# cd hive-rel-release-3.1.2/
          root@felixzh:/opt/sourceCode/hive-rel-release-3.1.2# mvn clean package -Pdist [-DskipTests -Dmaven.javadoc.skip=true]


          编译结果(大约持续11分钟)

            [INFO] Reactor Summary:
            [INFO]
            [INFO] Hive Upgrade Acid .................................. SUCCESS [ 11.873 s]
            [INFO] Hive 3.1.2 ......................................... SUCCESS [ 0.423 s]
            [INFO] Hive Classifications ............................... SUCCESS [ 0.842 s]
            [INFO] Hive Shims Common .................................. SUCCESS [ 8.274 s]
            [INFO] Hive Shims 0.23 .................................... SUCCESS [ 12.497 s]
            [INFO] Hive Shims Scheduler ............................... SUCCESS [ 4.304 s]
            [INFO] Hive Shims ......................................... SUCCESS [ 3.206 s]
            [INFO] Hive Common ........................................ SUCCESS [ 10.387 s]
            [INFO] Hive Service RPC ................................... SUCCESS [ 4.283 s]
            [INFO] Hive Serde ......................................... SUCCESS [ 8.959 s]
            [INFO] Hive Standalone Metastore .......................... SUCCESS [ 56.684 s]
            [INFO] Hive Metastore ..................................... SUCCESS [ 5.596 s]
            [INFO] Hive Vector-Code-Gen Utilities ..................... SUCCESS [ 0.403 s]
            [INFO] Hive Llap Common ................................... SUCCESS [ 4.841 s]
            [INFO] Hive Llap Client ................................... SUCCESS [ 4.132 s]
            [INFO] Hive Llap Tez ...................................... SUCCESS [ 6.240 s]
            [INFO] Hive Spark Remote Client ........................... SUCCESS [ 9.865 s]
            [INFO] Hive Query Language ................................ SUCCESS [01:32 min]
            [INFO] Hive Llap Server ................................... SUCCESS [02:02 min]
            [INFO] Hive Service ....................................... SUCCESS [ 12.864 s]
            [INFO] Hive Accumulo Handler .............................. SUCCESS [ 13.881 s]
            [INFO] Hive JDBC .......................................... SUCCESS [ 49.315 s]
            [INFO] Hive Beeline ....................................... SUCCESS [ 8.842 s]
            [INFO] Hive CLI ........................................... SUCCESS [ 5.013 s]
            [INFO] Hive Contrib ....................................... SUCCESS [ 2.793 s]
            [INFO] Hive Druid Handler ................................. SUCCESS [ 37.706 s]
            [INFO] Hive HBase Handler ................................. SUCCESS [ 8.411 s]
            [INFO] Hive JDBC Handler .................................. SUCCESS [ 2.955 s]
            [INFO] Hive HCatalog ...................................... SUCCESS [ 1.126 s]
            [INFO] Hive HCatalog Core ................................. SUCCESS [ 8.452 s]
            [INFO] Hive HCatalog Pig Adapter .......................... SUCCESS [ 5.347 s]
            [INFO] Hive HCatalog Server Extensions .................... SUCCESS [ 6.144 s]
            [INFO] Hive HCatalog Webhcat Java Client .................. SUCCESS [ 5.348 s]
            [INFO] Hive HCatalog Webhcat .............................. SUCCESS [ 17.953 s]
            [INFO] Hive HCatalog Streaming ............................ SUCCESS [ 7.195 s]
            [INFO] Hive HPL/SQL ....................................... SUCCESS [ 6.318 s]
            [INFO] Hive Streaming ..................................... SUCCESS [ 4.543 s]
            [INFO] Hive Llap External Client .......................... SUCCESS [ 5.212 s]
            [INFO] Hive Shims Aggregator .............................. SUCCESS [ 0.105 s]
            [INFO] Hive Kryo Registrator .............................. SUCCESS [ 4.622 s]
            [INFO] Hive TestUtils ..................................... SUCCESS [ 0.193 s]
            [INFO] Hive Packaging 3.1.2 ............................... SUCCESS [01:18 min]
            [INFO] ------------------------------------------------------------------------
            [INFO] BUILD SUCCESS
            [INFO] ------------------------------------------------------------------------
            [INFO] Total time: 11:01 min
            [INFO] Finished at: 2021-03-18T11:14:00+08:00
            [INFO] ------------------------------------------------------------------------
              root@felixzh:/opt/sourceCode/hive-rel-release-3.1.2# ll packaging/target/apache-hive-3.1.2-bin.tar.gz
              -rw-r--r-- 1 root root 283461639 3月 18 11:13 packaging/target/apache-hive-3.1.2-bin.tar.gz


              文章转载自大数据从业者,如果涉嫌侵权,请发送邮件至:contact@modb.pro进行举报,并提供相关证据,一经查实,墨天轮将立刻删除相关内容。

              评论