From fe74a9989edd4eda04262520cb0b6e20c96bf2a4 Mon Sep 17 00:00:00 2001 From: barry8023 Date: Fri, 8 Apr 2022 19:37:31 +0800 Subject: [PATCH 1/7] =?UTF-8?q?hive=E5=BC=95=E6=93=8E=E6=96=87=E6=A1=A3?= =?UTF-8?q?=E4=B8=8B=E5=A2=9E=E5=8A=A0Hive=E4=BF=AE=E6=94=B9=E6=97=A5?= =?UTF-8?q?=E5=BF=97=E5=B1=95=E7=A4=BA=E6=96=B9=E6=B3=95?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit 分别描述3点修改位置及代码 给出显示结果以及完整配置文件范例 --- .../version-1.0.3/engine_usage/hive.md | 124 ++++++++++++++++++ 1 file changed, 124 insertions(+) diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/version-1.0.3/engine_usage/hive.md b/i18n/zh-CN/docusaurus-plugin-content-docs/version-1.0.3/engine_usage/hive.md index 3bbe2f3195e..7aa64b17e3d 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/version-1.0.3/engine_usage/hive.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/version-1.0.3/engine_usage/hive.md @@ -92,3 +92,127 @@ hive引擎的实现方式通过实例化hive的Driver实例，然后由Driver来 ![](/Images-zh/EngineUsage/hive-config.png) 图4-1 hive的用户自定义配置管理台 + + +## 5.Hive修改日志展示 +默认的日志界面是不显示application_id以及task完成数量的,用户可以根据需要输出该日志 +引擎内的log4j2-engineconn.xml/log4j2.xml配置文件中需要修改的代码块如下 +1.appenders组件下需要添加 +```xml + + + +``` +2.root组件下需要添加 +```xml + +``` +3.loggers组件下需要添加 +```xml + + + +``` +进行如上相关修改后日志可以增加任务task进度信息，显示为如下样式 +``` +2022-04-08 11:06:50.228 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Status: Running (Executing on YARN cluster with App id application_1631114297082_432445) +2022-04-08 11:06:50.248 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: -/- Reducer 2: 0/1 +2022-04-08 11:06:52.417 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: 0/1 Reducer 2: 0/1 +2022-04-08 11:06:55.060 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: 0(+1)/1 Reducer 2: 0/1 +2022-04-08 11:06:57.495 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: 1/1 Reducer 2: 0(+1)/1 +2022-04-08 11:06:57.899 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: 1/1 Reducer 2: 1/1 +``` + +完整xml配置文件范例如下： +```xml + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +``` From f77f027174ee80cdf71d3e6276c48d2a0d6b0ef4 Mon Sep 17 00:00:00 2001 From: barry8023 Date: Tue, 12 Apr 2022 11:16:46 +0800 Subject: [PATCH 2/7] =?UTF-8?q?=E4=BF=AE=E6=94=B9hive=E5=BC=95=E6=93=8E?= =?UTF-8?q?=E6=96=87=E6=A1=A3=E4=BF=9D=E6=8C=81=E6=A0=BC=E5=BC=8F=E7=BB=9F?= =?UTF-8?q?=E4=B8=80?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- .../version-1.0.3/engine_usage/hive.md | 1 - 1 file changed, 1 deletion(-) diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/version-1.0.3/engine_usage/hive.md b/i18n/zh-CN/docusaurus-plugin-content-docs/version-1.0.3/engine_usage/hive.md index 7aa64b17e3d..a110e8d02a4 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/version-1.0.3/engine_usage/hive.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/version-1.0.3/engine_usage/hive.md @@ -93,7 +93,6 @@ hive引擎的实现方式通过实例化hive的Driver实例，然后由Driver来 图4-1 hive的用户自定义配置管理台 - ## 5.Hive修改日志展示 默认的日志界面是不显示application_id以及task完成数量的,用户可以根据需要输出该日志 引擎内的log4j2-engineconn.xml/log4j2.xml配置文件中需要修改的代码块如下 From 8e4bd6b5d6ccf209e28ede26b4ae47eda03954d8 Mon Sep 17 00:00:00 2001 From: barry8023 Date: Tue, 12 Apr 2022 11:17:59 +0800 Subject: [PATCH 3/7] =?UTF-8?q?1.0.2=E4=B8=AD=E6=96=87hive=E5=BC=95?= =?UTF-8?q?=E6=93=8E=E6=96=87=E6=A1=A3=E4=B8=8B=E5=A2=9E=E5=8A=A0Hive?= =?UTF-8?q?=E4=BF=AE=E6=94=B9=E6=97=A5=E5=BF=97=E5=B1=95=E7=A4=BA=E6=96=B9?= =?UTF-8?q?=E6=B3=95?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit 分别描述3点修改位置及代码 给出显示结果以及完整配置文件范例 --- .../version-1.0.2/engine_usage/hive.md | 123 ++++++++++++++++++ 1 file changed, 123 insertions(+) diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/version-1.0.2/engine_usage/hive.md b/i18n/zh-CN/docusaurus-plugin-content-docs/version-1.0.2/engine_usage/hive.md index 3bbe2f3195e..a110e8d02a4 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/version-1.0.2/engine_usage/hive.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/version-1.0.2/engine_usage/hive.md @@ -92,3 +92,126 @@ hive引擎的实现方式通过实例化hive的Driver实例，然后由Driver来 ![](/Images-zh/EngineUsage/hive-config.png) 图4-1 hive的用户自定义配置管理台 + +## 5.Hive修改日志展示 +默认的日志界面是不显示application_id以及task完成数量的,用户可以根据需要输出该日志 +引擎内的log4j2-engineconn.xml/log4j2.xml配置文件中需要修改的代码块如下 +1.appenders组件下需要添加 +```xml + + + +``` +2.root组件下需要添加 +```xml + +``` +3.loggers组件下需要添加 +```xml + + + +``` +进行如上相关修改后日志可以增加任务task进度信息，显示为如下样式 +``` +2022-04-08 11:06:50.228 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Status: Running (Executing on YARN cluster with App id application_1631114297082_432445) +2022-04-08 11:06:50.248 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: -/- Reducer 2: 0/1 +2022-04-08 11:06:52.417 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: 0/1 Reducer 2: 0/1 +2022-04-08 11:06:55.060 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: 0(+1)/1 Reducer 2: 0/1 +2022-04-08 11:06:57.495 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: 1/1 Reducer 2: 0(+1)/1 +2022-04-08 11:06:57.899 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: 1/1 Reducer 2: 1/1 +``` + +完整xml配置文件范例如下： +```xml + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +``` From 245d999da3c57030fb3127ca504eb51123be98a6 Mon Sep 17 00:00:00 2001 From: barry8023 Date: Tue, 12 Apr 2022 11:29:01 +0800 Subject: [PATCH 4/7] =?UTF-8?q?1.1.0=E4=B8=AD=E6=96=87hive=E5=BC=95?= =?UTF-8?q?=E6=93=8E=E6=96=87=E6=A1=A3=E4=B8=8B=E5=A2=9E=E5=8A=A0Hive?= =?UTF-8?q?=E4=BF=AE=E6=94=B9=E6=97=A5=E5=BF=97=E5=B1=95=E7=A4=BA=E6=96=B9?= =?UTF-8?q?=E6=B3=95?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit 分别描述3点修改位置及代码 给出显示结果以及完整配置文件范例 --- .../current/engine_usage/hive.md | 123 ++++++++++++++++++ 1 file changed, 123 insertions(+) diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/current/engine_usage/hive.md b/i18n/zh-CN/docusaurus-plugin-content-docs/current/engine_usage/hive.md index 3bbe2f3195e..a110e8d02a4 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/current/engine_usage/hive.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/current/engine_usage/hive.md @@ -92,3 +92,126 @@ hive引擎的实现方式通过实例化hive的Driver实例，然后由Driver来 ![](/Images-zh/EngineUsage/hive-config.png) 图4-1 hive的用户自定义配置管理台 + +## 5.Hive修改日志展示 +默认的日志界面是不显示application_id以及task完成数量的,用户可以根据需要输出该日志 +引擎内的log4j2-engineconn.xml/log4j2.xml配置文件中需要修改的代码块如下 +1.appenders组件下需要添加 +```xml + + + +``` +2.root组件下需要添加 +```xml + +``` +3.loggers组件下需要添加 +```xml + + + +``` +进行如上相关修改后日志可以增加任务task进度信息，显示为如下样式 +``` +2022-04-08 11:06:50.228 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Status: Running (Executing on YARN cluster with App id application_1631114297082_432445) +2022-04-08 11:06:50.248 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: -/- Reducer 2: 0/1 +2022-04-08 11:06:52.417 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: 0/1 Reducer 2: 0/1 +2022-04-08 11:06:55.060 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: 0(+1)/1 Reducer 2: 0/1 +2022-04-08 11:06:57.495 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: 1/1 Reducer 2: 0(+1)/1 +2022-04-08 11:06:57.899 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: 1/1 Reducer 2: 1/1 +``` + +完整xml配置文件范例如下： +```xml + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +``` From 2eb03bba588d941e51c6e71e537decbc583b7a96 Mon Sep 17 00:00:00 2001 From: barry8023 Date: Tue, 12 Apr 2022 13:48:09 +0800 Subject: [PATCH 5/7] =?UTF-8?q?1.1.0=E8=8B=B1=E6=96=87hive=E5=BC=95?= =?UTF-8?q?=E6=93=8E=E6=96=87=E6=A1=A3=E4=B8=8B=E5=A2=9E=E5=8A=A0Hive?= =?UTF-8?q?=E4=BF=AE=E6=94=B9=E6=97=A5=E5=BF=97=E5=B1=95=E7=A4=BA=E6=96=B9?= =?UTF-8?q?=E6=B3=95?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit 分别描述3点修改位置及代码 给出显示结果以及完整配置文件范例 --- docs/engine_usage/hive.md | 125 +++++++++++++++++++++++++++++++++++++- 1 file changed, 124 insertions(+), 1 deletion(-) diff --git a/docs/engine_usage/hive.md b/docs/engine_usage/hive.md index b524e07ff08..c01297337fc 100644 --- a/docs/engine_usage/hive.md +++ b/docs/engine_usage/hive.md @@ -87,4 +87,127 @@ In addition to the above engineConn configuration, users can also make custom se ![](/Images/EngineUsage/hive-config.png) -Figure 4-1 User-defined configuration management console of hive \ No newline at end of file +Figure 4-1 User-defined configuration management console of hive + +## 5.Hive modification log display +The default log interface does not display the application_id and the number of tasks completed, the user can output the log as needed +The code blocks that need to be modified in the log4j2-engineconn.xml/log4j2.xml configuration file in the engine are as follows +1.Need to add under the appenders component +```xml + + + +``` +2.Need to add under the root component +```xml + +``` +3.Need to add under the loggers component +```xml + + + +``` +After making the above relevant modifications, the log can add task progress information, which is displayed in the following style +``` +2022-04-08 11:06:50.228 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Status: Running (Executing on YARN cluster with App id application_1631114297082_432445) +2022-04-08 11:06:50.248 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: -/- Reducer 2: 0/1 +2022-04-08 11:06:52.417 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: 0/1 Reducer 2: 0/1 +2022-04-08 11:06:55.060 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: 0(+1)/1 Reducer 2: 0/1 +2022-04-08 11:06:57.495 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: 1/1 Reducer 2: 0(+1)/1 +2022-04-08 11:06:57.899 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: 1/1 Reducer 2: 1/1 +``` + +An example of a complete xml configuration file is as follows: +```xml + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +``` From 46257b497a18fbf58a59d47011fdbc3d82a8cbcd Mon Sep 17 00:00:00 2001 From: barry8023 Date: Tue, 12 Apr 2022 13:49:54 +0800 Subject: [PATCH 6/7] =?UTF-8?q?1.0.3=E8=8B=B1=E6=96=87hive=E5=BC=95?= =?UTF-8?q?=E6=93=8E=E6=96=87=E6=A1=A3=E4=B8=8B=E5=A2=9E=E5=8A=A0Hive?= =?UTF-8?q?=E4=BF=AE=E6=94=B9=E6=97=A5=E5=BF=97=E5=B1=95=E7=A4=BA=E6=96=B9?= =?UTF-8?q?=E6=B3=95?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit 分别描述3点修改位置及代码 给出显示结果以及完整配置文件范例 --- .../version-1.0.3/engine_usage/hive.md | 125 +++++++++++++++++- 1 file changed, 124 insertions(+), 1 deletion(-) diff --git a/versioned_docs/version-1.0.3/engine_usage/hive.md b/versioned_docs/version-1.0.3/engine_usage/hive.md index b524e07ff08..c01297337fc 100644 --- a/versioned_docs/version-1.0.3/engine_usage/hive.md +++ b/versioned_docs/version-1.0.3/engine_usage/hive.md @@ -87,4 +87,127 @@ In addition to the above engineConn configuration, users can also make custom se ![](/Images/EngineUsage/hive-config.png) -Figure 4-1 User-defined configuration management console of hive \ No newline at end of file +Figure 4-1 User-defined configuration management console of hive + +## 5.Hive modification log display +The default log interface does not display the application_id and the number of tasks completed, the user can output the log as needed +The code blocks that need to be modified in the log4j2-engineconn.xml/log4j2.xml configuration file in the engine are as follows +1.Need to add under the appenders component +```xml + + + +``` +2.Need to add under the root component +```xml + +``` +3.Need to add under the loggers component +```xml + + + +``` +After making the above relevant modifications, the log can add task progress information, which is displayed in the following style +``` +2022-04-08 11:06:50.228 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Status: Running (Executing on YARN cluster with App id application_1631114297082_432445) +2022-04-08 11:06:50.248 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: -/- Reducer 2: 0/1 +2022-04-08 11:06:52.417 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: 0/1 Reducer 2: 0/1 +2022-04-08 11:06:55.060 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: 0(+1)/1 Reducer 2: 0/1 +2022-04-08 11:06:57.495 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: 1/1 Reducer 2: 0(+1)/1 +2022-04-08 11:06:57.899 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: 1/1 Reducer 2: 1/1 +``` + +An example of a complete xml configuration file is as follows: +```xml + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +``` From 95d944f54a3f321a49b4b3305ef56405f0492645 Mon Sep 17 00:00:00 2001 From: barry8023 Date: Tue, 12 Apr 2022 13:51:08 +0800 Subject: [PATCH 7/7] =?UTF-8?q?1.0.2=E8=8B=B1=E6=96=87hive=E5=BC=95?= =?UTF-8?q?=E6=93=8E=E6=96=87=E6=A1=A3=E4=B8=8B=E5=A2=9E=E5=8A=A0Hive?= =?UTF-8?q?=E4=BF=AE=E6=94=B9=E6=97=A5=E5=BF=97=E5=B1=95=E7=A4=BA=E6=96=B9?= =?UTF-8?q?=E6=B3=95?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit 分别描述3点修改位置及代码 给出显示结果以及完整配置文件范例 --- .../version-1.0.2/engine_usage/hive.md | 125 +++++++++++++++++- 1 file changed, 124 insertions(+), 1 deletion(-) diff --git a/versioned_docs/version-1.0.2/engine_usage/hive.md b/versioned_docs/version-1.0.2/engine_usage/hive.md index c4b530bd10a..f63dc1920a2 100644 --- a/versioned_docs/version-1.0.2/engine_usage/hive.md +++ b/versioned_docs/version-1.0.2/engine_usage/hive.md @@ -88,4 +88,127 @@ In addition to the above engineConn configuration, users can also make custom se ![](/Images/EngineUsage/hive-config.png) -Figure 4-1 User-defined configuration management console of hive \ No newline at end of file +Figure 4-1 User-defined configuration management console of hive + +## 5.Hive modification log display +The default log interface does not display the application_id and the number of tasks completed, the user can output the log as needed +The code blocks that need to be modified in the log4j2-engineconn.xml/log4j2.xml configuration file in the engine are as follows +1.Need to add under the appenders component +```xml + + + +``` +2.Need to add under the root component +```xml + +``` +3.Need to add under the loggers component +```xml + + + +``` +After making the above relevant modifications, the log can add task progress information, which is displayed in the following style +``` +2022-04-08 11:06:50.228 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Status: Running (Executing on YARN cluster with App id application_1631114297082_432445) +2022-04-08 11:06:50.248 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: -/- Reducer 2: 0/1 +2022-04-08 11:06:52.417 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: 0/1 Reducer 2: 0/1 +2022-04-08 11:06:55.060 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: 0(+1)/1 Reducer 2: 0/1 +2022-04-08 11:06:57.495 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: 1/1 Reducer 2: 0(+1)/1 +2022-04-08 11:06:57.899 INFO [Linkis-Default-Scheduler-Thread-3] SessionState 1111 printInfo - Map 1: 1/1 Reducer 2: 1/1 +``` + +An example of a complete xml configuration file is as follows: +```xml + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +```