Skip to content

Commit

Permalink
Change aysnc_query default setting
Browse files Browse the repository at this point in the history
Signed-off-by: Peng Huo <[email protected]>
  • Loading branch information
penghuo committed Mar 18, 2024
1 parent a84c3ef commit 76b9846
Show file tree
Hide file tree
Showing 2 changed files with 10 additions and 10 deletions.
14 changes: 7 additions & 7 deletions docs/user/admin/settings.rst
Original file line number Diff line number Diff line change
Expand Up @@ -318,9 +318,9 @@ plugins.query.executionengine.spark.session.limit
Description
-----------

Each cluster can have maximum 100 sessions running in parallel by default. You can increase limit by this setting.
Each cluster can have maximum 10 sessions running in parallel by default. You can increase limit by this setting.

1. The default value is 100.
1. The default value is 10.
2. This setting is node scope.
3. This setting can be updated dynamically.

Expand Down Expand Up @@ -355,9 +355,9 @@ plugins.query.executionengine.spark.refresh_job.limit
Description
-----------

Each cluster can have maximum 20 datasources. You can increase limit by this setting.
Each cluster can have maximum 5 refresh job running concurrently. You can increase limit by this setting.

1. The default value is 20.
1. The default value is 5.
2. This setting is node scope.
3. This setting can be updated dynamically.

Expand Down Expand Up @@ -499,9 +499,9 @@ Description
This setting defines the time-to-live (TTL) for request indices when plugins.query.executionengine.spark.auto_index_management.enabled
is true. By default, request indices older than 14 days are deleted.

* Default Value: 14 days
* Default Value: 30 days

To change the TTL to 30 days for example, execute the following command:
To change the TTL to 60 days for example, execute the following command:

SQL query::

Expand All @@ -517,7 +517,7 @@ SQL query::
"spark": {
"session": {
"index": {
"ttl": "30d"
"ttl": "60d"
}
}
}
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -147,21 +147,21 @@ public class OpenSearchSettings extends Settings {
public static final Setting<?> SPARK_EXECUTION_SESSION_LIMIT_SETTING =
Setting.intSetting(
Key.SPARK_EXECUTION_SESSION_LIMIT.getKeyValue(),
100,
10,
Setting.Property.NodeScope,
Setting.Property.Dynamic);

public static final Setting<?> SPARK_EXECUTION_REFRESH_JOB_LIMIT_SETTING =
Setting.intSetting(
Key.SPARK_EXECUTION_REFRESH_JOB_LIMIT.getKeyValue(),
50,
5,
Setting.Property.NodeScope,
Setting.Property.Dynamic);

public static final Setting<TimeValue> SESSION_INDEX_TTL_SETTING =
Setting.positiveTimeSetting(
Key.SESSION_INDEX_TTL.getKeyValue(),
timeValueDays(14),
timeValueDays(30),
Setting.Property.NodeScope,
Setting.Property.Dynamic);

Expand Down

0 comments on commit 76b9846

Please sign in to comment.