[Reporting-CSV Export] Re-write CSV Export using SearchSource (elasti…

…c#88303)

* [Reporting-CSV Export] Re-write CSV Export using SearchSource

* replace PIT solution with scan-and-scroll

* update tests

* cleanup

* simplify pr

* update docs

* update docs

* update telemetry schema

* use getSearchRequestBody instead of flatten

* Revert "update docs"

This reverts commit ab9f4d9.

* optimize some async calls

* cleanup

* --wip-- [skip ci]

* fix telemetry schema

* fix telemetry tests

* fix snapshot

* api docs

* api doc updates

* use import type

* format the data through chains of maps

* add another saved search to reporting/ecommerce_kibana

* add a failing test

* add error logging to query failures

* put clear scroll in a finally so the ES error can be captured

* log dat error

* set dat fieldsFromSource

* --wip-- [skip ci]

* Revert "add another saved search to reporting/ecommerce_kibana"

This reverts commit 6edf26e.

* functional test fixes

* clean up ecommerce test archive

* add test for new search with fieldsFromSource set

* add tests and refactor tests

* cleanup redundant conditionals

* add GenerateCsv.getFields

* fix some tests

* fix double-escaping

* fix test snapshots and refactoring

* fix other tests

* fix test

* fix default index pattern in functional tests

* fix ts and sort fields when they come from API response

* --wip-- [skip ci]

* fix formatting and increase maxSizeBytes for testing

* remove client-side logic for sanitizing fields

* do not prepend timefield name if it already is a column

* test the logic to prepend timeField

* test the logic to sort the fields

* fix functional test

* preserve the error from data.search

* add functional test for ES returning an error

* fix snapshot

Co-authored-by: Kibana Machine <[email protected]>

api_docs/data.json

@@ -22013,7 +22013,7 @@
                 "description": [],
                 "source": {
                   "path": "src/plugins/data/server/index.ts",
-                  "lineNumber": 245
+                  "lineNumber": 246
                 },
                 "signature": [
                   "typeof ",
@@ -22034,7 +22034,7 @@
                 "description": [],
                 "source": {
                   "path": "src/plugins/data/server/index.ts",
-                  "lineNumber": 246
+                  "lineNumber": 247
                 },
                 "signature": [
                   "typeof ",
@@ -22055,7 +22055,7 @@
                 "description": [],
                 "source": {
                   "path": "src/plugins/data/server/index.ts",
-                  "lineNumber": 247
+                  "lineNumber": 248
                 },
                 "signature": [
                   "({ display: string; val: string; enabled(agg: ",
@@ -22077,7 +22077,7 @@
                 "description": [],
                 "source": {
                   "path": "src/plugins/data/server/index.ts",
-                  "lineNumber": 248
+                  "lineNumber": 249
                 },
                 "signature": [
                   "typeof ",
@@ -22098,7 +22098,7 @@
                 "description": [],
                 "source": {
                   "path": "src/plugins/data/server/index.ts",
-                  "lineNumber": 249
+                  "lineNumber": 250
                 },
                 "signature": [
                   "typeof ",
@@ -22119,7 +22119,7 @@
                 "description": [],
                 "source": {
                   "path": "src/plugins/data/server/index.ts",
-                  "lineNumber": 250
+                  "lineNumber": 251
                 },
                 "signature": [
                   "typeof ",
@@ -22140,7 +22140,7 @@
                 "description": [],
                 "source": {
                   "path": "src/plugins/data/server/index.ts",
-                  "lineNumber": 251
+                  "lineNumber": 252
                 },
                 "signature": [
                   "(agg: ",
@@ -22162,7 +22162,7 @@
                 "description": [],
                 "source": {
                   "path": "src/plugins/data/server/index.ts",
-                  "lineNumber": 252
+                  "lineNumber": 253
                 },
                 "signature": [
                   "(agg: ",
@@ -22184,7 +22184,7 @@
                 "description": [],
                 "source": {
                   "path": "src/plugins/data/server/index.ts",
-                  "lineNumber": 253
+                  "lineNumber": 254
                 },
                 "signature": [
                   "(...types: string[]) => (agg: ",
@@ -22206,7 +22206,7 @@
                 "description": [],
                 "source": {
                   "path": "src/plugins/data/server/index.ts",
-                  "lineNumber": 254
+                  "lineNumber": 255
                 },
                 "signature": [
                   "typeof ",
@@ -22227,7 +22227,7 @@
                 "description": [],
                 "source": {
                   "path": "src/plugins/data/server/index.ts",
-                  "lineNumber": 255
+                  "lineNumber": 256
                 },
                 "signature": [
                   "typeof ",
@@ -22248,7 +22248,7 @@
                 "description": [],
                 "source": {
                   "path": "src/plugins/data/server/index.ts",
-                  "lineNumber": 256
+                  "lineNumber": 257
                 }
               },
               {
@@ -22259,7 +22259,7 @@
                 "description": [],
                 "source": {
                   "path": "src/plugins/data/server/index.ts",
-                  "lineNumber": 257
+                  "lineNumber": 258
                 },
                 "signature": [
                   "typeof ",
@@ -22280,7 +22280,7 @@
                 "description": [],
                 "source": {
                   "path": "src/plugins/data/server/index.ts",
-                  "lineNumber": 258
+                  "lineNumber": 259
                 },
                 "signature": [
                   "typeof ",
@@ -22301,7 +22301,7 @@
                 "description": [],
                 "source": {
                   "path": "src/plugins/data/server/index.ts",
-                  "lineNumber": 259
+                  "lineNumber": 260
                 },
                 "signature": [
                   "typeof ",
@@ -22322,7 +22322,7 @@
                 "description": [],
                 "source": {
                   "path": "src/plugins/data/server/index.ts",
-                  "lineNumber": 260
+                  "lineNumber": 261
                 }
               },
               {
@@ -22333,7 +22333,7 @@
                 "description": [],
                 "source": {
                   "path": "src/plugins/data/server/index.ts",
-                  "lineNumber": 261
+                  "lineNumber": 262
                 },
                 "signature": [
                   "string[]"
@@ -22347,7 +22347,7 @@
                 "description": [],
                 "source": {
                   "path": "src/plugins/data/server/index.ts",
-                  "lineNumber": 262
+                  "lineNumber": 263
                 },
                 "signature": [
                   "typeof ",
@@ -22368,7 +22368,7 @@
                 "description": [],
                 "source": {
                   "path": "src/plugins/data/server/index.ts",
-                  "lineNumber": 263
+                  "lineNumber": 264
                 },
                 "signature": [
                   "typeof ",
@@ -22386,7 +22386,7 @@
             "label": "aggs",
             "source": {
               "path": "src/plugins/data/server/index.ts",
-              "lineNumber": 244
+              "lineNumber": 245
             }
           },
           {
@@ -22397,7 +22397,7 @@
             "description": [],
             "source": {
               "path": "src/plugins/data/server/index.ts",
-              "lineNumber": 265
+              "lineNumber": 266
             },
             "signature": [
               "typeof ",
@@ -22418,7 +22418,7 @@
             "description": [],
             "source": {
               "path": "src/plugins/data/server/index.ts",
-              "lineNumber": 266
+              "lineNumber": 267
             },
             "signature": [
               "typeof ",
@@ -22439,7 +22439,7 @@
             "description": [],
             "source": {
               "path": "src/plugins/data/server/index.ts",
-              "lineNumber": 267
+              "lineNumber": 268
             },
             "signature": [
               "typeof ",
@@ -22460,7 +22460,7 @@
             "description": [],
             "source": {
               "path": "src/plugins/data/server/index.ts",
-              "lineNumber": 268
+              "lineNumber": 269
             },
             "signature": [
               "typeof ",
@@ -22478,7 +22478,7 @@
         "label": "search",
         "source": {
           "path": "src/plugins/data/server/index.ts",
-          "lineNumber": 243
+          "lineNumber": 244
         },
         "initialIsOpen": false
       },