Reporting: Generating report for large dashboard fails #106873

liza-mae · 2021-07-27T15:27:20Z

Kibana version: 8.0.0-alpha1

Elasticsearch version: 8.0.0-alpha1

Server OS version: Linux

Browser version: Chrome

Browser OS version: Latest

Original install method (e.g. download page, yum, from source, etc.):
Staging

Description of the problem including expected versus actual behavior:
Generate large dashboard report should work, however it returns error unexpected token E in JSON at position 0
Steps to reproduce:

Install ES/Kibana
Generate PDF report for a large dashboard, about 51 visualizations or run large dashboard reporting test in x-pack directory.
Observe error: Unable to fetch report content Unexpected token E in JSON at position 0

NOTE: The reporting diagnostic also failed with an error can't read property http of undefined.

I have seen reporting fail on large dashboards before, but the errors showing are different here, so not sure if it is the same root cause.

The text was updated successfully, but these errors were encountered:

elasticmachine · 2021-07-27T15:27:21Z

Pinging @elastic/kibana-app-services (Team:AppServices)

tsullivan · 2021-07-27T21:01:22Z

@liza-mae

I have seen reporting fail on large dashboards before, but the errors showing are different here, so not sure if it is the same root cause.

The Cannot read property 'http' of undefined comes from a bug in a refactoring PR that was merged for 7.15.

#105508

dokmic · 2021-07-30T12:26:25Z

@liza-mae, The error Unable to fetch report content Unexpected token E in JSON at position 0 was not related to the large report generation. There was a bug on the UI side that was incorrectly deserializing the error message. That code was removed in #106184.
I tried to reproduce the reporting job failure by generating a report for the large dashboard, but everything works as expected. Could you please check if the issue is still valid with the latest changes? If the issue persists, we will be able to see the exact error now.

@tsullivan, I've addressed the error in the Reporting Diagnostics in #107282. Should we create a separate issue for the regression because the error is not related to the large dashboards?

tsullivan · 2021-07-30T15:33:56Z

@dokmic

I've addressed the error in the Reporting Diagnostics in #107282. Should we create a separate issue for the regression because the error is not related to the large dashboards?

I think it's fine to get that fix in without opening a separate issue.

tsullivan · 2021-07-30T15:35:19Z

@liza-mae hopefully when the diagnostic issue is fixed, you'll be able to see why reporting is not working on this Linux instance.

tsullivan · 2021-08-19T00:21:35Z

@liza-mae any update on this?

liza-mae · 2021-08-23T19:24:25Z

@tsullivan The diagnostic errors are now fixed and it gives me proper diagnostic error messages. The diagnostic states to increase xpack.reporting.capture.timeouts.waitForElements, which I did but the report still times out, is there an ideal time for this to be test to? I tried 60000ms.

liza-mae · 2021-08-23T22:35:30Z

The diagnostic gives this error at 30s or 60s and throws an error at 120s. Something isn't working right.

@30s

@120s

liza-mae · 2021-08-23T22:49:04Z

Logs

| Aug 23, 2021 @ 22:38:36.000 |   | Error: An error occurred when trying to read the page for visualization panel info. You may need to increase 'xpack.reporting.capture.timeouts.waitForElements'. TimeoutError: waiting for selector `[data-shared-item],[data-shared-items-count]` failed: timeout 30000ms exceeded     at getNumberOfItems (/usr/share/kibana/x-pack/plugins/reporting/server/lib/screenshots/get_number_of_items.js:66:11)

| Aug 23, 2021 @ 22:38:36.000 |   | TimeoutError: waiting for selector `[data-shared-item],[data-shared-items-count]` failed: timeout 30000ms exceeded     at new WaitTask (/usr/share/kibana/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:509:34)     at DOMWorld.waitForSelectorInPage (/usr/share/kibana/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:420:26)     at Object.internalHandler.waitFor (/usr/share/kibana/node_modules/puppeteer/lib/cjs/puppeteer/common/QueryHandler.js:31:77)     at DOMWorld.waitForSelector (/usr/share/kibana/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:313:29)     at Frame.waitForSelector (/usr/share/kibana/node_modules/puppeteer/lib/cjs/puppeteer/common/FrameManager.js:841:51)     at Page.waitForSelector (/usr/share/kibana/node_modules/puppeteer/lib/cjs/puppeteer/common/Page.js:1280:33)     at HeadlessChromiumDriver.waitForSelector (/usr/share/kibana/x-pack/plugins/reporting/server/browsers/chromium/driver/chromium_driver.js:181:34)     at getNumberOfItems (/usr/share/kibana/x-pack/plugins/reporting/server/lib/screenshots/get_number_of_items.js:39:19)     at MergeMapSubscriber.project (/usr/share/kibana/x-pack/plugins/reporting/server/lib/screenshots/observable.js:131:84)     at MergeMapSubscriber._tryNext (/usr/share/kibana/node_modules/rxjs/internal/operators/mergeMap.js:67:27)     at MergeMapSubscriber._next (/usr/share/kibana/node_modules/rxjs/internal/operators/mergeMap.js:57:18)     at MergeMapSubscriber.Subscriber.next (/usr/share/kibana/node_modules/rxjs/internal/Subscriber.js:66:18)     at MergeMapSubscriber.notifyNext (/usr/share/kibana/node_modules/rxjs/internal/operators/mergeMap.js:93:26)     at SimpleInnerSubscriber._next (/usr/share/kibana/node_modules/rxjs/internal/innerSubscribe.js:27:21)     at SimpleInnerSubscriber.Subscriber.next (/usr/share/kibana/node_modules/rxjs/internal/Subscriber.js:66:18)     at /usr/share/kibana/node_modules/rxjs/internal/util/subscribeToPromise.js:7:24

| Aug 23, 2021 @ 22:32:00.000 |   | TimeoutError: waiting for selector `[data-shared-item],[data-shared-items-count]` failed: timeout 30000ms exceeded     at new WaitTask (/usr/share/kibana/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:509:34)     at DOMWorld.waitForSelectorInPage (/usr/share/kibana/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:420:26)     at Object.internalHandler.waitFor (/usr/share/kibana/node_modules/puppeteer/lib/cjs/puppeteer/common/QueryHandler.js:31:77)     at DOMWorld.waitForSelector (/usr/share/kibana/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:313:29)     at Frame.waitForSelector (/usr/share/kibana/node_modules/puppeteer/lib/cjs/puppeteer/common/FrameManager.js:841:51)     at Page.waitForSelector (/usr/share/kibana/node_modules/puppeteer/lib/cjs/puppeteer/common/Page.js:1280:33)     at HeadlessChromiumDriver.waitForSelector (/usr/share/kibana/x-pack/plugins/reporting/server/browsers/chromium/driver/chromium_driver.js:181:34)     at getNumberOfItems (/usr/share/kibana/x-pack/plugins/reporting/server/lib/screenshots/get_number_of_items.js:39:19)     at MergeMapSubscriber.project (/usr/share/kibana/x-pack/plugins/reporting/server/lib/screenshots/observable.js:131:84)     at MergeMapSubscriber._tryNext (/usr/share/kibana/node_modules/rxjs/internal/operators/mergeMap.js:67:27)     at MergeMapSubscriber._next (/usr/share/kibana/node_modules/rxjs/internal/operators/mergeMap.js:57:18)     at MergeMapSubscriber.Subscriber.next (/usr/share/kibana/node_modules/rxjs/internal/Subscriber.js:66:18)     at MergeMapSubscriber.notifyNext (/usr/share/kibana/node_modules/rxjs/internal/operators/mergeMap.js:93:26)     at SimpleInnerSubscriber._next (/usr/share/kibana/node_modules/rxjs/internal/innerSubscribe.js:27:21)     at SimpleInnerSubscriber.Subscriber.next (/usr/share/kibana/node_modules/rxjs/internal/Subscriber.js:66:18)     at /usr/share/kibana/node_modules/rxjs/internal/util/subscribeToPromise.js:7:24

| Aug 23, 2021 @ 22:32:00.000 |   | Error: An error occurred when trying to read the page for visualization panel info. You may need to increase 'xpack.reporting.capture.timeouts.waitForElements'. TimeoutError: waiting for selector `[data-shared-item],[data-shared-items-count]` failed: timeout 30000ms exceeded     at getNumberOfItems (/usr/share/kibana/x-pack/plugins/reporting/server/lib/screenshots/get_number_of_items.js:66:11)

| Aug 23, 2021 @ 22:29:52.000 |   | Error: An error occurred when trying to read the page for visualization panel info. You may need to increase 'xpack.reporting.capture.timeouts.waitForElements'. TimeoutError: waiting for selector `[data-shared-item],[data-shared-items-count]` failed: timeout 120000ms exceeded     at getNumberOfItems (/usr/share/kibana/x-pack/plugins/reporting/server/lib/screenshots/get_number_of_items.js:66:11)

| Aug 23, 2021 @ 22:29:52.000 |   | TimeoutError: waiting for selector `[data-shared-item],[data-shared-items-count]` failed: timeout 120000ms exceeded     at new WaitTask (/usr/share/kibana/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:509:34)     at DOMWorld.waitForSelectorInPage (/usr/share/kibana/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:420:26)     at Object.internalHandler.waitFor (/usr/share/kibana/node_modules/puppeteer/lib/cjs/puppeteer/common/QueryHandler.js:31:77)     at DOMWorld.waitForSelector (/usr/share/kibana/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:313:29)     at Frame.waitForSelector (/usr/share/kibana/node_modules/puppeteer/lib/cjs/puppeteer/common/FrameManager.js:841:51)     at Page.waitForSelector (/usr/share/kibana/node_modules/puppeteer/lib/cjs/puppeteer/common/Page.js:1280:33)

tsullivan · 2021-09-02T22:03:33Z

@liza-mae the solution is to use a smaller dashboard that works for the test instance. The diagnostic tool errors look like a separate issue, unrelated to generating report for a large dashboard.

tsullivan · 2021-09-02T22:07:26Z

Same issue in 7.13: #102006

tsullivan · 2022-04-04T22:53:12Z

duplicate of #100461

liza-mae added the Team:AppServices label Jul 27, 2021

liza-mae added the bug Fixes for quality problems that affect the customer experience label Jul 27, 2021

exalate-issue-sync bot added impact:high Addressing this issue will have a high level of impact on the quality/strength of our product. loe:small Small Level of Effort labels Jul 27, 2021

tsullivan mentioned this issue Jul 27, 2021

[Reporting] Need unit tests for diagnostic tool #106924

Open

exalate-issue-sync bot added loe:medium Medium Level of Effort and removed loe:small Small Level of Effort labels Jul 27, 2021

dokmic mentioned this issue Jul 30, 2021

[Reporting] Fix API client wrapper in the reporting diagnostics #107282

Merged

1 task

exalate-issue-sync bot added loe:large Large Level of Effort and removed loe:medium Medium Level of Effort labels Aug 19, 2021

exalate-issue-sync bot added loe:small Small Level of Effort and removed loe:large Large Level of Effort labels Aug 19, 2021

exalate-issue-sync bot changed the title ~~Generating report for large dashboard fails~~ Reporting: Generating report for large dashboard fails Aug 19, 2021

tsullivan mentioned this issue Sep 2, 2021

Reporting: [test-failed]: Chrome X-Pack UI Functional Tests1.x-pack/test/functional/apps/dashboard/reporting/screenshots·ts - dashboard Reporting Dashboard Reporting Screenshots PNG Layout downloads a PNG file: large dashboard #102006

Closed

exalate-issue-sync bot added impact:low Addressing this issue will have a low level of impact on the quality/strength of our product. and removed impact:high Addressing this issue will have a high level of impact on the quality/strength of our product. labels Sep 27, 2021

tsullivan mentioned this issue Sep 29, 2021

Sometimes reporting pdf optimize fails after upgrade #108963

Closed

tsullivan added Team:AppServicesUx and removed Team:AppServicesSv labels Oct 6, 2021

liza-mae mentioned this issue Oct 14, 2021

Reporting diagnostics capture screenshot timeout #115107

Closed

exalate-issue-sync bot closed this as completed Apr 4, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Reporting: Generating report for large dashboard fails #106873

Reporting: Generating report for large dashboard fails #106873

liza-mae commented Jul 27, 2021 •

edited

Loading

elasticmachine commented Jul 27, 2021

tsullivan commented Jul 27, 2021 •

edited

Loading

dokmic commented Jul 30, 2021 •

edited

Loading

tsullivan commented Jul 30, 2021

tsullivan commented Jul 30, 2021

tsullivan commented Aug 19, 2021

liza-mae commented Aug 23, 2021

liza-mae commented Aug 23, 2021

liza-mae commented Aug 23, 2021

tsullivan commented Sep 2, 2021

tsullivan commented Sep 2, 2021

tsullivan commented Apr 4, 2022

Reporting: Generating report for large dashboard fails #106873

Reporting: Generating report for large dashboard fails #106873

Comments

liza-mae commented Jul 27, 2021 • edited Loading

elasticmachine commented Jul 27, 2021

tsullivan commented Jul 27, 2021 • edited Loading

dokmic commented Jul 30, 2021 • edited Loading

tsullivan commented Jul 30, 2021

tsullivan commented Jul 30, 2021

tsullivan commented Aug 19, 2021

liza-mae commented Aug 23, 2021

liza-mae commented Aug 23, 2021

liza-mae commented Aug 23, 2021

tsullivan commented Sep 2, 2021

tsullivan commented Sep 2, 2021

tsullivan commented Apr 4, 2022

liza-mae commented Jul 27, 2021 •

edited

Loading

tsullivan commented Jul 27, 2021 •

edited

Loading

dokmic commented Jul 30, 2021 •

edited

Loading