Log explorer ->Discover retains column names even when they are not relevant to current search/dataview in serverless observability projects

[bhavyarm]

Kibana version: main

Elasticsearch version: main

Browser version: chrome latest

Original install method (e.g. download page, yum, from source, etc.): serverless observability project

Describe the bug: Log explorer auto-selects service name, host name, message as "Selected fields" in discover side bar. When user clicks on open in Discover and picks any dataview - even though the picked dataview doesn't have these fields - they get displayed as columns in discover.

This used to happen in analytics ->discover and I cannot find my bug but it did get fixed a while ago.

columns_get_retained.mp4

[elasticmachine]

Pinging @elastic/kibana-data-discovery (Team:DataDiscovery)

[elasticmachine]

Pinging @elastic/obs-ux-logs-team (Team:obs-ux-logs)

[bhavyarm]

Please note this also caused another display issue and specific to non-time series data. I used the data visualizer to upload a csv of squirrel census data (non-time series data). The ingestion went through fine and squirrels dataview got created successfully. When I navigated to log explorer -> open in discover -> picked squirrels as data view - no documents got displayed. Once I manually removed selected columns - service name, host name and messages - I could see my data. may be we will never have logs data without time? In which case its user error (the problem is me :)) Just thought will note it down here.

[weltenwort]

Thanks for reporting this, @bhavyarm! In #170200 we completely rewrite the way state is represented in the URL, so I will try to make sure this doesn't happen anymore.