Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reduce or improve the number of assets added under the hood #183369

Open
yomduf opened this issue May 14, 2024 · 6 comments
Open

Reduce or improve the number of assets added under the hood #183369

yomduf opened this issue May 14, 2024 · 6 comments
Labels
Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc.

Comments

@yomduf
Copy link

yomduf commented May 14, 2024

Describe the feature:
When users browse Kibana, they may activate features (by mistake) that automatically add assets (data-views/dashboards) that are managed by Kibana.
Some of these assets are not easy to delete because they are "Managed" so it add a kind of noise in the Kibana Environment

Example :

  • By simply clicking Main Menu > Security > Dashboards, Elastic automatically added, without consent, the following integrations Elastic Defend and Prebuilt Security Detection Rules. As a result, several unrequested data views, a dashboard (and most likely other things) were created without need.
Capture d’écran 2024-05-13 à 13 51 47

Describe a specific use case for the feature:
Maybe add

  • warning message, such as By clicking here, dashboards and data views will automatically be added to this space. Do you wish to continue?
  • Or maybe we should add a boolean settings in Kibana Advanced Settings Automatically add managed assets
@botelastic botelastic bot added the needs-team Issues missing a team label label May 14, 2024
@lukasolson lukasolson added Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. and removed needs-team Issues missing a team label labels May 14, 2024
@elasticmachine
Copy link
Contributor

Pinging @elastic/security-solution (Team: SecuritySolution)

@jlind23
Copy link
Contributor

jlind23 commented May 27, 2024

@nimarezainia is this something you have already heard of?

@lucabelluccini
Copy link
Contributor

Additional context:

  • This might be seen as a Fleet feature to be offered to integration developers. Instead of installing all assets by default, we can offer optional assets and a mandatory set of assets (e.g. Index Templates, Ingest pipelines, ... are mandatory - Dashboards, Visualizations, Alerts can be optional)
  • For some "system" integrations (e.g. Elastic Agent integration), all assets must be made mandatory as we rely on them for Monitoring features of Fleet/Elastic Agent (Elastic Agent view in Fleet has a link to the Elastic Agent monitoring dashboard)

@nimarezainia
Copy link
Contributor

so it add a kind of noise in the Kibana Environment

there's a fairly comprehensive filtering options there. Why couldn't the user just filter out "managed"? I'm worried about changing already established behaviour in this regard.

@lucabelluccini
Copy link
Contributor

I think this can be expressed as "Fleet UI to offer the ability to install assets selectively":

  • Ingestion assets (index templates, components, ingest pipelines). Those are purely ES side and I would make those mandatory and with a big warning they are required in 99% of cases.
  • Dashboards and Visualizations (+ data views). Those are optional (some integrations might mark them as mandatory, like the elastic_agent package as the monitoring dashboards are needed for the Fleet UI to work properly)
  • Transforms. Some integrations started shipping transforms with integrations.
  • (future) Alerts, SLO, ... ?

I can provide 2 possible use cases:

  • User doesn't use our bundled dashboards for Prometheus integration. They do not want to remove them every time they install/upgrade to not pollute the Kibana environment they have.
  • User has N clusters and a central CCS cluster. Each cluster is dedicated only for ingesting data for a separate data center. In each one of the N clusters they only ingest data. The central CCS cluster searches across all the N clusters. They want to:
    • install only the ingest assets in the N clusters
    • install only the kibana assets in the CCS cluster

@nimarezainia
Copy link
Contributor

let's pursue this as giving the user the ability to make non-essential assets as optional installs. Provide the package developer the ability to nominate which assets are "optional" (and therefore can be de-selected) and which are mandatory (which can't be de-selected).

All assets are "selected" by default as that is the current behavior.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc.
Projects
None yet
Development

No branches or pull requests

6 participants