Make compiled plugin artifacts available

[adaisley]

Is your feature request related to a problem? Please describe.
We're trying to build our own version of OpenSource Dashboards 1.0.0 from source with a few minor UI changes and we're encountering a bit of an issue in that trying to run /usr/share/opensearch-dashboards/bin/opensearch-dashboards-plugin --allow-root install securityDashboards gives us an error saying a valid URL was not specified.

I asked on the forums if anyone could provide the correct link to this so that we might download it and bring it into our Dockerfile, then run the install step on the .zip. According to @SearchyMcSearchFace, compiled plugin artifacts aren't yet available?

Describe the solution you'd like
Make compiled plugin artifacts available on https://artifacts.opensearch.org/downloads/kibana-plugins/

Describe alternatives you've considered
I haven't got too many alternatives here I'm afraid.

Additional context
https://discuss.opendistrocommunity.dev/t/errors-when-installing-plugins-in-opensearch-dashboards/7030

[dblock]

Aside of making .zips available, we have work in progress in #435 to get the OpenSearch Dashboards build working top-down in a repeatable way similarly to what we did for OpenSearch.

[peternied]

[Triage] @stockholmux Do you have thoughts on how we want to distribute these artifacts independently or the distribution?

[stockholmux]

@peternied totally open to ideas on this. To be clear we're talking about zips of the plugins on a per version basis?

Something like:
opensearch-knn-1.2.0.zip, opensearch-security-1.2.0.zip, etc.

The website is setup to attach n number of artifacts per version but I think they should be outside the primary get started/download page - it's still pretty niche. Additionally we'll need some documentation on how to install them (IIRC it's not in the OpenSearch docs)

[dblock]

A related ask is to have these and other distributions in maven, #716.

We can definitely extend our signing process to include plugin ZIPs and distribute those in the bundle with every build. Today we include the min artifact this way, just need to mirror that.

[dblock]

@adaisley You can now build OpenSearch Dashboards from the source using this repo.

./build.sh manifests/1.1.0/opensearch-dashboards-1.1.0.yml
./assemble.sh artifacts/manifest.yml

Do you still need those artifacts published if you're building everything from source anyway?

You could update the manifest pointing to your GitHub forks/changes and use the process as is.

[dblock]

Note that plugins seem to be working around this by publishing a .zip on GitHub, and are recommending to use those (e.g. opensearch-project/cross-cluster-replication#258), which isn't the same .zip that's included in the distribution with plugins. For one these aren't built in the same CI, and aren't signed.

[bbarani]

@adaisley, The plugin zips are available at ci.artifacts.org/... location and the exact location can be found inside the manifest.yml file inside the OpenSearch-Dashboards distribution.

Extracted location from 1.2.0 manifest:

• location: https://ci.opensearch.org/ci/dbc/bundle-build-dashboards/1.2.0/512/linux/x64/dist/opensearch-dashboards-1.2.0-linux-x64.tar.gz
• location: https://ci.opensearch.org/ci/dbc/bundle-build-dashboards/1.2.0/512/linux/x64/builds/dist/opensearch-dashboards-min-1.2.0-linux-x64.tar.gz
• location: https://ci.opensearch.org/ci/dbc/bundle-build-dashboards/1.2.0/512/linux/x64/builds/plugins/alertingDashboards-1.2.0.zip
• location: https://ci.opensearch.org/ci/dbc/bundle-build-dashboards/1.2.0/512/linux/x64/builds/plugins/securityDashboards-1.2.0.zip
• location: https://ci.opensearch.org/ci/dbc/bundle-build-dashboards/1.2.0/512/linux/x64/builds/plugins/indexManagementDashboards-1.2.0.zip
• location: https://ci.opensearch.org/ci/dbc/bundle-build-dashboards/1.2.0/512/linux/x64/builds/plugins/queryWorkbenchDashboards-1.2.0.zip
• location: https://ci.opensearch.org/ci/dbc/bundle-build-dashboards/1.2.0/512/linux/x64/builds/plugins/reportsDashboards-1.2.0.zip
• location: https://ci.opensearch.org/ci/dbc/bundle-build-dashboards/1.2.0/512/linux/x64/builds/plugins/observabilityDashboards-1.2.0.zip
• location: https://ci.opensearch.org/ci/dbc/bundle-build-dashboards/1.2.0/512/linux/x64/builds/plugins/ganttChartDashboards-1.2.0.zip
• location: https://ci.opensearch.org/ci/dbc/bundle-build-dashboards/1.2.0/512/linux/x64/builds/plugins/anomalyDetectionDashboards-1.2.0.zip

[bbarani]

I am closing this issue as we are already publishing the compiled artifacts now. Please feel free to re-open this issue if this resolution doesn't address your issue.