[BUG] Cannot Install k-NN plugin via Homebrew

[Petercopter]

Describe the bug

I've installed OpenSearch via Homebrew on MacOS (M1). I'm trying to install the k-NN search plugin, but I'm getting an error.

Related component

Build

To Reproduce

brew install opensearch

then

opensearch-plugin install opensearch-knn

returns

warning: no-jdk distributions that do not bundle a JDK are deprecated and will be removed in a future release
-> Installing opensearch-knn
-> Failed installing opensearch-knn
-> Rolling back opensearch-knn
-> Rolled back opensearch-knn
A tool for managing installed opensearch plugins

Non-option arguments:
[String] -- command  

Option             Description        
------             -----------        
-E <KeyValuePair>  Configure a setting
-h, --help         Show help          
-s, --silent       Show minimal output
-v, --verbose      Show verbose output
ERROR: Unknown plugin opensearch-knn

Expected behavior

Plugin should install

Additional Details

My coworker was able to install a different plugin as a test using

opensearch-plugin install query-insights

So this could be specific to the opensearch-knn plugin.

Plugins
Please list all plugins currently enabled.

Host/Environment (please complete the following information):

• OS: MacOS (M1)
• Version Sequoia 15.0

[michelson]

can confirm , opensearch-plugin install query-insights works , but opensearch-knn has the error above.

• homebrew / Sonoma
• Version: 2.13.0, Build: tar/unknown/2024-03-25T17:59:25Z, JVM: 21.0.3

also failing by installing via ZIP

opensearch-plugin install https://github.com/opensearch-project/k-NN/archive/refs/tags/2.17.0.0.zip

warning: no-jdk distributions that do not bundle a JDK are deprecated and will be removed in a future release
-> Installing https://github.com/opensearch-project/k-NN/archive/refs/tags/2.17.0.0.zip
-> Downloading https://github.com/opensearch-project/k-NN/archive/refs/tags/2.17.0.0.zip
-> Failed installing https://github.com/opensearch-project/k-NN/archive/refs/tags/2.17.0.0.zip
-> Rolling back https://github.com/opensearch-project/k-NN/archive/refs/tags/2.17.0.0.zip
-> Rolled back https://github.com/opensearch-project/k-NN/archive/refs/tags/2.17.0.0.zip
Exception in thread "main" java.nio.file.NoSuchFileException: /opt/homebrew/Cellar/opensearch/2.13.0/libexec/plugins/.installing-2573063452617542771/plugin-descriptor.properties
	at java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:92)
	at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:106)
	at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111)
	at java.base/sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:261)
	at java.base/java.nio.file.Files.newByteChannel(Files.java:379)
	at java.base/java.nio.file.Files.newByteChannel(Files.java:431)
	at java.base/java.nio.file.spi.FileSystemProvider.newInputStream(FileSystemProvider.java:420)
	at java.base/java.nio.file.Files.newInputStream(Files.java:159)
	at org.opensearch.plugins.PluginInfo.readFromProperties(PluginInfo.java:258)
	at org.opensearch.plugins.InstallPluginCommand.loadPluginInfo(InstallPluginCommand.java:815)
	at org.opensearch.plugins.InstallPluginCommand.installPlugin(InstallPluginCommand.java:874)
	at org.opensearch.plugins.InstallPluginCommand.execute(InstallPluginCommand.java:276)
	at org.opensearch.plugins.InstallPluginCommand.execute(InstallPluginCommand.java:250)
	at org.opensearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:104)
	at org.opensearch.cli.Command.mainWithoutErrorHandling(Command.java:138)
	at org.opensearch.cli.MultiCommand.execute(MultiCommand.java:104)
	at org.opensearch.cli.Command.mainWithoutErrorHandling(Command.java:138)
	at org.opensearch.cli.Command.main(Command.java:101)
	at org.opensearch.plugins.PluginCli.main(PluginCli.java:60)

[jmazanec15]

@opensearch-project/admin I didnt realize installing from opensearch-plugin was supported for distro plugins. Could this be moved to opensearch-build repo for onboarding k-NN?

[peterzhuamazon]

Homebrew currently only have core I believe and it is barebone.
We didnt officially announce any macOS bundle yet.
Only a barebone core in core repo on homebrew, and snapshot core tar artifact with direct download.

Thanks.

[peterzhuamazon]

Plus, we do not support knn on macOS yet.
As the code is native and only support linux and windows afaik.

@jmazanec15 can correct me on that one. Thanks.

[gaiksaya]

Hi @Petercopter ,

We do not support macos distribution yet. See the supported distributions on the download page https://opensearch.org/downloads.html
We do have issues open for macos and homebrew support for future enhancements.