-
Notifications
You must be signed in to change notification settings - Fork 11
Desktop Install
sudo apt install python3 python3-pip openjdk-11-jre xdg-utils
pip3 install setuptools wheel
- If
openjdk-11-jre
is not available,openjdk-8-jre
will work. Versions of Java over 11 may have difficulties working with Spark. - If
xdg-utils
is not available in your distribution, you may get an error when launching vizier and will need to manually open the provided URL in a browser, but it is not critical.
For best results install Java JDK-11. If you have a later JDK installed, Apache Arrow support may not work properly.
brew install python
pip3 install setuptools wheel
sudo port install py39-pip
pip3 install setuptools wheel
Enable Windows Subsystem for Linux
sudo apt install python3 openjdk-11-jre-headless
ln -s /usr/bin/python3 /usr/local/bin/python
curl https://bootstrap.pypa.io/get-pip.py -o get-pip.py
python get-pip.py
Note: WSL2 does not make it easy to access servers running in the Linux subsystem from your desktop web browser. We have yet to find a consistent way to provide a frontend for windows users running WSL2. A reliable workaround has been to install a web browser within WSL itself. For example, sudo apt install firefox
.
Using coursier
coursier install vizier --channel https://vizierdb.info/coursier.json
You may need to add your user bin directory (typically ~/.local/bin
) to your PATH
environment variable
- Download the latest Vizier release
- Make it runnable
cd ~/Downloads; chmod +x vizier
- Put it in your path
if [ -d /usr/local/bin ] ; then sudo cp vizier /usr/local/bin/vizier; else sudo cp vizier /usr/bin/vizier; fi
(The last line installs vizier into /usr/local/bin
if it exists and /usr/bin
otherwise. Adjust the last line as needed if you prefer your binaries elsewhere)
vizier
coursier uninstall vizier
rm -r ~/.cache/coursier
Recent versions of Java introduce significant security restrictions that break parts of Apache Spark, which Vizier uses for data processing. Notably, we see:
- Apache Arrow support in Python (i.e., Pandas/Vizier integration via
vizierdb.get_dataframe
) does not work in Java 9+ - Running on a v9+ JVM, Vizier dumps out an
IllegalArgumentException
. This is just a warning, you can continue to use Vizier normally.
If necessary, you can download Java JRE 8 from here. Note that Java does allow you to have multiple JREs installed at the same time by setting the JAVA_HOME
environment variable.
Spark has limited support for Java JRE 9 or later. This message is only a warning and can usually be ignored, however see above as to why we do not support Java 11.
WSL2 runs a separate VM that is NAT-bridged to the main windows environment. See here for a possible workaround (make sure to include port 5050
in the list in the script).
Our users have reported that a more stable workaround is simply to install a web browser (e.g., sudo apt install firefox
) within the Ubuntu VM itself.