Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

added section on user directory #161

Merged
merged 9 commits into from
Jul 1, 2024
14 changes: 14 additions & 0 deletions book/guides/faq.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,3 +21,17 @@ If you **are** member of one of the github teams, ask them to try the following
- \[ \] Try a different browser
- \[ \] Restart the computer
- If these steps do not work, please reach out to the [](support.data_compute_team).

(faq.usr_dir_usage_warning)=

## I received a warning about space on my User Directory

If you get a Hub Usage Alert email, this means you are violating the User Directory storage limit (to learn why this limit exists, see read about [User Directories](hub.guide.data.user_dir)). Remember that user directories are for scripts and notebooks not datasets! Users who persistently violate hub usage policies may temporarily get reduced cloud access.

**Troubleshooting**

- To see which files and directories are taking up the bulk of your storage, run `du -h --max-depth=1 ~/ | sort -h` in Terminal. It will likely reveal cached files and small/medium size data files that can be removed without disrupting typical usage.
- Delete cached files, ipython checkpoints, and any other unwanted files.
- If you still require more storage, it is likely that you are storing downloaded data in your user directory. We recommend storing data in a LEAP [cloud bucket](https://leap-stc.github.io/leap-pangeo/jupyterhub.html#leap-pangeo-cloud-storage-buckets) or data catalog. For more information, please consult our [Hub Data Guide](guide.hub.data) and [Data Policy](./../policies/data_policy).

Our goal is to accomodate all community members and thus we are happy to assist users in relocating data. If you have any concerns, please reach out to the [](support.data_compute_team).
4 changes: 2 additions & 2 deletions book/leap-pangeo/jupyterhub.md
Original file line number Diff line number Diff line change
Expand Up @@ -97,11 +97,11 @@ As shown in the picture above, every user will see `'/home/jovyan'` as their roo
The primary purpose of this directory is to store small files, like github repositories and other code.

:::\{warning}
Please do not store large files in your user directory `/home/jovyan`. Your home directory is intended only for notebooks, analysis scripts, and small datasets (\< 1 GB). It is not an appropriate place to store large datasets.
To accommodate the expanding LEAP community, the data and compute team has instituted a storage quota on individual user directories `/home/jovyan`. Your home directory is intended only for notebooks, analysis scripts, and small datasets (\< 1 GB). It is not an appropriate place to store large datasets. Unlike the cloud buckets, these directories use an underlying storage with a rigid limit. If a single user fills up the space, the Hub crashes for everyone. We recommend users use less than 25GB and enforce a hard limit of 50GB. **Users who persistently violate the limit may temporarily get reduced cloud access**.

To check how much space you are using in your home directory open a terminal window on the hub and run `du -h --max-depth=1 ~/ | sort -h`.

If you want to save larger files for your work use our [](hub.data.buckets) and consult out [Hub Data Guide](guide.hub.data)
If you want to save larger files for your work use our [](hub.data.buckets) and consult our [Hub Data Guide](guide.hub.data). See the [FAQs](faq.usr_dir_usage_warning) for guidance on reducing storage.
:::

(hub.data.buckets)=
Expand Down
Loading