Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

README: Update training data URL #135

Merged
merged 3 commits into from
Oct 10, 2020
Merged

README: Update training data URL #135

merged 3 commits into from
Oct 10, 2020

Conversation

nottatdat
Copy link
Contributor

As per #132, training data URL in README.md is outdated.

README.md Outdated
@@ -8,10 +8,11 @@ Install the requirements under `tf/requirements.txt`. And call `./init.sh` to co

## Data preparation

In order to start a training session you first need to download trainingdata from http://lczero.org/training_data. This data is packed in tar.gz balls each containing 10'000 games or chunks as we call them. Preparing data requires the following steps:
In order to start a training session you first need to download trainingdata from https://storage.lczero.org/files/training_data/. This data is packed in tar.gz balls each containing 10'000 games or chunks as we call them. Preparing data requires the following steps:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This part is out of date as well. We have tars of compressed training files that are one hours worth of training data each.
Since they are already compressed inside the tar the instructions below are also wrong, there is no need to run parallel gzip.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, has just updated the instruction.

README.md Outdated
@@ -8,15 +8,13 @@ Install the requirements under `tf/requirements.txt`. And call `./init.sh` to co

## Data preparation

In order to start a training session you first need to download trainingdata from http://lczero.org/training_data. This data is packed in tar.gz balls each containing 10'000 games or chunks as we call them. Preparing data requires the following steps:
In order to start a training session you first need to download training data from https://storage.lczero.org/files/training_data/. This data is packed in a tar file each contains several chunks, where each chunk is one hours worth of training data. Preparing data requires the following steps:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

chunks are games - each tar file contains an hours worth of chunks.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for your clarification!

@Tilps Tilps merged commit 43ecf9e into LeelaChessZero:master Oct 10, 2020
hans-ekbrand added a commit to hans-ekbrand/lczero-training that referenced this pull request Apr 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants