Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bash create_datasets_from_start.sh Throws 404 error for downloading wikipedia dataset #16

Open
ssk2573 opened this issue Jun 7, 2024 · 0 comments

Comments

@ssk2573
Copy link

ssk2573 commented Jun 7, 2024

bash create_datasets_from_start.sh throws error downloading datasets when https://dumps.wikimedia.org/enwiki/latest/enwiki-latest-pages-articles.xml.bz2 is updating (shows 404 error).
On top of that in order to change that, you cannot just change it in WikiDownloader.py, it is hardcoded way back in /opt/conda/lib/python3.8/site-packages/lddl/download/wikipedia.py. I had to change in that file with another available dataset.
Used dataset: https://dumps.wikimedia.your.org/enwiki/20220820/enwiki-20220820-pages-articles.xml.bz2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant