Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

images are not downloaded #155

Closed
milahu opened this issue Jun 30, 2023 · 4 comments · Fixed by #163
Closed

images are not downloaded #155

milahu opened this issue Jun 30, 2023 · 4 comments · Fixed by #163

Comments

@milahu
Copy link

milahu commented Jun 30, 2023

dumpgenerator --images is not downloading images, it downloads only the *.desc files

it works with the old version WikiTeam#331 which downloads *.desc files and image files

@yzqzss
Copy link

yzqzss commented Jul 1, 2023

Please provide the command you ran (with url) and more info(errors log, stdout, etc.).

@elsiehupp

This comment was marked as off-topic.

@robkam

This comment was marked as off-topic.

@milahu
Copy link
Author

milahu commented Jul 3, 2023

version 3: eb1529a (mediawiki-scraper.nix)

version 2: WikiTeam@54d9d80 (mediawiki-scraper-2.nix)

same command for both versions:

dumptime=$(date +%F.%H-%M-%S)

path=nixos.wiki.$dumptime

dumpgenerator \
https://nixos.wiki/ \
--api https://nixos.wiki/api.php \
--index https://nixos.wiki/index.php \
--xml \
--images \
--path $path \
2>&1 | tee -a dumpgenerator.$dumptime.log

dumpgenerator.log.v3.fail.gz
files.v3.fail.txt.gz

dumpgenerator.log.v2.ok.gz
files.v2.ok.txt.gz (the html folder is not by dumpgenerator)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants