Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Duplicate Files #171

Open
PerseusRex opened this issue Dec 12, 2022 · 6 comments
Open

Duplicate Files #171

PerseusRex opened this issue Dec 12, 2022 · 6 comments

Comments

@PerseusRex
Copy link

PerseusRex commented Dec 12, 2022

When running the program for some creators it's downloading the same files again. I'm assuming hashes(?) have changed for those files because the names have changed, but is there a way to ignore files that have been already downloaded?

@Ovear
Copy link

Ovear commented Dec 12, 2022

--archive should be a option.

@PerseusRex
Copy link
Author

--archive should be a option.

I just want to make sure, the usual line i use is "python kemono-dl.py --cookies "kemono.party_cookies.txt" --from-file "user.txt" --extract-links" do I just add --archive to something like this "python kemono-dl.py --cookies "kemono.party_cookies.txt" --from-file "user.txt" --extract-links --archive "user.txt""?

@Ovear
Copy link

Ovear commented Dec 12, 2022

Use another file for --archive to record what this scripts already downloaded, like --archive archive_user.txt

@L4cache
Copy link

L4cache commented Dec 12, 2022

You can still use my fork for when creating archive list tho.
https://github.com/L4cache/kemono-dl#options-added-in-this-fork

@PerseusRex
Copy link
Author

You can still use my fork for when creating archive list tho. https://github.com/L4cache/kemono-dl#options-added-in-this-fork

Thank you, but just a little bit of help. I might be doing something wrong. I'm using this line:
python kemono-dl.py --cookies "kemono.party_cookies.txt" --from-file "user.txt"--dupe-check

but it keeps giving me this error:
Traceback (most recent call last):
File "kemono-dl.py", line 1, in
from src.main import main
File "L:\Kemono\kemono-dl-2022.04.27\src\main.py", line 15, in
from .logger import logger
File "L:\Kemono\kemono-dl-2022.04.27\src\logger.py", line 5, in
args = get_args()
File "L:\Kemono\kemono-dl-2022.04.27\src\args.py", line 204, in get_args
action=argparse.BooleanOptionalAction, default=False,
AttributeError: module 'argparse' has no attribute 'BooleanOptionalAction'

@L4cache
Copy link

L4cache commented Dec 13, 2022

You can still use my fork for when creating archive list tho. https://github.com/L4cache/kemono-dl#options-added-in-this-fork

Thank you, but just a little bit of help. I might be doing something wrong. I'm using this line: python kemono-dl.py --cookies "kemono.party_cookies.txt" --from-file "user.txt"--dupe-check

but it keeps giving me this error: Traceback (most recent call last): File "kemono-dl.py", line 1, in from src.main import main File "L:\Kemono\kemono-dl-2022.04.27\src\main.py", line 15, in from .logger import logger File "L:\Kemono\kemono-dl-2022.04.27\src\logger.py", line 5, in args = get_args() File "L:\Kemono\kemono-dl-2022.04.27\src\args.py", line 204, in get_args action=argparse.BooleanOptionalAction, default=False, AttributeError: module 'argparse' has no attribute 'BooleanOptionalAction'

This --[no-]something behavior was introduced in python 3.9, so you need 3.9+ to run it, or you can modify the code...
so i made this branch... not tested tho
https://github.com/L4cache/kemono-dl/tree/py3.9_minus

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants