Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Kemono] Problems with the site's new API. #6780

Open
Gromily4 opened this issue Jan 6, 2025 · 3 comments
Open

[Kemono] Problems with the site's new API. #6780

Gromily4 opened this issue Jan 6, 2025 · 3 comments
Labels
external-issue

Comments

@Gromily4
Copy link

Gromily4 commented Jan 6, 2025 •
edited
Loading

When trying to download updated data from the site, the problem occurs that the application does not see the updates. https://kemono.su/patreon/user/683277 it downloads only from https://kemono.su/patreon/user/683277/post/118839799, but the beginning of https://kemono.su/patreon/user/683277/post/119238309.

If you specify a specific page, the download happens.

If you give a list of specific pages, it downloads, if you don't specify them, it ignores them.

z:\gallery-dl>g https://kemono.su/patreon/user/683277 --verb
[gallery-dl][debug] Version 1.28.3:2025.01.04 - Executable (dev/windows)
[gallery-dl][debug] Python 3.13.1 - Windows-10-10.0.19045-SP0
[gallery-dl][debug] requests 2.32.3 - urllib3 2.3.0
[gallery-dl][debug] Configuration Files ['z:\\gallery-dl\\gallery-dl.conf']
[gallery-dl][debug] Starting DownloadJob for 'https://kemono.su/patreon/user/683277'
[kemonoparty][debug] Using KemonopartyUserExtractor for 'https://kemono.su/patreon/user/683277'
[cookies][debug] Extracting cookies from C:\Users\Den\AppData\Roaming\Mozilla\Firefox\Profiles\a18rl9dh.default-nightly\cookies.sqlite
[cookies][debug] Only loading cookies not belonging to any container
[cookies][info] Extracted 1220 cookies from Firefox
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): kemono.su:443
[urllib3.connectionpool][debug] https://kemono.su:443 "GET /api/v1/patreon/user/683277/profile HTTP/1.1" 200 154
[urllib3.connectionpool][debug] https://kemono.su:443 "GET /api/v1/patreon/user/683277?o=0 HTTP/1.1" 200 40894
[kemonoparty][debug] Skipping /fb/61/fb618751eda221fd3327b2a2ec4ac1392d23ae76b1155d128167c0612e3aa519.jpg (duplicate)
[kemonoparty][debug] Active postprocessor modules: [MetadataPP]
.\gallery-dl\kemonoparty\patreon\683277 - BaronEngel\118839799_Last Stream of 2024 tonight 12_28_24_01_ 2024 Streaming Tonight.jpg
[kemonoparty][debug] Skipping /67/5c/675c95d7525c884cd7b24bfd5e8fb6af994dd42094c76034411fb798aa7a8c46.jpg (duplicate)
.\gallery-dl\kemonoparty\patreon\683277 - BaronEngel\118782993_Ask Not_01_Ask Not.jpg
[kemonoparty][debug] Skipping /55/69/55698aba8a31dfffdbe176312cd2c946a320750987a3e535d89401c2504b89de.jpg (duplicate)
.\gallery-dl\kemonoparty\patreon\683277 - BaronEngel\118733492_Rouge the Bat study drawings_01_Rouge the Bat studies.jpg
[kemonoparty][debug] Skipping /58/f2/58f2051c9e4bc5d8e18aa9d2f723314b545270d21e87b36abf38c17d142e0bb9.jpg (duplicate)
.\gallery-dl\kemonoparty\patreon\683277 - BaronEngel\118678090_End of year stream 12_28_24_01_chibi ponies.jpg
[kemonoparty][debug] Skipping /a2/da/a2da5f4c0e3bb3762ff00642d7a73388405fbf4258483bb0e6074dbfdd23d18c.jpg (duplicate)
.\gallery-dl\kemonoparty\patreon\683277 - BaronEngel\118570851_Out of Control_01_Out Of Control.jpg
@Hrxn
Copy link
Contributor

Hrxn commented Jan 6, 2025

I.. don't follow. What is the verbose log supposed to show?

@Gromily4
Copy link
Author

Gromily4 commented Jan 6, 2025 •
edited
Loading

I.. don't follow. What is the verbose log supposed to show?

posts are not seen until a certain time. in order to see, it takes up to a day, or even more, although in the browser these posts are available.

z:\gallery-dl>g https://kemono.su/patreon/user/57918587
[cookies][info] Extracted 1220 cookies from Firefox
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\118811913_Mocha Latte_01_christmas mocha latte.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\118575797_Latte_01_christmas latte.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\118575797_Latte_02_christmas latte nude.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\118178010_Mocha_01_mocha 18.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\117965896_Latte_01_latte 29.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\117599589_It's a Goth Christmas_01_goth christmas.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\117587796_Goth Christmas _01_goth christmas.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\117540376_Latte WIP _01_latte 29.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\116986252_Date Night Frankie_01_frankie 17.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\116986252_Date Night Frankie_02_frankie 17 nude.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\116861572_Frankie WIP _01_frankie 17.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\116736881_Frankie_01_frankie doodles.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\116722914_Frankie WIP doodles_ _01_frankie doodles.jpg

z:\gallery-dl>g https://kemono.su/patreon/user/57918587 --verb
[gallery-dl][debug] Version 1.28.3:2025.01.04 - Executable (dev/windows)
[gallery-dl][debug] Python 3.13.1 - Windows-10-10.0.19045-SP0
[gallery-dl][debug] requests 2.32.3 - urllib3 2.3.0
[gallery-dl][debug] Configuration Files ['z:\\gallery-dl\\gallery-dl.conf']
[gallery-dl][debug] Starting DownloadJob for 'https://kemono.su/patreon/user/57918587'
[kemonoparty][debug] Using KemonopartyUserExtractor for 'https://kemono.su/patreon/user/57918587'
[cookies][debug] Extracting cookies from C:\Users\Den\AppData\Roaming\Mozilla\Firefox\Profiles\a18rl9dh.default-nightly\cookies.sqlite
[cookies][debug] Only loading cookies not belonging to any container
[cookies][info] Extracted 1220 cookies from Firefox
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): kemono.su:443
[urllib3.connectionpool][debug] https://kemono.su:443 "GET /api/v1/patreon/user/57918587/profile HTTP/1.1" 200 152
[urllib3.connectionpool][debug] https://kemono.su:443 "GET /api/v1/patreon/user/57918587?o=0 HTTP/1.1" 200 7512
[kemonoparty][debug] Skipping /f2/28/f228557823ae2159097ddab64c6814837ec3db3cea39cf5122f19a00f5b7c951.jpg (duplicate)
[kemonoparty][debug] Active postprocessor modules: [MetadataPP]
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\119258724_Cowkini Fauna 2_01_cowkini fauna 2.jpg
[kemonoparty][debug] Skipping /06/37/06374d4610fa18766e58539a45f6a68c09deeaba0d436f90c6254aa400a80ea6.jpg (duplicate)
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\119251467_Cowkini Fauna_01_cowkini fauna.jpg
[kemonoparty][debug] Skipping /6f/2c/6f2cdea590ab444f2e9cce64cb768b48540e0b0348731dc44f68045a1f294f3b.jpg (duplicate)
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\119192977_Cowkini Fauna WIPs _01_cowkini fauna.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\119192977_Cowkini Fauna WIPs _02_cowkini fauna 2.jpg
[kemonoparty][debug] Skipping /3c/9a/3c9afe1b7d46f89dfb1ef54ceacbd1577f76e9cf0d34900bcf6974ce41af3692.jpg (duplicate)
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\119049262_Recent WIPS _01_latte 30.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\119049262_Recent WIPS _02_christmas latte 2.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\119049262_Recent WIPS _03_christmas mocha latte.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\119049262_Recent WIPS _04_mocha 18.jpg
[kemonoparty][debug] Skipping /01/4b/014b9c92ecdfcee26b3f88e93ab184444117bf02b6ac53bfa003de1b9cd291a9.jpg (duplicate)
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\119048298_Latte_01_latte 30.jpg
[kemonoparty][debug] Skipping /26/1f/261fb035377c77d477840fdd2df486035179625f2ce16c2f27bac8fb788b8f99.jpg (duplicate)
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\118811913_Mocha Latte_01_christmas mocha latte.jpg


z:\gallery-dl>g https://kemono.su/patreon/user/57918587
[cookies][info] Extracted 1220 cookies from Firefox
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\119258724_Cowkini Fauna 2_01_cowkini fauna 2.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\119251467_Cowkini Fauna_01_cowkini fauna.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\119192977_Cowkini Fauna WIPs _01_cowkini fauna.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\119192977_Cowkini Fauna WIPs _02_cowkini fauna 2.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\119049262_Recent WIPS _01_latte 30.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\119049262_Recent WIPS _02_christmas latte 2.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\119049262_Recent WIPS _03_christmas mocha latte.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\119049262_Recent WIPS _04_mocha 18.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\119048298_Latte_01_latte 30.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\118811913_Mocha Latte_01_christmas mocha latte.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\118575797_Latte_01_christmas latte.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\118575797_Latte_02_christmas latte nude.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\118178010_Mocha_01_mocha 18.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\117965896_Latte_01_latte 29.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\117599589_It's a Goth Christmas_01_goth christmas.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\117587796_Goth Christmas _01_goth christmas.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\117540376_Latte WIP _01_latte 29.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\116986252_Date Night Frankie_01_frankie 17.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\116986252_Date Night Frankie_02_frankie 17 nude.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\116861572_Frankie WIP _01_frankie 17.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\116736881_Frankie_01_frankie doodles.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\116722914_Frankie WIP doodles_ _01_frankie doodles.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\116520819_New merch! _01_FAUNA STICKER TEASER.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\116520819_New merch! _02_dandadan.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\116465634_Goth Fauna Titjob_01_goth fauna titjob.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\116465634_Goth Fauna Titjob_02_goth fauna titjob 1.jpg
.\gallery-dl\kemonoparty\patreon\57918587 - Klimspree\116410840_Goth Fauna titjob WIP _01_goth fauna titjob.jpg

first run only sees 118811913_Mocha Latte_01_christmas mocha latte.jpg

running with the --verb parameter sees the initial post 119258724_Cowkini Fauna 2_01_cowkini fauna 2.jpg

started to see without --verb the initial post 119258724_Cowkini Fauna 2_01_cowkini fauna 2.jpg

but it doesn't always work

There is also a problem, if you specify a specific page, then sometimes there is a re-download, although the files exist, sometimes skips it.

@a84r7a3rga76fg
Copy link

Kemono is just... bad. Only they can fix the API.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
external-issue
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@mikf @Hrxn @Gromily4 @a84r7a3rga76fg