Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Getting error in Instagram after few pics are downloaded. #1128

Closed
junomarian opened this issue Nov 24, 2020 · 4 comments
Closed

Getting error in Instagram after few pics are downloaded. #1128

junomarian opened this issue Nov 24, 2020 · 4 comments

Comments

@junomarian
Copy link

junomarian commented Nov 24, 2020

There are around 1000 pics in account.
Error: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
First error happened after 65 images downloaded
then I retired another day 105 images downloaded and again error. Is Instagram limiting bulk download from one IP?

@lihuelworks
Copy link

I think so. Happened to me when downloading my saved posts, and my account was blocked (requesting new password and all) because of it.

This might suck, but if you are downloading from your Saved, you might want to use the archive option (setting it up on your config). This way, you can cancel manually when reaching +65 images, then start again. The images that were already downloaded will be skipped.

@Vrihub
Copy link
Contributor

Vrihub commented Nov 27, 2020

It seems that since mid-November instagram really tightened their rate-control limits, now it redirects to the login page after ~100 requests, while before it was possible to do hundreds before being redirected to the login page (and for some kind of requests there were actually no limits).

I think so. Happened to me when downloading my saved posts, and my account was blocked

Ouch. Can anyone else confirm that the new limits kick in even when logging in? This would really be bad news...

@mikf
Copy link
Owner

mikf commented Nov 27, 2020

Can anyone else confirm that the new limits kick in even when logging in?

#1113

For right now, I'd recommend using a really high delay (>= 10s) between downloads and other HTTP requests with sleep and sleep-request: #1113 (comment)

mikf added a commit that referenced this issue Dec 3, 2020
(#1113, #1122, #1128, #1130, #1149)

Rely on the results of GraphQL queries instead of requesting data
for each post separately via '/p/<shortcode>/?__a=1'.

This might result in some missing metadata, and there might be some
issues for '/channel/' and '/saved/' URLs, but at least downloading
from the regular post listings should work without issues and without
getting users blocked/banned.

TODO: reimplement support for stories
@mikf
Copy link
Owner

mikf commented Dec 3, 2020

Should be fixed with 447488f (See #1149 (comment))

@mikf mikf closed this as completed Dec 3, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants