Error when scraping captions

[joaanna]

Hey, so far I crawled followers smoothly, but I have 2 issues:

1. I get this when I try to crawl the captions
   python instagramcrawler.py -d data -q 'viralnova365' -c -n 10
   dir_prefix: data, query: viralnova365, crawl_type: photos, number: 10, caption: True
   posts: 1660, number: 10
   Scraping photo links...
   Number of photo_links: 25
   Scraping captions...
   Traceback (most recent call last):
   File "instagramcrawler.py", line 297, in
   main()
   File "instagramcrawler.py", line 293, in main
   caption=args.caption)
   File "instagramcrawler.py", line 85, in crawl
   self.click_and_scrape_captions(number)
   File "instagramcrawler.py", line 161, in click_and_scrape_captions
   FIREFOX_FIRST_POST_PATH).click()
   File "/InstagramCrawler/crawl/lib/python3.4/site-packages/selenium/webdriver/remote/webdriver.py", line 313, in find_element_by_xpath
   return self.find_element(by=By.XPATH, value=xpath)
   File "InstagramCrawler/crawl/lib/python3.4/site-packages/selenium/webdriver/remote/webdriver.py", line 791, in find_element
   'value': value})['value']
   File 'InstagramCrawler/crawl/lib/python3.4/site-packages/selenium/webdriver/remote/webdriver.py", line 256, in execute
   self.error_handler.check_response(response)
   File "InstagramCrawler/crawl/lib/python3.4/site-packages/selenium/webdriver/remote/errorhandler.py", line 194, in check_response
   raise exception_class(message, screen, stacktrace)
   selenium.common.exceptions.NoSuchElementException: Message: Unable to locate element: //a[contains(@Class, '_8mlbc _vbtk2 _t5r8b')]
2. also I would like to crawl all the images, but it never downloades the number specifed by -n, do you have any suggestions?

[tzuhsial]

Hi @joaanna ,
Thank you for telling me!
I'll look into this when I have time...

[tzuhsial]

@joaanna
I think I fixed the path to caption, that makes captions crawlable now.
(Guess I'll have to do this everytime whenever Instagram updates)

And about the number issue,
I am still looking for a robust way to detect if new posts are loaded.
Any help is appreciated!

[anfiallos]

Hi. I have the same problem. Error with values on label.
FIREFOX_FIRST_POST_PATH
Any suggestion please?

[anakmalank]

hi, i got this problem too.
selenium.common.exceptions.NoSuchElementException: Message: Unable to locate element: //div[contains(@Class, '_8mlbc _vbtk2 _t5r8b')]