GitHub - 00arpit00/Crawler-Scraper

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
Readme.txt		Readme.txt
Readme.txt~		Readme.txt~
copyy.py		copyy.py
internship.py		internship.py
output.txt		output.txt
output1.txt		output1.txt
output10.txt		output10.txt
output11.txt		output11.txt
output2.txt		output2.txt
output3.txt		output3.txt
output4.txt		output4.txt
output5.txt		output5.txt
output6.txt		output6.txt
output7.txt		output7.txt
output8.txt		output8.txt
output9.txt		output9.txt

Repository files navigation

I have integrated a crawler with the web scraper so that the data of every model of the car is downloaded.

To run the script goto the desired folder and type on terminal the following command
python3 internship.py


Output-
Along with the generated files for each car the url will also be printed on the terminal.

Make sure the following packets are installed
1. requests module
2. beautifulSoup