Arxiv-Spider

This is a spider (or scrawl) to download papers in computer science area in arxiv.org. The paper will be used in our prp project.

How to Use It

First,ensure you have installed python3 in your computer,then download the source code from github:

$ git clone https://github.com/cjqw/arxiv-spider ~/arxiv-spider

Change the first line to specify your python3 path. Run the program directly and it will download 10 papers by default.

$ chmod a+x spider.py
$ ./spider.py

To doanload more papers, change the value of max_pdf to whatever you want.