This project scrapes cryptocurrency data from CoinMarketCap using Django Rest Framework, Celery, and Selenium.
/api/taskmanager/start_scraping
[POST] - Starts a scraping job./api/taskmanager/scraping_status/<job_id>
[GET] - Checks the status of a scraping job.
- Install dependencies:
pip install -r requirements.txt
- Run Redis server:
redis-server
- Run Celery worker:
celery -A crypto_scraper worker -l info
- Run Django server:
python manage.py runserver