ma-pony
Follow
Scraper
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架
Fast, easy and reliable testing for anything that runs in a browser.
Python version of the Playwright testing and automation library.
Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
JavaScript API for Chrome and Firefox
Open Source record and playback test automation for the web.
🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单，功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬虫解决不同场景的需求。且支持断点续爬、监控报警、浏览器渲染、海量数据去重等功能。更有功能强大的爬虫管理系统feaplat为其提…
A curated list of awesome packages, articles, and other cool resources from the Scrapy community.
Extends Selenium's Python bindings to give you the ability to inspect requests made by the browser.
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, an…
Cross-platform automation framework for all kinds of apps, built on top of the W3C WebDriver protocol
UI Automation Framework for Games and Apps
Gray box end-to-end testing and automation framework for mobile apps
Automation&Workflow JavaScript IDE on Android(安卓平台上的JavaScript编程IDE)
Next-gen browser and mobile automation test framework for Node.js
Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️♂️ when scraping the web?
各类验证码（滑块、点选、手势）纯 js 破解 腾讯 | Vaptcha | 今日头条 | Geetest | 极验全家桶 | 美团 | 安居客 | 58同城 | 京东 | 易盾 | 云片 | 数美 | 携程 | 搜狐 | 虎牙 | 爱奇艺 | 完美世界 | 同盾 | 螺丝帽 | 猎聘 | 蘑菇街 | 大街 | 云闪付 | 东方财富
Scrapy Extension for monitoring spiders execution.
🎭 Playwright integration for Scrapy
Android real-time display control software
Awesome multilingual OCR toolkits based on PaddlePaddle (practical ultra lightweight OCR system, support 80+ languages recognition, provide data annotation and synthesis tools, support training and…
Capturing SSL/TLS plaintext without a CA certificate using eBPF. Supported on Linux/Android kernels for amd64/arm64.
Cross-platform download bilibili video desktop software, support windows, macOS, Linux