- The Protocol Labs Metrics Group is doing highly relevant work in defining and collecting metrics https://github.com/protocol/metrics
| Venue | Year | Code | Data | |
|---|---|---|---|---|
| Mapping the Interplanetary Filesystem. | IFIP Networking Conference | 2020 | Yes | No |
| Crawling the IPFS Network. | IFIP Networking Conference | 2020 | Yes | No |
| Measuring Decentralized Video Streaming: A Case Study of DTube | IFIP Networking Conference | 2020 | Yes | Yes |
| Monitoring Data Requests in Decentralized Data Storage Systems: A Case Study of IPFS | ICDCS | 2022 | No | On Request |
| Design and evaluation of IPFS: a storage layer for the decentralized web | SIGCOMM | 2022 | Probably | Probably |
| Tool | Description | Languages | Status | Documentation | Working |
|---|---|---|---|---|---|
| vyzo/ipfs-crawl | A simple crawler for diagnosing connectivity issues in the ipfs network | Go | Inactive | Installation only | No. Opened an issue. Author commented that it's not maintained anymore and should be ported to go mod to work. |
| dzhelezov/ipfs-crawler | A simple ifps crawler to estimate the IPFS network size and node churn. | Go | Active | Basic | Yes. It outputs the peer IDs that need to be mapped to IP addresses with follow-up queries. |
| trudi-group/ipfs-crawler | Crawler for the IPFS network, code for the paper "Mapping the Interplanetary Filesystem". Also holds scripts to evaluate the obtained data and make similar plots as in the paper. | Go, Python, R | Active | Extensive | Not successfully. The crawler finishes immediately with empty output. Opened an issue. Now fixed. |
| manuelpolzhofer/ipfs-mon | A crawler for IPFS nodes to estimate the number of nodes and daily churn in IPFS | Go | Active | Installation + Usage | Yes, but outputs only PeerID |
| BasitAwan/IPFS-Crawler | This crawler crawls the IPFS to get a snapshot of the peers in the network | Go | Active | Basic logic | No, seems to be stuck and produces no output |
| Tool | Description | Language | Status |
|---|---|---|---|
| IPFS Metrics Exporter Plugin | Kubo (go-ipfs) plugin to export additional metrics from large, well-connected monitoring nodes. Exports Bitswap traffic in real-time and metrics via Prometheus. Used for the ICDCS monitoring paper. | Go | Active |
| IPFS Public Gateway Finder | Finds overlay addresses of public IPFS gateways through a traffic-correlation attack on their HTTP side. | Rust | Active |
| Bitswap Monitoring Client | Connects to multiple monitors running the Metric Exporter Plugin and analyzes Bitswap traffic in real-time. Exports metrics via Prometheus. | Rust | Active |
| Dashboard | Description | Code | Data |
|---|---|---|---|
| IPFS Monitoring Metrics | Various metrics extracted from IPFS nodes with unlimited connection capacity and the Bitswap messages they receive. Uses the monitoring plugin and associated client. | Not yet :) | On Request |
| Venue | Year | Code | Data | |
|---|---|---|---|---|
| Characterization of BitTorrent swarms and their distribution in the Internet" | Elsevier Computer Networks | 2011 | No | No |
| The bittorrent peer collector problem. | IFIP IM | 2017 | No | No |
| A measurement study on the topologies of BitTorrent networks. | IEEE Journal on Selected Areas in Communications | 2013 | No | No |
| Analysis of topology dynamics for unstructured P2P networks. | Elsevier Computer Communications | 2016 | No | No |
| Big torrent measurement: A country-, network-, and content-centric analysis of video sharing in BitTorrent. | IEEE NOMS | 2018 | No | No |
| Inference on the Network Evolution in BitTorrent Mainline DHT. | arxiv | 2014 | No | No |
| Measuring the bittorrent ecosystem: Techniques, tips, and tricks. | IEEE Communications Magazine | 2011 | No | No |
| Crawling BitTorrent DHTs for Fun and Profit. | USENIX WOOT | 2010 | No (dead link) | No |
| Tool | Description | Languages | Status | Documentation | Working |
|---|---|---|---|---|---|
| mmathys/dht-crawler | Minimal BitTorrent DHT-Protocol crawler | Javascript | Inactive | Good (in parent repo) | ? |
| node-dht-peer-crawler | A fast and stable DHT crawler. | NodeJS | Inactive | Good | ? |
| polcak/DHT-crawler | Implementation of peer finder as part of Bachelor work. | Python 3, Shell | Inactive | Excellent | ? |
| BitInsight | Bittorrent Network Overview through Infohash Indexing, Metadata and IP visualisations of the DHT network | NodeJS | Active | Good | ? |
From the project description:
Bitnodes is currently being developed to estimate the size of the Bitcoin network by finding all the reachable nodes in the network. The current methodology involves sending getaddr messages recursively to find all the reachable nodes in the network, starting from a set of seed nodes. Bitnodes uses Bitcoin protocol version 70001 (i.e. >= /Satoshi:0.8.x/), so nodes running an older protocol version will be skipped. The crawler implementation in Python is available from GitHub (ayeowch/bitnodes) and the crawler deployment is documented in Provisioning Bitcoin Network Crawler.
https://github.com/agamble/btc-crawler
A Bitcoin network crawler in Go. Hasn't been maintained for the past 5 years.
A more recent fork: https://github.com/Kleissner/btc-crawler
-
Kim, Seoung Kyun, Zane Ma, Siddharth Murali, Joshua Mason, Andrew Miller, and Michael Bailey. "Measuring ethereum network peers." In Proceedings of the Internet Measurement Conference 2018, pp. 91-104. 2018.
-
Gao, Yue, Jinqiao Shi, Xuebin Wang, Qingfeng Tan, Can Zhao, and Zelin Yin. "Topology Measurement and Analysis on Ethereum P2P Network." In 2019 IEEE Symposium on Computers and Communications (ISCC), pp. 1-7. IEEE, 2019.