allnpm

Graph generator of entire npm registry. See actual visualizations here:

3D NPM Universe

2D NPM Universe

Generating for 3D

This is instructions how to generate data for 3D visualization

1. Download npm metadata using downloadGraph.sh file. If you don't have wget simply save response to byField file. I do not list url directly here, since response is huge (~124MB).
2. Convert response to graph: node convertToGraph.js byField > graph.out
3. Run 3D layouter: node layout3d.js graph.out. This will take you a while. Layouter saves each 5th iteration into a .pos3d file.
4. Once you get to 100.pos3d (500 iterations, takes several hours) you can cancel layouter (ctrl + c).
5. Produce data files by running node convertToBinary.js ./100.pos3d graph.out
6. Produced files should be placed into src/data of allnpmviz3d

Generating for 2D

This is instructions how to generate data for 2D visualization

1. Download npm metadata using downloadGraph.sh file. If you don't have wget simply save response to byField file. I do not list url directly here, since response is huge (~124MB).
2. Convert response to graph: node convertToGraph.js byField > graph.out
3. Run layouter: node layout.js graph.out. This will take you a while. Layouter saves each 60th iteration into a .pos file.
4. Once you get 100-200 iterations saved (takes approximately 3-4 hours) you can cancel layouter (ctrl + c).
5. Flatten the graph into data file: node flatten.js byField 100.pos > graph.js

Now graph.js contains information about graph nodes/positions. Each element in the array represents a node:

{"id":"pkgName","pos":{"x":-63,"y":681},"a":"Author","d":[dependency1, dependency2, ...]}

Note: format of 2D is currently incompatible with 3D.

license

MIT