[wip] Statically built Nix #56281

matthewbauer · 2019-02-24T07:48:43Z

Motivation for this change

This makes it possible to build Nix statically through pkgsStatic.nix. Needs a couple of patches to nix but otherwise works smoothly.

If you'd like to try it, you can just check out this branch and run:

nix-build -A pkgsStatic.nix

and wait a little bit. More targets are available here:

https://github.com/matthewbauer/static-nix

Alternatively, you can use my prebuilt binary at https://matthewbauer.us/nix. It is built for x86_64-linux and can be used on any system like this:

$ curl https://matthewbauer.us/nix | sh -s ...

For instance, on a linux system without nix installed, you can do this:

$ curl https://matthewbauer.us/nix | sh -s run --store $HOME/.cache/nix/store -f channel:nixpkgs-unstable hello -c hello
Hello World!

There are many uses cases where nix is unavailable and the above command can be extremely useful. It's a little slow still, but can be sped up by reusing the same --store value (such as $HOME/.cache/nix/store). Here is the time:

$ time (curl https://matthewbauer.us/nix | sh -s run --store $HOME/.cache/nix/store -f channel:nixpkgs-unstable hello -c hello)
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 5596k  100 5596k    0     0  2807k      0  0:00:01  0:00:01 --:--:-- 2807k
[2 copied (24.0 MiB), 35.5 MiB DL]
Hello, world!
( curl https://matthewbauer.us/nix | sh -s run --store $(mktemp -d) -f  hello)  3.39s user 3.52s system 70% cpu 9.757 total

ryantm · 2019-02-24T17:59:12Z

I tried following some of the examples in your blog post on my NixOS machine, and I get this error message:

[ryantm@laptop3:~]$ curl https://matthewbauer.us/nix | sh -s run --store $HOME/.cache/nix/store -f channel:nixpkgs-unstable hello -c hello
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 5596k  100 5596k    0     0  1408k      0  0:00:03  0:00:03 --:--:-- 1408k
error: getting status of '/nix/store/p492jkrs1q0nddjqghw5d5s5w7kgifda-nix-2.2-x86_64-unknown-linux-musl': No such file or directory
[ryantm@laptop3:~]$ nix=$(mktemp); \
>   curl https://matthewbauer.us/nix > $nix && \
>   chmod +x $nix && \
>   $nix run --store $HOME/.cache/nix/store -f channel:nixpkgs-unstable \
>   ranger -c ranger
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 5596k  100 5596k    0     0  5264k      0  0:00:01  0:00:01 --:--:-- 5269k
error: getting status of '/nix/store/p492jkrs1q0nddjqghw5d5s5w7kgifda-nix-2.2-x86_64-unknown-linux-musl': No such file or directory

jb55 · 2019-02-24T18:38:30Z

I'm getting the same error as @ryantm

matthewbauer · 2019-02-24T18:49:16Z

Thanks for the heads up. I had forgotten about those extra files needed. The updated binary at https://matthewbauer.us/nix should have a working copy.

For future reference, this is how it was built:

nix-build -A pkgsStatic.nix
mkdir -p nix
cp ./result/bin/nix nix/nix
cp -r ./result/share nix/share
cd nix
chmod 755 share/ share/nix/ share/nix/corepkgs/
rm -rf share/nix/sandbox
chmod 644 nix share/nix/corepkgs/*
chmod a+x nix
tar cfz nix.tar.gz nix share/
arx tmpx ./nix.tar.gz // './nix "$@"' > ./nix.sh
cp ./nix.sh ~/matthewbauer.github.io/nix

If you don't want to download/extract anything each time, you should run:

mkdir -p $HOME/bin
cd $HOME/bin
curl https://matthewbauer.us/nix > nix.sh
sh nix.sh --extract
mv dat/* .
rm -rf dat run env
export PATH=$HOME/bin
nix run ...

Install size is ~11M.

ryantm · 2019-02-24T18:56:23Z

Works now for me!

bhipple · 2019-02-24T19:41:24Z

pkgs/top-level/static.nix

+
+  curl = super.curl.override {
+    gssSupport = false;
+  };


I would imagine your target audience for this is users who are running and deploying on rootless "enterprise" environments such a RHEL or CentOS. It's worth noting that in many of these setups, kerberos is used extensively for all HTTP and git authentication, so if you could get it working in this static variant it'd probably be worthwhile.

Yeah this is an issue. libkrb5 doesn't have good way to link statically, however:

https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=439039

kerberos heimdal might support it though.

bhipple · 2019-02-24T19:44:47Z

pkgs/top-level/static.nix

+  };
+
+  nix = super.nix.overrideAttrs (_: {
+    NIX_LDFLAGS = "-lssl -lbrotlicommon -lssh2 -lz -lnghttp2 -lcrypto";


I think the right way to do this would be patching the pkg-config files to include these libraries in the Requires.private section, as is done in:

$ nix-build -A brotli.dev && cat result-dev/lib/pkgconfig/libbrotlidec.pc prefix=/nix/store/7i965pyrkqph3gwpfzswz35c6a1j1v5h-brotli-1.0.7 exec_prefix=/nix/store/7i965pyrkqph3gwpfzswz35c6a1j1v5h-brotli-1.0.7 libdir=/nix/store/iahrxydkznvf6z0q0hp0cp9nhrq1pkys-brotli-1.0.7-lib/lib includedir=/nix/store/1qcykjlmxvvzgvvnyzsz7yii794m5rjv-brotli-1.0.7-dev/include Name: libbrotlidec URL: https://github.com/google/brotli Description: Brotli decoder library Version: 1.0.7 Libs: -L${libdir} -lbrotlidec Requires.private: libbrotlicommon >= 1.0.2 Cflags: -I${includedir}

I haven't looked at this specific case too closely, but in general invoking pkgconfig --static <args> will also include the Requires.private sections for transitive link dependencies that are not needed in the dynamic variant.

For example, the libssl.pc has a Requires.private directive on libcrypto, which means you don't need to include -lcrypto on the linkline manually if you use pkgconfig --static ssl.

I think the issue was that all of these need to be propagated in static. static linking requires knowing where all of the needed libraries are.

edolstra · 2019-02-25T02:14:12Z

In principle this looks fine to me, but it clutters Nixpkgs with numerous patches and special-case attributes that are going to be a pain in the ass to maintain. Who is going to be responsible for maintaining those?

ryantm · 2019-02-25T03:11:12Z

Who is going to be responsible for maintaining those?

One possible part of the solution would be for @matthewbauer to add himself as a maintainer of these packages.

dtzWill · 2019-02-25T17:44:07Z

pkgs/development/libraries/boehm-gc/default.nix

+    name = "boehm-gc-7.6.0-sys_select.patch";
+    url = "https://gitweb.gentoo.org/proj/musl.git/plain/dev-libs/boehm-gc/files/boehm-gc-7.6.0-sys_select.patch?id=85b6a600996bdd71162b357e9ba93d8559342432";
+    sha256 = "1gydwlklvci30f5dpp5ccw2p2qpph5y41r55wx9idamjlq66fbb3";
+  }) ] ++


Is this still needed? It was explicitly removed in a recent-ish PR with the idea that this didn't hurt but didn't help, IIRC. Might be good to check.

dtzWill · 2019-02-25T17:45:12Z

pkgs/stdenv/adapters.nix

@@ -44,6 +44,7 @@ rec {
      then throw "Cannot build fully static binaries on Darwin/macOS"
      else stdenv'.mkDerivation (args // {
        NIX_CFLAGS_LINK = toString (args.NIX_CFLAGS_LINK or "") + " -static";
+        separateDebugInfo = false;


This doesn't seem right, why must this be disabled for static adapter?

Yeah maybe not... I was getting an issue that I thought was due to this but it might have been unrelated.

matthewbauer · 2019-02-25T18:35:27Z

Yeah i can do that. Lots of these are because of ad hoc configure scripts (no autotools, cmake, or meson). Other times static libs are not being installed correctly into prefix. All of these can probably be corrected with upstream patches though.

orivej · 2019-02-25T19:11:43Z

pkgs/development/libraries/aws-c-common/default.nix

@@ -13,6 +13,10 @@ stdenv.mkDerivation rec {

  nativeBuildInputs = [ cmake ];

+  postPatch = stdenv.lib.optionalString stdenv.hostPlatform.isMusl ''
+    sed -i "24ireturn()" cmake/AwsTestHarness.cmake


This is fragile. In general, a better approach is to generate a patch with diff -U1.

This breaks non-musl configure with:

CMake Error at tests/CMakeLists.txt:260 (target_compile_options): Cannot specify compile options for target "aws-c-common-tests" which is not built by this project.

Why does it work with musl?

You could try -DBUILD_TESTING=OFF instead.

Yeah it’s super broken. BUILD_TESTING doesn’t work at least

I see, BUILD_TESTING is not actually implemented. You could patch out add_subdirectory(tests) in the main CMakeLists.txt then.

illegalprime · 2019-03-02T00:51:27Z

This looks really cool, it would help people (me) run nix on ARM with limited memory / disk space (by downloading a static nix and loading some external disk space and setting the nix store inside there).
Is this the right derivation to build?

nix build -f . pkgsStatic.pkgsCross.aarch64-multiplatform.nix

matthewbauer · 2019-03-02T04:01:01Z

I don't think that will work - it will build a static toolchain and then cross compile with it. Ideally, you would pass these args to Nixpkgs:

nix build -f. \
  --arg crossSystem '{ config = "aarch64-unknown-linux-musl"; }' \
  --arg crossOverlays '[ (import ./pkgs/top-level/static.nix) ]'

But I don't think crossOverlays is exposed yet.

illegalprime · 2019-03-05T19:17:02Z

Thanks for this PR @matthewbauer ! After 220 derivations & a couple of days on my small ARM board, I've got a statically compiled armv7l nix!

nix-2.2-armv7l.tar.gz

I did have to edit the bash derivation though:

diff --git a/pkgs/shells/bash/4.4.nix b/pkgs/shells/bash/4.4.nix
index e5e33c7..a61801a 100644
--- a/pkgs/shells/bash/4.4.nix
+++ b/pkgs/shells/bash/4.4.nix
@@ -28,7 +28,7 @@ stdenv.mkDerivation rec {
     sha256 = "1jyz6snd63xjn6skk7za6psgidsd53k05cr3lksqybi0q6936syq";
   };
 
-  hardeningDisable = [ "format" ];
+  hardeningDisable = [ "format" ] ++ optional (stdenv.hostPlatform.libc == "musl") "pie";
 
   outputs = [ "out" "dev" "man" "doc" "info" ];

now I can run it but nix seems to ignore the --store argument (it tries to find /nix), maybe it can't setup the chroot and defaults to the normal store, but I have this:

$ zcat /proc/config.gz | egrep 'USER_NS|SECCOMP'
CONFIG_USER_NS=y
CONFIG_HAVE_ARCH_SECCOMP_FILTER=y
CONFIG_SECCOMP_FILTER=y
CONFIG_SECCOMP=y

$ sudo mkdir -p /nix/store

$ ./nix run --store ~/my-nix nixpkgs.nix nixpkgs.bashInteractive
error: getting status of '/nix/store/3azwf31ib816jq403qrymzw02hrlj5fk-nix-2.2-armv7l-unknown-linux-musleabihf': No such file or directory

$ ./nix show-config | grep '/nix/store'
build-hook = /nix/store/3azwf31ib816jq403qrymzw02hrlj5fk-nix-2.2-armv7l-unknown-linux-musleabihf/libexec/nix/build-remote
sandbox-paths = /bin/sh=/nix/store/l31h4is1irdw1zfld2qf7l0l4w98ylrh-busybox-1.30.1-armv7l-unknown-linux-musleabihf/bin/busybox

i'll keep poking around, thought i'd post the built binary here if it helps anyone

matthewbauer · 2019-03-05T19:51:24Z

You need to provide a Nix channel / file for it to use. So most likely you need something like this:

export NIX_DATA_DIR=$(nix-build '<nixpkgs>' -A nix)/share
./nix run --store ~/my-nix -f channel:nixpkgs-unstable nixpkgs.nix nixpkgs.bashInteractive

Both the --store and -f flags would be nice to provide defaults ofr.

NIX_DATA_DIR is needed to pick up some "booter" expressions in corepkgs. You can use the native Nix for this to avoid rebuliding.

illegalprime · 2019-03-05T22:35:38Z

@matthewbauer that worked! i'm currently building with a static nix in a custom nix-store 🎉 !
but in order to do that I did have to include these files in my root's /nix/store, even though there's no other nix files present on the system:

$ tree /nix/store
/nix/store
├── 3azwf31ib816jq403qrymzw02hrlj5fk-nix-2.2-armv7l-unknown-linux-musleabihf
│   └── libexec
│       └── nix
│           └── build-remote -> /home/debian/static-nix/bin/nix
└── l31h4is1irdw1zfld2qf7l0l4w98ylrh-busybox-1.30.1-armv7l-unknown-linux-musleabihf
    └── bin
        ├── ash
        ├── busybox
        └── sh

$ ls my-custom-nix-root/nix/store | wc -l
814

the files in my /nix/store also have incorrect permissions (they're writable) so it looks like it's just a hard-coded path in the static nix.

so, the static nix is fully portable except that it references those two paths.
maybe a unit test that checks that no buildInputs are runtime dependencies?

EDIT:
I think patching nix can solve it (might not be a great solution):

diff --git a/src/libstore/globals.cc b/src/libstore/globals.cc
index 1c2c0871..34a08756 100644
--- a/src/libstore/globals.cc
+++ b/src/libstore/globals.cc
@@ -64,7 +64,7 @@ Settings::Settings()
     }
 
 #if defined(__linux__) && defined(SANDBOX_SHELL)
-    sandboxPaths = tokenizeString<StringSet>("/bin/sh=" SANDBOX_SHELL);
+    sandboxPaths = tokenizeString<StringSet>("/bin/sh=" + getEnv("NIX_SANDBOX_SHELL", SANDBOX_SHELL));
 #endif
 
     allowedImpureHostPrefixes = tokenizeString<StringSet>(DEFAULT_ALLOWED_IMPURE_PREFIXES);

and then using NIX_LIBEXEC_DIR to point to the relative libexecdir

ppc64le and ppc64 are different targets in the configure script. We can’t use the same one. TODO: canonicalize similar ones based on qemu’s configure script.

Ericson2314 · 2019-04-17T19:02:03Z

pkgs/build-support/cc-wrapper/default.nix

@@ -295,6 +295,10 @@ stdenv.mkDerivation {
      hardening_unsupported_flags+=" stackprotector fortify"
    ''

+    + optionalString targetPlatform.isx86_32 ''
+      hardening_unsupported_flags+=" stackprotector"


This is temporary I assume?

Maybe... binutils and musl seemed to get stuck. I don't think anyone supports i686 very well any more.

that combination or in isolation? with targetPlatform.isx86_32 && targetPlatform.isMusl I'd be more comfortable with that.

matthewbauer · 2019-04-17T20:10:48Z

I have a repo that holds some scripts to build static nix here:

https://github.com/matthewbauer/static-nix

It makes it easy to cross build Nix to a few architectures like:

aarch64
armv6l
armv7a
powerpc64le
i486
i686

lib/systems/default.nix

@Ericson2314

thanks @Ericson2314

nixos-discourse · 2019-06-06T13:56:18Z

This pull request has been mentioned on Nix community. There might be relevant details there:

https://discourse.nixos.org/t/crosscompilation-to-musl32-problems/3110/3

domenkozar · 2019-09-29T09:22:36Z

I've polished a few commits from here and pushed to master to fix builds of bohemgc, brotli, and busybox.

What's left seems to be: curl, boost and openssl.

domenkozar · 2019-09-29T10:02:47Z

Fixed also curl, boost, opeensl and libsodium.

Last one standing before nix is nghttp2:

checking build system type... x86_64-pc-linux-gnu
checking host system type... x86_64-pc-linux-gnu
checking for grep that handles long lines and -e... (cached) /nix/store/6zcfsp4rkn7pyc04zy0jww3p5lfhvvh4-gnugrep-3.3/bin/grep
checking for egrep... /nix/store/6zcfsp4rkn7pyc04zy0jww3p5lfhvvh4-gnugrep-3.3/bin/grep -E
checking if OS is AIX (to define _ALL_SOURCE)... no
checking if _THREAD_SAFE is already defined... no
checking if _THREAD_SAFE is actually needed... no
checking if _THREAD_SAFE is onwards defined... no
checking if _REENTRANT is already defined... no
/nix/store/gkq6rh8nj8i7prh4c9rawhwrk5g20cfx-x86_64-unknown-linux-musl-binutils-2.31.1/bin/x86_64-unknown-linux-musl-ld: cannot find -lz
collect2: error: ld returned 1 exit status
make[3]: *** [Makefile:1414: nghttp] Error 1
make[3]: Leaving directory '/build/nghttp2-1.39.2/src'
make[2]: *** [Makefile:2678: all-recursive] Error 1
make[2]: Leaving directory '/build/nghttp2-1.39.2/src'
make[1]: *** [Makefile:567: all-recursive] Error 1
make[1]: Leaving directory '/build/nghttp2-1.39.2'
make: *** [Makefile:476: all] Error 2
builder for '/nix/store/ba1w3wbdp4k02pkanhwcpyh2cv2qj2wh-nghttp2-1.39.2-x86_64-unknown-linux-musl.drv' failed with exit code 2

Any ideas? EDIT: ah, probably need to build zlib with shared libs as well.

domenkozar · 2019-09-29T10:21:50Z

Fixed also zlib and nghttp2.

domenkozar · 2019-09-29T10:27:24Z

It gets all the way to nix now:

Updating Autotools / GNU config script to a newer upstream version: ./config/config.guess
configuring
chmod: missing operand after 'u+w'
Try 'chmod --help' for more information.
builder for '/nix/store/17hykiklqbk2dyq3jcj6pdb9b32sl9yk-nix-2.3-x86_64-unknown-linux-musl.drv' failed with exit code 1

EDIT: will continue after lunch, seems like boost copying needs fixes for static compilatin.

domenkozar · 2019-09-29T15:00:34Z

I think we should close this one as it has conflicts. I haven't checked cross compilation (certainly some patches from this PR is missing), but at least Nix compiles statically in #70024

fzakaria · 2020-12-03T15:18:43Z

Is there a way to get the static binary without flake ?
Can it be published as a release artifact on GitHub ?

domenkozar · 2020-12-03T15:23:09Z

It is built by CI, so it just needs that some adds an artifact.

fzakaria · 2020-12-03T15:48:07Z

That's so cool. A lot of guides or tutorials could use it instead for a very light installation or demo.

fzakaria · 2020-12-03T15:48:49Z

Off topic: @domenkozar why is multi user install becoming the default ?

domenkozar · 2020-12-04T17:37:30Z

See NixOS/nix#4181 for discussion

matthewbauer · 2020-12-04T19:38:02Z

@fzakaria You can now download static nix via Hydra at:

https://hydra.nixos.org/job/nix/master/buildStatic.x86_64-linux/latest/download/2/nix

We don't have any official release on nixos.org yet though.

mausch · 2022-06-22T15:37:25Z

The link above is dead now, it takes you to the nix docs.
Instead use:

To view all static builds you can start at https://hydra.nixos.org/jobset/nix/maintenance-2.9#tabs-jobs and search for "buildStatic"

nixos-discourse · 2023-10-17T09:25:19Z

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:

https://discourse.nixos.org/t/where-can-i-get-a-statically-built-nix/34253/3

matthewbauer mentioned this pull request Feb 24, 2019

Add --whole-archive to include all store implementations (when BUILD_SHARED_LIBS=false) NixOS/nix#2698

Closed

GrahamcOfBorg added the 6.topic: stdenv Standard environment label Feb 24, 2019

GrahamcOfBorg requested review from vcunat and edolstra February 24, 2019 08:17

GrahamcOfBorg added 10.rebuild-darwin: 501+ 10.rebuild-darwin: 1001-2500 10.rebuild-linux: 501+ 10.rebuild-linux: 5001+ labels Feb 24, 2019

bhipple reviewed Feb 24, 2019

View reviewed changes

matthewbauer changed the title ~~Statically built Nix~~ [wip] Statically built Nix Feb 24, 2019

matthewbauer changed the base branch from master to staging February 24, 2019 23:56

dtzWill reviewed Feb 25, 2019

View reviewed changes

orivej reviewed Feb 25, 2019

View reviewed changes

matthewbauer mentioned this pull request Feb 27, 2019

Rootless Nix: Path Rewriting (would like to contribute) NixOS/nix#1971

Open

xaverdh mentioned this pull request Feb 28, 2019

error while preallocating on nfs NixOS/nix#2707

Closed

matthewbauer force-pushed the static-nix branch from 1857278 to 4fb2125 Compare March 13, 2019 18:04

matthewbauer requested a review from Ericson2314 as a code owner March 13, 2019 18:04

matthewbauer added 2 commits April 15, 2019 11:25

top-level/impure.nix: expose crossOverlays

350f3d0

don’t use stackprotector for x86_32

78bd45b

matthewbauer force-pushed the static-nix branch from 8241f2d to 78bd45b Compare April 15, 2019 15:25

systems: correct qemu architectures

f2290fb

ppc64le and ppc64 are different targets in the configure script. We can’t use the same one. TODO: canonicalize similar ones based on qemu’s configure script.

Ericson2314 reviewed Apr 17, 2019

View reviewed changes

systems: fix emulator identity

dccd9e3

Ericson2314 reviewed Apr 18, 2019

View reviewed changes

lib/systems/default.nix Outdated Show resolved Hide resolved

fix shell quoting

3afa626

thanks @Ericson2314

FRidh added the 2.status: work-in-progress This PR isn't done label Apr 28, 2019

FRidh removed their request for review July 20, 2019 11:28

domenkozar mentioned this pull request Sep 29, 2019

Provide a static build? cachix/cachix#184

Closed

domenkozar mentioned this pull request Sep 29, 2019

nix: allow static compilation #70024

Merged

3 tasks

domenkozar closed this Sep 29, 2019

mausch mentioned this pull request Jun 22, 2022

Relation to static builds in Hydra? DavHau/nix-portable#41

Open

michaelCTS mentioned this pull request Oct 19, 2023

Bug: nixStatic has dependencies in /nix/store #262007

Closed

[wip] Statically built Nix #56281

[wip] Statically built Nix #56281

Conversation

matthewbauer commented Feb 24, 2019 • edited Loading

Motivation for this change

ryantm commented Feb 24, 2019 • edited Loading

jb55 commented Feb 24, 2019

matthewbauer commented Feb 24, 2019 • edited Loading

ryantm commented Feb 24, 2019

Choose a reason for hiding this comment

Choose a reason for hiding this comment

bhipple Feb 24, 2019 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

edolstra commented Feb 25, 2019

ryantm commented Feb 25, 2019

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

matthewbauer commented Feb 25, 2019

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

illegalprime commented Mar 2, 2019

matthewbauer commented Mar 2, 2019 • edited Loading

illegalprime commented Mar 5, 2019 • edited Loading

matthewbauer commented Mar 5, 2019

illegalprime commented Mar 5, 2019 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

matthewbauer commented Apr 17, 2019

nixos-discourse commented Jun 6, 2019

domenkozar commented Sep 29, 2019

domenkozar commented Sep 29, 2019 • edited Loading

domenkozar commented Sep 29, 2019

domenkozar commented Sep 29, 2019 • edited Loading

domenkozar commented Sep 29, 2019

fzakaria commented Dec 3, 2020

domenkozar commented Dec 3, 2020

fzakaria commented Dec 3, 2020

fzakaria commented Dec 3, 2020

domenkozar commented Dec 4, 2020

matthewbauer commented Dec 4, 2020

mausch commented Jun 22, 2022

nixos-discourse commented Oct 17, 2023

matthewbauer commented Feb 24, 2019 •

edited

Loading

ryantm commented Feb 24, 2019 •

edited

Loading

matthewbauer commented Feb 24, 2019 •

edited

Loading

bhipple Feb 24, 2019 •

edited

Loading

matthewbauer commented Mar 2, 2019 •

edited

Loading

illegalprime commented Mar 5, 2019 •

edited

Loading

illegalprime commented Mar 5, 2019 •

edited

Loading

domenkozar commented Sep 29, 2019 •

edited

Loading

domenkozar commented Sep 29, 2019 •

edited

Loading