Nix / Nixos support #357

alanz · 2017-11-18T15:28:54Z

mrkgnao · 2017-11-18T15:33:25Z

Here are two logs with hie --lsp --vomit. In both cases, the essential error is

real-hie: <command line>: cannot satisfy -package-id base-4.10.0.0

Behaviour observed

In both cases, the following behaviour occurs:

VSCode starts, tons of HLint warnings are shown.
Hovering produces a Loading... tooltip that never resolves.
Fixing the offending code does not dismiss the HLint warning.
Refactoring does not work.

My environment

I am using NixOS (latest stable, 17.09).

I generated a hie executable from the Nix derivation in the linked thread, using nix-build, and put it on my $PATH as real-hie. I then made a wrapper script called hie:

#!/bin/sh
real-hie -d -l /tmp/hie.log --vomit $@ | tee /tmp/hie-wire.log

The logs

The first one is from a nix-shell+Cabal project, where VSCode was started from inside a Nix shell.

info: Found Cabal project at: /home/mrkgnao/code/sans/sound-and-complete
info: Using Cabal project at: /home/mrkgnao/code/sans/sound-and-complete
Using hoogle db at: /home/mrkgnao/code/sans/sound-and-complete/hiehoogledb.hoo
info: Found Cabal project at: /home/mrkgnao/code/sans/sound-and-complete
info: Using Cabal project at: /home/mrkgnao/code/sans/sound-and-complete
DEBUG: reading cache: /home/mrkgnao/code/sans/sound-and-complete/dist/setup-config.ghc-mod.cabal-components
DEBUG: resolveEntrypoint:
       ["-i","-idist/build/sound-and-complete/sound-and-complete-tmp","-isrc","-idist/build/sound-and-complete/autogen","-idist/build/global-autogen","-Idist/build/sound-and-complete/autogen","-Idist/build/global-autogen","-Idist/build/sound-and-complete/sound-and-complete-tmp","-optP-include","-optPdist/build/sound-and-complete/autogen/cabal_macros.h"]
Warning: resolveModule "/home/mrkgnao/code/sans/sound-and-complete/src/Main.md":
         cannot compile this file to desired target:
/home/mrkgnao/code/sans/sound-and-complete/src/Main.md
DEBUG: resolveEntrypoint: []
DEBUG: making sure autogen files exist
DEBUG: autogen files out of sync
DEBUG: writing Cabal autogen files
DEBUG: reading cache: dist/setup-config.ghc-mod.resolved-components
DEBUG: Could not find a component assignment, falling back to
       picking library component in cabal file.
VOMIT: Using the following mapped files:
VOMIT: Initializing GHC session with following options: "-fbuilding-cabal-package" "-O" "-outputdir" "dist/build/sound-and-complete/sound-and-complete-tmp" "-odir" "dist/build/sound-and-complete/sound-and-complete-tmp" "-hidir" "dist/build/sound-and-complete/sound-and-complete-tmp" "-stubdir" "dist/build/sound-and-complete/sound-and-complete-tmp" "-i" "-idist/build/sound-and-complete/sound-and-complete-tmp" "-isrc" "-idist/build/sound-and-complete/autogen" "-idist/build/global-autogen" "-Idist/build/sound-and-complete/autogen" "-Idist/build/global-autogen" "-Idist/build/sound-and-complete/sound-and-complete-tmp" "-optP-include" "-optPdist/build/sound-and-complete/autogen/cabal_macros.h" "-hide-all-packages" "-Wmissing-home-modules" "-package-id" "base-4.10.0.0" "-package-id" "mtl-2.2.1-19EL8AGBsN3DnnOhrC9xY3" "-package-id" "transformers-0.5.2.0" "-package-id" "safe-0.3.15-5SmTamu8dz8KnTA9MfNcRD" "-package-id" "lens-4.15.4-4q970k0XvkV7aqAQ5eBtP3" "-package-id" "prettyprinter-1.1.1-2QNu42iMc4MGCD9K0ZJaq" "-package-id" "hspec-2.4.4-FJuRtB7WMYqKF0brZ7icE5" "-package-id" "containers-0.5.10.2" "-package-id" "adjunctions-4.3-18NVfKnieoxAHaA9U5pxMh" "-package-id" "profunctors-5.2.1-1lOUsE8aiaZLtdvF0ROsOX" "-package-id" "text-1.2.2.2-5RuPYjcevF59B6YENNKuiP" "-package-id" "bytestring-0.10.8.2" "-package-id" "hashable-1.2.6.1-BqrB4iRJk0C8e42ef63nR4" "-package-id" "unordered-containers-0.2.8.0-KsuUwaupoRi1cUuuci0Zxb" "-XHaskell2010" "-pgmL" "markdown-unlit" "-O0" "-Wall"
DEBUG: initSession: Session not initialized, creating new one
real-hie: <command line>: cannot satisfy -package-id base-4.10.0.0
    (use -v for more information)

The second one is a new Stack project with nix: {enable: true} in stack.yaml (I think all this does is use Nix for GHC and zlib).

info: Found Stack project at: /home/mrkgnao/code/testproj
Warning: 'dist/setup-config' exists, ignoring Stack project
info: Found Cabal project at: /home/mrkgnao/code/testproj
info: Using Cabal project at: /home/mrkgnao/code/testproj
Using hoogle db at: /home/mrkgnao/.hoogle/default-haskell-5.0.13.hoo
info: Found Stack project at: /home/mrkgnao/code/testproj
Warning: 'dist/setup-config' exists, ignoring Stack project
info: Found Cabal project at: /home/mrkgnao/code/testproj
info: Using Cabal project at: /home/mrkgnao/code/testproj
DEBUG: reading cache: /home/mrkgnao/code/testproj/dist/setup-config.ghc-mod.cabal-components
DEBUG: resolveEntrypoint:
       ["-i","-idist/build/testproj/testproj-tmp","-isrc","-idist/build/testproj/autogen","-idist/build/global-autogen","-Idist/build/testproj/autogen","-Idist/build/global-autogen","-Idist/build/testproj/testproj-tmp","-optP-include","-optPdist/build/testproj/autogen/cabal_macros.h"]
DEBUG: resolveEntrypoint: []
DEBUG: making sure autogen files exist
DEBUG: autogen files out of sync
DEBUG: writing Cabal autogen files
DEBUG: reading cache: dist/setup-config.ghc-mod.resolved-components
VOMIT: Using the following mapped files: "/home/mrkgnao/code/testproj/src/Main.hs"
VOMIT: Initializing GHC session with following options: "-fbuilding-cabal-package" "-O" "-outputdir" "dist/build/testproj/testproj-tmp" "-odir" "dist/build/testproj/testproj-tmp" "-hidir" "dist/build/testproj/testproj-tmp" "-stubdir" "dist/build/testproj/testproj-tmp" "-i" "-idist/build/testproj/testproj-tmp" "-isrc" "-idist/build/testproj/autogen" "-idist/build/global-autogen" "-Idist/build/testproj/autogen" "-Idist/build/global-autogen" "-Idist/build/testproj/testproj-tmp" "-optP-include" "-optPdist/build/testproj/autogen/cabal_macros.h" "-hide-all-packages" "-Wmissing-home-modules" "-package-id" "base-4.10.0.0" "-XHaskell2010" "-O0" "-Wall"
DEBUG: initSession: Session not initialized, creating new one
real-hie: <command line>: cannot satisfy -package-id base-4.10.0.0
    (use -v for more information)

alanz · 2017-11-18T15:44:57Z

Please show the contents of /tmp/hie.log

mrkgnao · 2017-11-18T16:44:58Z

So the problem in the Stack project turned out to be the old ghc-mod dist/setup-config thing, and deleting the dist/ folder fixed it.

The Nix project, on the other hand, seemed to be an incompatibility in GHC versions. (The output about Main.md was irrelevant and had to do with a markdown-unlit literate file, which I've changed back into a plain .hs for simplicity.)

I compiled hie from source using stack-8.2.1.yaml. Here's the output from VSCode with --vomit:

info: Found Cabal project at: /home/mrkgnao/code/sans/sound-and-complete
info: Using Cabal project at: /home/mrkgnao/code/sans/sound-and-complete
info: Found Cabal project at: /home/mrkgnao/code/sans/sound-and-complete
info: Using Cabal project at: /home/mrkgnao/code/sans/sound-and-complete
DEBUG: reading cache: /home/mrkgnao/code/sans/sound-and-complete/dist/setup-config.ghc-mod.cabal-components
DEBUG: resolveEntrypoint:
       ["-i","-idist/build/sound-and-complete/sound-and-complete-tmp","-isrc","-idist/build/sound-and-complete/autogen","-idist/build/global-autogen","-Idist/build/sound-and-complete/autogen","-Idist/build/global-autogen","-Idist/build/sound-and-complete/sound-and-complete-tmp","-optP-include","-optPdist/build/sound-and-complete/autogen/cabal_macros.h"]
DEBUG: resolveEntrypoint: []
DEBUG: making sure autogen files exist
DEBUG: autogen files out of sync
DEBUG: writing Cabal autogen files
DEBUG: reading cache: dist/setup-config.ghc-mod.resolved-components
DEBUG: Could not find a component assignment, falling back to
       picking library component in cabal file.
VOMIT: Using the following mapped files:
VOMIT: Initializing GHC session with following options: "-fbuilding-cabal-package" "-O" "-outputdir" "dist/build/sound-and-complete/sound-and-complete-tmp" "-odir" "dist/build/sound-and-complete/sound-and-complete-tmp" "-hidir" "dist/build/sound-and-complete/sound-and-complete-tmp" "-stubdir" "dist/build/sound-and-complete/sound-and-complete-tmp" "-i" "-idist/build/sound-and-complete/sound-and-complete-tmp" "-isrc" "-idist/build/sound-and-complete/autogen" "-idist/build/global-autogen" "-Idist/build/sound-and-complete/autogen" "-Idist/build/global-autogen" "-Idist/build/sound-and-complete/sound-and-complete-tmp" "-optP-include" "-optPdist/build/sound-and-complete/autogen/cabal_macros.h" "-hide-all-packages" "-Wmissing-home-modules" "-package-id" "base-4.10.0.0" "-package-id" "mtl-2.2.1-19EL8AGBsN3DnnOhrC9xY3" "-package-id" "transformers-0.5.2.0" "-package-id" "safe-0.3.15-5SmTamu8dz8KnTA9MfNcRD" "-package-id" "lens-4.15.4-4q970k0XvkV7aqAQ5eBtP3" "-package-id" "prettyprinter-1.1.1-2QNu42iMc4MGCD9K0ZJaq" "-package-id" "hspec-2.4.4-FJuRtB7WMYqKF0brZ7icE5" "-package-id" "containers-0.5.10.2" "-package-id" "adjunctions-4.3-18NVfKnieoxAHaA9U5pxMh" "-package-id" "profunctors-5.2.1-1lOUsE8aiaZLtdvF0ROsOX" "-package-id" "text-1.2.2.2-5RuPYjcevF59B6YENNKuiP" "-package-id" "bytestring-0.10.8.2" "-package-id" "hashable-1.2.6.1-BqrB4iRJk0C8e42ef63nR4" "-package-id" "unordered-containers-0.2.8.0-KsuUwaupoRi1cUuuci0Zxb" "-XHaskell2010" "-pgmL" "markdown-unlit" "-O0" "-Wall"
DEBUG: initSession: Session not initialized, creating new one
real-hie: <command line>: cannot satisfy -package-id mtl-2.2.1-19EL8AGBsN3DnnOhrC9xY3
    (use -v for more information)

Fresheyeball · 2017-11-30T18:18:26Z

I have but a bounty on this issue. https://www.bountysource.com/issues/51713360-nix-nixos-support would love to see this resolved ASAP.

domenkozar · 2017-12-03T21:53:58Z

@Fresheyeball @imalsogreg do you want to have IDE support for projects using nix-shell/nix-build or is stack+nix enough?

imalsogreg · 2017-12-04T01:15:37Z

@domenkozar Preferably nix-shell aware; most of my work is on projects with dependencies managed by nix.

Fresheyeball · 2017-12-04T22:49:13Z

@domenkozar I don't use stack. I'm in the same boat as @imalsogreg.

shlevy · 2017-12-21T19:39:34Z

NixOS/nixpkgs#32947 fixes this I think.

alanz · 2017-12-21T19:52:24Z

Does anything need to change in https://github.com/haskell/haskell-ide-engine#installation-with-nix because of this?

shlevy · 2017-12-21T19:56:58Z

@alanz Those instructions are still reasonable for building and installing a local checkout with stack + nix, but end-users will probably want to install from nixpkgs which they can do with my PR. If it would be welcome, I'd be happy to also add nix expressions to make it possible to do a self-contained (not via stack) nix build from a nix checkout.

shlevy · 2017-12-21T19:58:32Z

Note that there may be some confusion on my part if this addresses the issue here. The idea with that PR is that your nix environment (nix-shell, nix-buffer, whatever) would build haskell-ide-engine with the same haskell package set as your package is using, and that would fix the version mismatch here. But @Fresheyeball is testing to see if that's enough.

Fresheyeball · 2017-12-21T19:58:57Z

@shlevy would you mind reaching out on slack?

shlevy · 2017-12-21T20:01:55Z

@Fresheyeball Which slack?

Fresheyeball · 2017-12-21T20:04:03Z

Idk, I am on fpchat.

shlevy · 2017-12-29T19:47:20Z

@imalsogreg @Fresheyeball The nixpkgs PR is now merged, testing appreciated 😄

domenkozar · 2018-02-02T10:00:10Z

I have prepared hie executables for GHC 8.0.2 and GHC 8.2.2 with Nix in reproducible mannner: https://github.com/domenkozar/hie-nix - let me know what you think

shlevy · 2018-02-02T14:38:37Z

@domenkozar This seems very hard to integrate in with nixpkgs haskell package sets

michalrus · 2018-02-02T15:22:43Z

@domenkozar, so if I ~~add~~ import-from-derivation this ghc-8.2.nix to my project’s default.nix/shell.nix… will it see correct dependencies declared in that same default.nix (e.g. by callCabal2Nix ./.)?

@shlevy is this what you mean, that it won’t?

domenkozar · 2018-02-02T15:30:40Z

@shlevy why would you need that?

shlevy · 2018-02-02T15:57:41Z

@domenkozar Because we're defining package environments for our projects based on nixpkgs (plus our own overlays), and we want (well, need) to have the same dependencies (not just the same GHC version!) to use hie with our projects.

shlevy · 2018-02-02T15:58:07Z

So I want to make an env that contains "the hie appropriate for this project" and launch that hie per-project.

michalrus · 2018-02-02T17:24:52Z

^ Exactly. What’s the point otherwise?

domenkozar · 2018-02-02T20:50:40Z

Afaik HIE does this at runtime using ghc-mod, so you'd have to run it with nix-shell of your environment.

michalrus · 2018-02-19T01:24:48Z

It does; working v. well. =) Thank you, @domenkozar!

In general, when developing Haskell programs on Nix, it is nice to enter a Nix shell with the required packages

Also, if you can specify path to a HIE wrapper in your editor, you can use a wrapper like https://github.com/michalrus/kornel/blob/8e0d466e4f23a8479a268eaff5940537a335e08d/hie.sh to not have to run the whole editor inside an impure nix-shell (crazy!).

(This -A hie from the wrapper is defined in https://github.com/michalrus/kornel/blob/8e0d466e4f23a8479a268eaff5940537a335e08d/default.nix#L40-L48 — a bit clunky, but this definition survives GC!)

domenkozar · 2018-02-20T10:49:18Z

@Fresheyeball @imalsogreg could you provide a Nix project you'd like to see HIE working with? I think with hie-nix it should be trivial, but I want to make sure we agree that's the acceptance criteria for this to pass :)

srid · 2018-02-20T14:06:37Z

Here's a skeleton Nix project:
https://github.com/ElvishJerricco/reflex-project-skeleton

The frontend package can be compiled using ghcjs, although for editor integration purposes one could compile it using ghc. It even targets android and iOS.

Should be a good candidate to test HIE support?

alanz · 2018-02-21T07:32:22Z

Once this thing settles down to best practice, can someone make a PR on the README, for future NIX users?

domenkozar · 2018-03-23T13:48:05Z

@alanz https://github.com/haskell/haskell-ide-engine#installation-with-nix

@srid @ElvishJerricco made it work, but not sure he posted the steps (although they are as in README with usual caveats).

Is this considered then done? :)

alanz · 2018-03-23T13:54:50Z

Well, the link is good, but the instructions at https://github.com/domenkozar/hie-nix/blob/master/README.md don't work.

We now seem to have

default.nix
ghc-8.0.nix
ghc-8.2.nix

Rather than hie-nix.nix

domenkozar · 2018-03-23T14:28:44Z

It did work (I've tested locally), but I see your point, it was confusing.

What about this: https://github.com/domenkozar/hie-nix#install

alanz · 2018-03-23T14:41:18Z

Yep, that works.

And a pretty neat way of doing it.

Thanks.

alanz · 2018-03-23T14:50:39Z

@domenkozar I presume at some stage this will end up on a binary cache somewhere?

My install (admittedly for a fresh nixpkgs install) is building the world.

domenkozar · 2018-03-23T15:17:35Z

Yes, that's the plan :)

Camsbury · 2018-09-09T01:53:48Z

Writing here to thank @michalrus again. Coming back to this months later, and your strategy has worked for me.

michalrus mentioned this issue Dec 19, 2017

Fix target selection using intero-targets michalrus/intero-nix-shim#6

Merged

shlevy mentioned this issue Dec 21, 2017

Add haskell-ide-engine. NixOS/nixpkgs#32947

Merged

michalrus mentioned this issue Feb 20, 2018

Ease of use with nix-shell #117

Closed

alanz closed this as completed Mar 23, 2018

alanz added this to the prehistory milestone Feb 2, 2019

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Nix / Nixos support #357

Nix / Nixos support #357

alanz commented Nov 18, 2017

mrkgnao commented Nov 18, 2017 •

edited

Loading

alanz commented Nov 18, 2017

mrkgnao commented Nov 18, 2017 •

edited

Loading

Fresheyeball commented Nov 30, 2017

domenkozar commented Dec 3, 2017

imalsogreg commented Dec 4, 2017

Fresheyeball commented Dec 4, 2017

shlevy commented Dec 21, 2017

alanz commented Dec 21, 2017

shlevy commented Dec 21, 2017

shlevy commented Dec 21, 2017

Fresheyeball commented Dec 21, 2017

shlevy commented Dec 21, 2017

Fresheyeball commented Dec 21, 2017

shlevy commented Dec 29, 2017

domenkozar commented Feb 2, 2018

shlevy commented Feb 2, 2018

michalrus commented Feb 2, 2018 •

edited

Loading

domenkozar commented Feb 2, 2018

shlevy commented Feb 2, 2018

shlevy commented Feb 2, 2018

michalrus commented Feb 2, 2018

domenkozar commented Feb 2, 2018

michalrus commented Feb 19, 2018 •

edited

Loading

domenkozar commented Feb 20, 2018

srid commented Feb 20, 2018

alanz commented Feb 21, 2018

domenkozar commented Mar 23, 2018

alanz commented Mar 23, 2018

domenkozar commented Mar 23, 2018

alanz commented Mar 23, 2018

alanz commented Mar 23, 2018

domenkozar commented Mar 23, 2018

Camsbury commented Sep 9, 2018

Nix / Nixos support #357

Nix / Nixos support #357

Comments

alanz commented Nov 18, 2017

mrkgnao commented Nov 18, 2017 • edited Loading

Behaviour observed

My environment

The logs

alanz commented Nov 18, 2017

mrkgnao commented Nov 18, 2017 • edited Loading

Fresheyeball commented Nov 30, 2017

domenkozar commented Dec 3, 2017

imalsogreg commented Dec 4, 2017

Fresheyeball commented Dec 4, 2017

shlevy commented Dec 21, 2017

alanz commented Dec 21, 2017

shlevy commented Dec 21, 2017

shlevy commented Dec 21, 2017

Fresheyeball commented Dec 21, 2017

shlevy commented Dec 21, 2017

Fresheyeball commented Dec 21, 2017

shlevy commented Dec 29, 2017

domenkozar commented Feb 2, 2018

shlevy commented Feb 2, 2018

michalrus commented Feb 2, 2018 • edited Loading

domenkozar commented Feb 2, 2018

shlevy commented Feb 2, 2018

shlevy commented Feb 2, 2018

michalrus commented Feb 2, 2018

domenkozar commented Feb 2, 2018

michalrus commented Feb 19, 2018 • edited Loading

domenkozar commented Feb 20, 2018

srid commented Feb 20, 2018

alanz commented Feb 21, 2018

domenkozar commented Mar 23, 2018

alanz commented Mar 23, 2018

domenkozar commented Mar 23, 2018

alanz commented Mar 23, 2018

alanz commented Mar 23, 2018

domenkozar commented Mar 23, 2018

Camsbury commented Sep 9, 2018

mrkgnao commented Nov 18, 2017 •

edited

Loading

mrkgnao commented Nov 18, 2017 •

edited

Loading

michalrus commented Feb 2, 2018 •

edited

Loading

michalrus commented Feb 19, 2018 •

edited

Loading