Debian packaging #160

ghisvail · 2016-04-28T11:56:46Z

I am opening a separate meta issue for all my questions / remarks / requests, whilst dealing with the packaging work on Debian (like #159).

ghisvail · 2016-04-28T12:06:55Z

Amongst the list of dependencies for hdf-compass:

setup_args['install_requires'] =\
    [
        "numpy",
        "matplotlib>=1.5",
        "cartopy[plotting]",
        "h5py",
        "wxPython==3.0.2",
        "hydroffice.bag>=0.2.10",
        "pydap",
        "requests"
    ]

Debian is currently missing cartopy, hydroffice.bag and pydap. Cartopy is supposedly being worked on, hydroffice.bag is in my backlog and pydap is not available. We have dap, but I am assuming it is outdated and superseded by pydap. I wonder which of these dependencies are trully necessary for running hdf-compass and which of those could be moved to extra_requires.

giumas · 2016-04-28T12:36:42Z

Does it help?

    setup_args['install_requires'] =\
    [
        "numpy",
        "matplotlib>=1.5",
        "h5py",
        "wxPython==3.0.2",
        "requests"
    ]
    setup_args['extras_require'] =\
    {
        "GeoNodes": ["cartopy[plotting]", ],  # required for visualization of GeoArray and GeoSurface nodes
        "BAG": ["hydroffice.bag>=0.2.10", ],  # required by BAG plugin
        "OpenDAP": ["pydap", ],  # required by OpenDAP plugin
    }

ghisvail · 2016-04-28T13:20:35Z

It does, yes. So that means we do have all the essentials in place in Debian.

giumas · 2016-04-28T13:37:33Z

As hydroffice.bag maintainer, I hope that you can also add the BAG plugin.. Incidentally, this plugin is currently the only one that takes advantage of the GeoNodes dependency to geo-visualize the data (if present).

ghisvail · 2016-04-28T13:42:50Z

so it would require cartopy too?

giumas · 2016-04-28T13:49:06Z

Nope! It reverts to visualize the data as simple Array nodes if cartopy is missing.

ghisvail · 2016-04-28T16:19:23Z

Could you guys provide a scalable and / or PNG version of the application icon? Right now, I am running imagemagick during the package build to generate a freedesktop compliant .png from the .ico but a .svg would make it look better, regardless of the screen resolution or application launcher.

giumas · 2016-04-28T16:26:35Z

Doesn't it work? https://github.com/HDFGroup/hdf-compass/blob/develop/hdf_compass/compass_viewer/icons/favicon_48.png

ghisvail · 2016-04-28T19:11:53Z

I now have a working package for 0.6.0b4. You should consider merging #162 which would benefit packaging efforts for other distributions. In addition, you guys might want to have a look at the AppStream standard for better discovery in software stores.

giumas · 2016-04-28T19:19:48Z

Great! new tag: https://github.com/HDFGroup/hdf-compass/releases/tag/v0.6.0b5

ghisvail · 2016-04-30T20:38:19Z

Perfect. The packaging is ready on my end. I'll should perhaps wait for the final v0.6.0 tag before doing the submission?

giumas · 2016-04-30T20:54:56Z

@ghisvail Great!

For the release decision, we need somebody from the HDF Group: @jreadey ? @hyoklee ? @ajelenak-thg ? and I would also invoke the opinion of @andrewcollette

giumas · 2016-04-30T20:55:44Z

@ghisvail can I hope that the packaging is with the BAG plugin?

jreadey · 2016-05-01T16:07:44Z

I'd like to have frozen binaries built and tested for Mac & Windows before releasing v0.6.0.

giumas · 2016-05-01T16:22:13Z

Does it mean that these binaries do not work? https://github.com/HDFGroup/hdf-compass/releases/tag/v0.6.0b3 Or that is required that binaries are built on HDF Group's machines?

Incidentally, I am also a bit concerned about the lack of recent developer time put on the project. Is this a project that the HDF Group wants to really push for?

jreadey · 2016-05-02T07:04:28Z

The binaries don't work on my Mountain Lion System. And I would say the binaries need to be built on HDF Group's machine if we are to be the one's to distribute them.

I think at this point it makes sense to move the minimal OS X version to Yosemite (10.10). For example I notice that Chrome is no longer supported on 10.8 and in general it's hard to get the binary build dependencies on 10.8.

Sorry for the lack of time the HDF Group has been able to put in to this project recently. Compass is a great tool, but it has to take a back seat to projects that customers are paying us for. I will spend some time this week to get the build setup for v0.6.0.

giumas · 2016-05-02T12:14:48Z

The binaries don't work on my Mountain Lion System.

What is the error? I would like to understand better what is the general issue. Do we really need to have a frozen app for each supported OS X?

I will spend some time this week to get the build setup for v0.6.0.

This is great!

ghisvail · 2016-05-02T12:34:24Z

I will spend some time this week to get the build setup for v0.6.0.

Awesome. Then, what I can do is submit the packaging of v0.6.0b5 for review (which always take some time to complete) and update to v0.6.0 once it is released. Is that ok?

jreadey · 2016-05-02T23:54:09Z

Re: the runtime error, it was similar to this: http://stackoverflow.com/questions/25926495/symbol-not-found-sincos-stret.

In general, binaries built on one version of OS X won't run on previous versions. So I'm trying to setup a build machine with a OS X release recent enough to be able to build Compass w/ the various plugins and old enough that most Mac users will have it or a newer release. I wasn't able to find a download for 10.10 on the Mac developer site: https://developer.apple.com/osx/download/. Does anyone know if they are still keeping a Yosemite DMG around?

giumas · 2016-05-03T00:29:57Z

I wasn't able to find a download for 10.10 on the Mac developer site: https://developer.apple.com/osx/download/. Does anyone know if they are still keeping a Yosemite DMG around?

I am afraid that Yosemite was already removed.. Bad guys!!

BTW, if you downloaded it in the past, shouldn't it be in your purchases in the App Store?

jreadey · 2016-05-03T00:35:31Z

Good idea! - I do have it on my App Store/Purchased tab. I'll give it a go.

jreadey · 2016-05-04T05:19:26Z

@giumas - I was able to follow your wiki and create a dmg on OS X 10.10! Since this is 10.10, I didn't need to deal with the WxPython work-around.

The binary is here: s3://hdfgroup.download/HDFCompass/0.6.0b5/HDFCompass.dmg, try it out and let me know if you see any issues.

Next, I'll try the same on Windows 7.

giumas · 2016-05-04T12:25:40Z

Do you mean: https://s3.amazonaws.com/hdfgroup.download/HDFCompass/0.6.0b5/HDFCompass.dmg?

giumas · 2016-05-04T12:47:46Z

It works on my Yosemite machine:

jreadey · 2016-05-04T15:37:01Z

Great! Yes I meant to say https://...

giumas · 2016-05-05T02:35:36Z

@jreadey I have found much easier the building on Windows. Are you hitting issues?

giumas · 2016-06-13T12:13:02Z

@jreadey It works on my machine

jreadey · 2016-06-15T11:58:59Z

@giumas - can you do the PyPI release?

giumas · 2016-06-15T12:12:15Z

@jreadey of course, yes.We should also add a release tag on GitHub. Let me know when you decide that is time.

jreadey · 2016-06-15T12:27:20Z

Ok - done!

giumas · 2016-06-15T12:34:31Z

I have just discovered this: https://github.com/HDFGroup/hdf-compass/blob/develop/spec.json#L2

giumas · 2016-06-15T12:35:57Z

The py2app script is also outdated.. Actually, I did not test it since a while. Do you? https://github.com/HDFGroup/hdf-compass/blob/develop/setup.py2app.py#L49

giumas · 2016-06-15T12:37:13Z

This file is outdated: https://github.com/HDFGroup/hdf-compass/blob/develop/README.txt

jreadey · 2016-06-15T12:37:32Z

No, I haven't used py2app since we switched to using pyinstaller for both windows and Mac. Delete it?
The version strings hidden everywhere are a pain.

jreadey · 2016-06-15T12:39:37Z

I can delete README.txt as well. Anything else?

giumas · 2016-06-15T12:41:14Z

I am double-checking.. it doesn't seem to me that these small issues require a new tag

giumas · 2016-06-15T12:42:02Z

Do you plan to provide the dmg for Mac?

jreadey · 2016-06-15T12:43:21Z

Yes, but I won't be able to get to it this week - I'm traveling.

giumas · 2016-06-15T12:43:44Z

One more: https://github.com/HDFGroup/hdf-compass/blob/develop/docs/conf.py#L60

giumas · 2016-06-15T12:45:25Z

The license year is not updated: https://github.com/HDFGroup/hdf-compass/blob/develop/docs/license.rst

giumas · 2016-06-15T12:49:24Z

Are you freezing with console=True and debug=True? https://github.com/HDFGroup/hdf-compass/blob/master/HDFCompass.1file.spec#L89

jreadey · 2016-06-15T12:52:28Z

Yes.

giumas · 2016-06-15T12:57:13Z

Here we go: https://pypi.python.org/pypi/hdf_compass/0.6.0

giumas · 2016-06-15T13:00:17Z

@jreadey Can you create an account on PyPI? I believe that it is a good idea if I add you.. just in case.

jreadey · 2016-06-15T13:06:37Z

I have a PyPI account. Userid is: john_readey.

giumas · 2016-06-15T13:08:47Z

Just added

giumas · 2016-06-15T13:10:24Z

@ghisvail This ticket is getting too long.. and capturing too much stuff. I would like to close it as soon as the debian package is accepted!

ghisvail · 2016-06-15T14:02:48Z

Since v0.6.0 is out, it is now my turn to work. I'll report here if I have issues / comments, but it should be fine. I will close it once the package is submitted.

Cheers,

ghisvail · 2016-06-15T15:07:55Z

I need a tar.gz release on PyPI please.

giumas · 2016-06-15T15:10:09Z

added

giumas · 2016-07-27T02:55:11Z

@ghisvail updates? can we close this ticket?

ghisvail · 2016-07-27T06:34:34Z

It is currently sitting in the NEW queue for approval by the release team. Will close once it is accepted.

ghisvail · 2016-09-01T14:52:34Z

hdf-compass is now available in Debian. Closing.

jreadey · 2016-09-01T15:05:31Z

@ghisvail - cool! Does this mean I can just do Apt-get on a recent Debian install to get it? What's the package name?

ghisvail · 2016-09-01T15:10:44Z

https://packages.debian.org/sid/hdf-compass

It will transition to Debian Stretch (Debian testing, future stable) tomorrow.

giumas mentioned this issue Apr 28, 2016

Setup.py modifications for making optional some dependencies #161

Merged

giumas mentioned this issue Apr 28, 2016

wxPython Phoenix #156

Closed

giumas added the enhancement label Apr 28, 2016

giumas self-assigned this Apr 28, 2016

ghisvail closed this as completed Sep 1, 2016

Debian packaging #160

Debian packaging #160

Comments

ghisvail commented Apr 28, 2016

ghisvail commented Apr 28, 2016

giumas commented Apr 28, 2016

ghisvail commented Apr 28, 2016

giumas commented Apr 28, 2016 • edited Loading

ghisvail commented Apr 28, 2016

giumas commented Apr 28, 2016

ghisvail commented Apr 28, 2016

giumas commented Apr 28, 2016 • edited Loading

ghisvail commented Apr 28, 2016

giumas commented Apr 28, 2016

ghisvail commented Apr 30, 2016

giumas commented Apr 30, 2016

giumas commented Apr 30, 2016

jreadey commented May 1, 2016

giumas commented May 1, 2016

jreadey commented May 2, 2016

giumas commented May 2, 2016 • edited Loading

ghisvail commented May 2, 2016

jreadey commented May 2, 2016

giumas commented May 3, 2016

jreadey commented May 3, 2016

jreadey commented May 4, 2016

giumas commented May 4, 2016

giumas commented May 4, 2016

jreadey commented May 4, 2016

giumas commented May 5, 2016

giumas commented Jun 13, 2016

jreadey commented Jun 15, 2016

giumas commented Jun 15, 2016

jreadey commented Jun 15, 2016

giumas commented Jun 15, 2016

giumas commented Jun 15, 2016

giumas commented Jun 15, 2016

jreadey commented Jun 15, 2016

jreadey commented Jun 15, 2016

giumas commented Jun 15, 2016

giumas commented Jun 15, 2016

jreadey commented Jun 15, 2016

giumas commented Jun 15, 2016

giumas commented Jun 15, 2016

giumas commented Jun 15, 2016

jreadey commented Jun 15, 2016

giumas commented Jun 15, 2016

giumas commented Jun 15, 2016

jreadey commented Jun 15, 2016

giumas commented Jun 15, 2016

giumas commented Jun 15, 2016

ghisvail commented Jun 15, 2016

ghisvail commented Jun 15, 2016

giumas commented Jun 15, 2016

giumas commented Jul 27, 2016

ghisvail commented Jul 27, 2016

ghisvail commented Sep 1, 2016

jreadey commented Sep 1, 2016

ghisvail commented Sep 1, 2016 • edited Loading

giumas commented Apr 28, 2016 •

edited

Loading

giumas commented Apr 28, 2016 •

edited

Loading

giumas commented May 2, 2016 •

edited

Loading

ghisvail commented Sep 1, 2016 •

edited

Loading