You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Springtime currently offers a nice, streamlined way to download data from several sources. It was designed to be extensible, in the sense that it should be easy to add more data sources. However, new data sources typically come with additional requirements (e.g. #54) and licenses (e.g. #63). This could eventually render the whole package cumbersome to work with.
It would be nice if we could separate the package into a core module with optional data source subsets. There are two main options:
Import the springtime core package into new datasource subset packages.
Import optional datasource subset packages into springtime. This would be my preferred option, but it requires a mechanism to register subset packages into the main tool.
Option 1 might lead to duplication and it moves away from the ideal of having a one-stop-shop for all your data workflows. This is why I would prefer option 2. To make that work, we need a mechanism to register subset packages into springtime.
tell springtime about the additional datasets in the subpackage (perhaps through a config file?)
...
Then we can make springtime, on load, search for Dataset objects in the packages specified in the config file, and add those to the list of Datasets it can work with.
The text was updated successfully, but these errors were encountered:
There are several plugin frameworks for Python, e.g. Pluggy, used for pytest. But we could also use entrypoints directly, as they're part of the standard library and we might not need much more functionality.
Springtime currently offers a nice, streamlined way to download data from several sources. It was designed to be extensible, in the sense that it should be easy to add more data sources. However, new data sources typically come with additional requirements (e.g. #54) and licenses (e.g. #63). This could eventually render the whole package cumbersome to work with.
It would be nice if we could separate the package into a core module with optional data source subsets. There are two main options:
Option 1 might lead to duplication and it moves away from the ideal of having a one-stop-shop for all your data workflows. This is why I would prefer option 2. To make that work, we need a mechanism to register subset packages into springtime.
Perhaps something like:
Where the last command should:
Then we can make springtime, on load, search for Dataset objects in the packages specified in the config file, and add those to the list of Datasets it can work with.
The text was updated successfully, but these errors were encountered: