Skip to content
/ ceci Public
forked from LSSTDESC/ceci

Experimental pipeline prototype software

License

Notifications You must be signed in to change notification settings

eacharles/ceci

This branch is 236 commits behind LSSTDESC/ceci:master.

Folders and files

NameName
Last commit message
Last commit date

Latest commit

e52e956 · Feb 3, 2022
Aug 6, 2021
Feb 3, 2022
Mar 8, 2021
Jul 7, 2020
Jan 17, 2022
Jan 18, 2022
Dec 16, 2021
Jan 4, 2022
Jan 17, 2022
Jul 31, 2018
Jan 20, 2021
May 28, 2020
Dec 16, 2021
Apr 15, 2021

Repository files navigation

Ceci Logo

Ceci Pipeline Software

Continuous Integration Status Documentation Status Coverage Status PyPI Downloads

“Ceci n'est pas une pipeline.”

A lightweight parsl-based framework for running DESC pipelines.

This is now beta status.

Install

pip install ceci

This installs the simplest version of ceci, if you want to be able to use the parsl backend, install instead ceci[parsl].

You can then run an example pipeline from the ceci_lib directory using:

export PYTHONPATH=$PYTHONPATH:$PWD
ceci test/test.yml

Adding Pipeline Stages

To make new pipeline stages, you must:

  • make a new python package somewhere else, to contain your stages.
  • the package must have an __init__.py file that should import from . all the stages you want to use.
  • it must also have a file __main__.py with the same contents as the example in ceci_example.
  • each stage is its own class inheriting from ceci.PipelineStage. Each must define its name, inputs, and outputs, and a run method.
  • the run method should use the parent methods from PipelineStage to get its inputs and outputs etc.

About

Experimental pipeline prototype software

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Python 96.7%
  • Jupyter Notebook 3.3%