Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Terminology: suite to workflow #4174

Merged
merged 21 commits into from
Apr 27, 2021
Merged

Conversation

hjoliver
Copy link
Member

@hjoliver hjoliver commented Apr 15, 2021

This is a small large-but-trivial change with no associated Issue (but discussed with the team!)

  • globally replace suite/Suite/SUITE with workflow/Workflow/WORKFLOW
    • thank @@#$$@# for easy command-line automation
  • rename all *suite* filenames as *workflow*
  • restore any back-compat references to suite.rc
  • fix style violations resulting from slightly longer lines
  • restore CYLC_SUITE_* job environment variables for back-compat

Note:

  • much easier to do this all at once than separate user-facing and internal changes
  • some use of the word suite should really be translated to scheduler rather than workflow, but I haven't done that (requires a careful look at each case)

Requirements check-list

  • I have read CONTRIBUTING.md and added my name as a Code Contributor.
  • Contains logically grouped changes (else tidy your branch by rebase).
  • Does not contain off-topic changes (use other PRs for other changes).
  • Already covered by existing tests.
  • Appropriate change log entry included.
  • documentation PR: Terminology: suite to workflow cylc-doc#238
  • No dependency changes.

@hjoliver hjoliver added this to the cylc-8.0b2 milestone Apr 15, 2021
@hjoliver hjoliver self-assigned this Apr 15, 2021
@hjoliver
Copy link
Member Author

All tests passing locally.

@hjoliver hjoliver marked this pull request as ready for review April 15, 2021 07:11
@MetRonnie MetRonnie self-requested a review April 15, 2021 09:35
Copy link
Contributor

@datamel datamel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have worked my way through the bulk of this PR.
Couple of comments.
All tests pass for me locally. I have also read through code changes.
Will re-review when the
TODO: restore CYLC_SUITE_* job environment variables for back-compat has been completed.
This change will break ui so will wait on giving explicit approval before a companion pr for cylc-uiserver is also approved.

tests/unit/parsec/test_include.py Outdated Show resolved Hide resolved
cylc/flow/scripts/reinstall.py Outdated Show resolved Hide resolved
cylc/flow/workflow_files.py Outdated Show resolved Hide resolved
cylc/flow/workflow_files.py Outdated Show resolved Hide resolved
cylc/flow/parsec/fileparse.py Outdated Show resolved Hide resolved
cylc/flow/scripts/install.py Outdated Show resolved Hide resolved
@hjoliver
Copy link
Member Author

I have worked my way through the bulk of this PR.

Thanks @datamel, I'm sure that was mildly painful!

@hjoliver
Copy link
Member Author

Should be good to go now. No need to merge for beta-1 release though.

Copy link
Contributor

@datamel datamel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have reviewed the final files that I didn't get to yesterday...
image!!!!
A couple of points....

  • (Minor) On occasion you have replaced suite server program with scheduler, did you want to sed workflow server program and change them all to scheduler for consistency?
  • (Minor) etc/bin/run-functional-tests has a couple of workflows that should be suites.
  • (Possibly more major) I have checkout out sibling PRs and get errors when my run directory contains a contact file with old fields e.g CYLC_SUITE_UUID.. this returns traceback to the user
    image
    Maybe we want some back compatibility, since users may encounter this problem?

Compatibility for cylc review was also raised by @dpmatthews, @wxtim has added this to his to do list.

cylc/flow/subprocpool.py Outdated Show resolved Hide resolved
etc/bin/run-functional-tests Outdated Show resolved Hide resolved
etc/bin/run-functional-tests Outdated Show resolved Hide resolved
@hjoliver
Copy link
Member Author

Good points @datamel, I'll address them soon...

cylc/flow/cfgspec/workflow.py Outdated Show resolved Hide resolved
cylc/flow/cfgspec/workflow.py Show resolved Hide resolved
cylc/flow/cfgspec/workflow.py Outdated Show resolved Hide resolved
cylc/flow/etc/job.sh Outdated Show resolved Hide resolved
cylc/flow/etc/syntax/cylc-mode.el Outdated Show resolved Hide resolved
cylc/flow/etc/syntax/cylc-mode.el Outdated Show resolved Hide resolved
cylc/flow/etc/syntax/cylc.lang Outdated Show resolved Hide resolved
cylc/flow/etc/syntax/cylc.vim Outdated Show resolved Hide resolved
cylc/flow/etc/syntax/cylc.xml Outdated Show resolved Hide resolved
cylc/flow/exceptions.py Outdated Show resolved Hide resolved
@hjoliver hjoliver force-pushed the suite-to-workflow branch from 69fc60c to d886b46 Compare April 21, 2021 05:54
@hjoliver hjoliver force-pushed the suite-to-workflow branch from d886b46 to ff94ee2 Compare April 21, 2021 06:08
@hjoliver hjoliver closed this Apr 21, 2021
@hjoliver hjoliver reopened this Apr 21, 2021
@hjoliver
Copy link
Member Author

(closed and reopened to trigger Actions)

@hjoliver
Copy link
Member Author

@datamel -

(Possibly more major) I have checkout out sibling PRs and get errors when my run directory contains a contact file with old fields e.g CYLC_SUITE_UUID.. this returns traceback to the user

Last commit fixes this. (It fixes cylc scan here, in case of old contact files, and the hub-reported errors if you pip install this branch into your ui-server).

@hjoliver
Copy link
Member Author

I think the test failures are spurious - something weird just happened (see comment on Element) ... but I'll come back to check later.

@hjoliver hjoliver closed this Apr 21, 2021
@hjoliver hjoliver reopened this Apr 21, 2021
cylc/flow/workflow_files.py Outdated Show resolved Hide resolved
cylc/flow/workflow_files.py Outdated Show resolved Hide resolved
@hjoliver
Copy link
Member Author

Tests passing 🎉

@hjoliver
Copy link
Member Author

Finally finished reviewing all the files 😅

Thanks, excellent reviewing! 💐

@hjoliver hjoliver force-pushed the suite-to-workflow branch from 1d40697 to 4833d6c Compare April 22, 2021 23:13
Copy link
Contributor

@datamel datamel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can confirm the issue that resulted in traceback on ui-server has been fixed.
Approved.

@oliver-sanders
Copy link
Member

thank @@#$$@# for easy command-line automation

Couldn't find any words in the English language which match that pattern, gonna have to be more specific.

Copy link
Member

@oliver-sanders oliver-sanders left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Well that was fun!

I think we need to keep the "suite" fields we provide to suiteworkflow/task event scripts (unless there's some clever logic handling that I didn't spot).

cylc/flow/etc/job.sh Outdated Show resolved Hide resolved
cylc/flow/etc/job.sh Outdated Show resolved Hide resolved
cylc/flow/task_events_mgr.py Outdated Show resolved Hide resolved
cylc/flow/task_events_mgr.py Show resolved Hide resolved
cylc/flow/workflow_events.py Outdated Show resolved Hide resolved
@hjoliver hjoliver force-pushed the suite-to-workflow branch from 6ced750 to 697c407 Compare April 27, 2021 05:36
Copy link
Member

@oliver-sanders oliver-sanders left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@oliver-sanders
Copy link
Member

Brace for conflicts, it's going in!

@oliver-sanders oliver-sanders merged commit 35a3d1b into cylc:master Apr 27, 2021
@hjoliver hjoliver deleted the suite-to-workflow branch April 27, 2021 20:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants