Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Task]: Setup an orchestration layer for running ECS python scripts #1242

Closed
1 task
coilysiren opened this issue Feb 14, 2024 · 0 comments · Fixed by #1247
Closed
1 task

[Task]: Setup an orchestration layer for running ECS python scripts #1242

coilysiren opened this issue Feb 14, 2024 · 0 comments · Fixed by #1247
Assignees
@coilysiren
Labels
project: grants.gov Grants.gov Modernization tickets
Milestone
API - Dev databas...

Comments

@coilysiren
Copy link
Collaborator

coilysiren commented Feb 14, 2024 •
edited
Loading

Summary

We need an orchestration layer that's responsible for, at a basic level, running a python script on a cron schedule. The orchestration layer should call a python script that resides in the same(ish) location as the existing data migrations. Most / all of the existing infrastructure for running data migrations should be used for this.

Options include:

  • AWS Step functions
  • AWS Event bridge
  • // some combination thereof //

Acceptance criteria

  • Terraform configuration for an orchestrator has been deployed and tested
@coilysiren coilysiren added the project: grants.gov Grants.gov Modernization tickets label Feb 14, 2024
@coilysiren coilysiren self-assigned this Feb 14, 2024
@coilysiren coilysiren mentioned this issue Feb 15, 2024
Merged
coilysiren added a commit that referenced this issue Feb 15, 2024
@coilysiren
[Issue 1242] AWS Event Bridge => Step Functions scheduler (#1247)
2214eef 
## Summary

Fixes #1242

### Time to review: __10 mins__

## Changes proposed

Adds a event bridge (every 2 minutes) => step functions => ECS task
pipeline. It's in the approximate form that we would want to use to run
an Oracle copy job.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@coilysiren coilysiren

Labels
project: grants.gov Grants.gov Modernization tickets
Projects
Simpler.Grants.gov Product Backlog
Archived in project
Milestone
API - Dev database (DB) replica
Development

Successfully merging a pull request may close this issue.

[Issue 1242] AWS Event Bridge => Step Functions scheduler HHS/simpler-grants-gov
2 participants
@acouch @coilysiren