Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CVAT][Exchange Oracle] Data cleanup #2428

Merged
merged 29 commits into from
Sep 5, 2024

Conversation

Bobronium
Copy link
Contributor

@Bobronium Bobronium commented Aug 22, 2024

Description

  • Add support for escrow_finished event from reputation_oracle
  • Introduce common abstractions for dealing with crons and webhooks
  • Add data cleanup

Summary of changes

New: handling webhooks from reputation_oracle

  • escrow_completed
    • delete projects from CVAT
    • cleanup data in Exchange Oracle cloud storage
    • mark projects, tasks and jobs as deleted
    • send webhook to Recording Oracle with event escrow_cleaned

Changed: handling webhooks from job_launcher

  • escrow_created handling failure:
    • before:
      • delete project from CVAT
      • delete project from Exchange Oracle
    • now:
      • cleanup data in cloud storage
      • delete projects from CVAT
      • delete projects from Exchange Oracle
  • escrow_cancelled:
    • before:
      • mark projects as cancelled
    • now:
      • delete projects from CVAT
      • cleanup data in Exchange Oracle cloud storage
      • mark projects as cancelled
      • send webhook to Recording Oracle with event escrow_cleaned

How test the changes

New test module has been added as well as necessary changes to existing ones.

Related issues

Keywords for linking issues

Copy link

vercel bot commented Aug 22, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
human-dashboard-frontend ❌ Failed (Inspect) Sep 3, 2024 2:06pm
2 Skipped Deployments
Name Status Preview Comments Updated (UTC)
escrow-dashboard ⬜️ Ignored (Inspect) Visit Preview Sep 3, 2024 2:06pm
faucet-server ⬜️ Ignored (Inspect) Visit Preview Sep 3, 2024 2:06pm

@Bobronium Bobronium force-pushed the ba/exchange-oracle/data-cleanup branch from e673507 to c4945e4 Compare August 26, 2024 10:51
@Bobronium Bobronium changed the base branch from ba/add-ruff to develop August 27, 2024 10:17
@Bobronium Bobronium force-pushed the ba/exchange-oracle/data-cleanup branch from 872d08b to 901a61b Compare August 27, 2024 10:26
@Bobronium Bobronium marked this pull request as ready for review August 27, 2024 10:27
@Bobronium Bobronium changed the title [Exchange Oracle] Data cleanup [CVAT][Exchange Oracle] Data cleanup Aug 27, 2024
zhiltsov-max
zhiltsov-max previously approved these changes Sep 3, 2024
@Bobronium Bobronium merged commit ca5f007 into develop Sep 5, 2024
13 of 14 checks passed
@flopez7 flopez7 deleted the ba/exchange-oracle/data-cleanup branch November 5, 2024 13:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants