Code

Implement remove command#89

Code

Open

rk1274 wants to merge 49 commits intodevelopwtsi-hgi/ibackup:developfrom remove-commandwtsi-hgi/ibackup:remove-commandCopy head branch name to clipboard

+3,550-399

Commits

Commits on Feb 18, 2025

• Add implentation to remove files and dirs from a set

  rk1274

  committed
  200ae79

  Copy full SHA for 200ae79

• Add implementation to remove metadata and files from iRODS

  rk1274

  committed
  2d73f4d

  Copy full SHA for 2d73f4d

• Add test for removing hardlink files

  rk1274

  committed
  ec3ce10

  Copy full SHA for ec3ce10

• Add implementation for removing hardlinks and dirs from iRODS

  rk1274

  committed
  45ab258

  Copy full SHA for 45ab258

• Add validation to check if files/dirs are in the set

  rk1274

  committed
  f3c6283

  Copy full SHA for f3c6283

• Refactor removeFilesFromIRODS and removeDirsFromIRODS functions

  rk1274

  committed
  b04ee4e

  Copy full SHA for b04ee4e

• Fix wrong implementation about deleting hardlink inodes file

  rk1274

  committed
  e8bfdf2

  Copy full SHA for e8bfdf2

• Add implementation to remove requester from iRODS metadata

  rk1274

  committed
  b879294

  Copy full SHA for b879294

• Add extra validation for different user`s sets with the same name WIP

  rk1274

  committed
  fc55102

  Copy full SHA for fc55102

• Refactor handleSetsAndRequesters

  rk1274

  committed
  3e418f2

  Copy full SHA for 3e418f2

• Fix bug when removing a failed file that was successful in a different set

  rk1274

  committed
  043d554

  Copy full SHA for 043d554

• Update set counts after removal WIP

  rk1274

  committed
  26fc4be

  Copy full SHA for 26fc4be

• Refactor SetNewCounts to recalculate file counts

  

  y-popov

  authored and

  rk1274

  committed
  ace746b

  Copy full SHA for ace746b

• Combine removeFiles and removeDirs endpoints and add recently removed to status

  rk1274

  committed
  73708fe

  Copy full SHA for 73708fe

• Implement removeQueue WIP

  rk1274

  committed
  48dc79d

  Copy full SHA for 48dc79d

• Finish implentation for removeQueue WIP

  rk1274

  committed
  25131d3

  Copy full SHA for 25131d3

• Finish removeQueue implementation

  rk1274

  committed
  973a34d

  Copy full SHA for 973a34d

• Update status to have a Removal status line when removing

  rk1274

  committed
  53aa3bb

  Copy full SHA for 53aa3bb

• Handle removal retries

  rk1274

  committed
  cd1bae3

  Copy full SHA for cd1bae3

• Refactor removeQueue implementation

  rk1274

  committed
  18c0cb8

  Copy full SHA for 18c0cb8

• Add handling for when an item is removed from iRODS but fails to be removed from DB and delint

  rk1274

  committed
  812e3a0

  Copy full SHA for 812e3a0

• Delint and fix tests

  rk1274

  committed
  6818231

  Copy full SHA for 6818231

• Refactor classification of a path to use db instead of file system

  rk1274

  committed
  2b954c6

  Copy full SHA for 2b954c6

• Modify code for pull request

  rk1274

  committed
  621627a

  Copy full SHA for 621627a

• Small PR fixes

  rk1274

  committed
  4b87f5b

  Copy full SHA for 4b87f5b

• Change implementation to carry out iRODS commands through a handler on the server

  rk1274

  committed
  596919f

  Copy full SHA for 596919f

• Store removeReq in db incase server shutdown WIP

  rk1274

  committed
  540463d

  Copy full SHA for 540463d

• Allow removal to recover if server goes down

  rk1274

  committed
  345cfbb

  Copy full SHA for 345cfbb

• Small PR fixes, and optimisation of GetFilesInDir

  rk1274

  committed
  9ae8992

  Copy full SHA for 9ae8992

• Move removal functionality from put pkg to remove pkg

  rk1274

  committed
  7d3b389

  Copy full SHA for 7d3b389

Commits on Feb 19, 2025

• Add new baton pkg and make remove.handler use baton.GetBatonHandler() WIP

  rk1274

  committed
  a4224f3

  Copy full SHA for a4224f3

• Make remove.handler use baton.GetBatonHandler()

  rk1274

  committed
  891de16

  Copy full SHA for 891de16

Commits on Feb 20, 2025

• Refactor code to move baton tests into baton pkg and add new tests

  rk1274

  committed
  12d625d

  Copy full SHA for 12d625d

• Add tests for mock (localHandler)

  rk1274

  committed
  22ac24f

  Copy full SHA for 22ac24f

Commits on Feb 21, 2025

• Add tests for remove pkg and refactor remove functions

  rk1274

  committed
  78ed27e

  Copy full SHA for 78ed27e

Commits on Feb 24, 2025

• make timeoutOp private again

  y-popov

  committed
  8b0158e

  Copy full SHA for 8b0158e

• Remove InitClients() function and move client creation into individual functions

  rk1274

  committed
  4815720

  Copy full SHA for 4815720

Commits on Feb 25, 2025

• Create and use new discoveredFolders bucket

  rk1274

  committed
  677d2c5

  Copy full SHA for 677d2c5

Commits on Feb 26, 2025

• Make RemoveRemoteFileAndHandleHardlink remove all empty parent folders

  rk1274

  committed
  667cead

  Copy full SHA for 667cead

Commits on Feb 27, 2025

• Add benchmark for removal tests WIP

  rk1274

  committed
  7227d5a

  Copy full SHA for 7227d5a

• Revert "Add benchmark for removal tests WIP"

  Show description for 0e9080a
  rk1274

  committed
  0e9080a

  Copy full SHA for 0e9080a

• Refactor removeEmptyFoldersRecursively to check the error from RemoveDir rather than using ListDir

  rk1274

  committed
  d9671bd

  Copy full SHA for d9671bd

Commits on Feb 28, 2025

• Ensure discovery and removal do not run at the same time WIP

  rk1274

  committed
  0dbd15a

  Copy full SHA for 0dbd15a

Commits on Mar 3, 2025

• Refactor waiting so discovery has priority over removal WIP

  rk1274

  committed
  72b15fc

  Copy full SHA for 72b15fc

Commits on Mar 4, 2025

• Refactor waiting so discovery has priority over removal

  rk1274

  committed
  46a9356

  Copy full SHA for 46a9356

• Merge remove bucket and exclude sub bucket into one removal sub bucket

  rk1274

  committed
  b2dc7fd

  Copy full SHA for b2dc7fd

Commits on Mar 5, 2025

• Add tests for new db functions

  Show description for fc04924
  

  rk1274

  and

  y-popov

  committed
  fc04924

  Copy full SHA for fc04924

• Refactor waiting to use new removeDiscoverLinker

  rk1274

  committed
  7821557

  Copy full SHA for 7821557

• Delint

  rk1274

  committed
  1f63017

  Copy full SHA for 1f63017