Storj

[zimbres]

Is it possible to use VolSync with Storj?

[JohnStrunk]

Maybe...

Rclone appears to support Tardigrade (https://rclone.org/tardigrade/), so it may be possible.
If you can create an rclone.conf that accesses your storage and can use rclone sync, there's a good chance you could get it working w/ VolSync.

If you want to give it a try:

• Take a look at the volsync rclone docs: https://volsync.readthedocs.io/en/stable/usage/rclone/index.html
• You're rclone.conf that is configured for Tardigrade will be what you use as the rclone Secret
• You will need to set rcloneConfigSection and rcloneDestPath appropriately in the ReplicationSource/ReplicationDestination
• The actual rclone commands that the VolSync mover executes are here:

  volsync/mover-rclone/active.sh

  Lines 23 to 33 in 2a78c57

  	source)
  	getfacl -R "${MOUNT_PATH}" > "${MOUNT_PATH}"/permissons.facl
  	rclone sync "${RCLONE_FLAGS[@]}" "${MOUNT_PATH}" "${RCLONE_CONFIG_SECTION}:${RCLONE_DEST_PATH}" --log-level DEBUG
  	rm -rf "${MOUNT_PATH}"/permissons.facl
  	rc=$?
  	;;
  	destination)
  	rclone sync "${RCLONE_FLAGS[@]}" "${RCLONE_CONFIG_SECTION}:${RCLONE_DEST_PATH}" "${MOUNT_PATH}" --log-level DEBUG
  	setfacl --restore="${MOUNT_PATH}"/permissons.facl || true
  	rm -rf "${MOUNT_PATH}"/permissons.facl
  	rc=$?

I'd love to hear if you get it working!

[RobotSail]

@zimbres Were you ever able to get this working? I'd also be curious to know

[RobotSail]

@zimbres Since Storj has S3-compatibility, you could use Storj with VolSync would be through rclone.

You could also set up an S3 bucket with a service such as Filebase and select Storj as your storage backend. This should work with any data mover that can be setup with an S3-compatible API, including rclone. You would also be able to use additional backends including Sia, IPFS, and Skynet, which are not directly supported through Rclone (yet).

[zimbres]

Hi, I wasn't aware, but Storj supports S3 Api.

When generating an Access Token, in the last step there is an option to generate S3 credentials.

[RobotSail]

I see that now. It also looks like rclone has direct support for Storj.