Add supporting presign for other cloud storage services

[suyanhanx]

We have implemented presign for s3. But haven't implemented it for other cloud services yet.

azblob and gcs are ready for implementing presign, just need some work on the opendal side. Other services may need some extra work at the reqsign side.

Originally posted by @Xuanwo in #2067 (comment)

What is presign?

presign, which allows users to pre-sign S3 or other cloud storage services' requests, with operations, expiration time, and HTTP headers. This enables users to execute the request elsewhere, providing greater flexibility and control.

How to implement presign operation for a service?

To implement presign for a service, the service needs to support pre-sign first in order to use it.

For a service that supports presign, we could do the following steps(We will take s3 as an example here):

1. Find the service related folder. We place those files in core/src/services/s3.
2. Implement request builder. We always place the actual request generation function in the core.rs. Currently, we offer three operations for ·presign· - stat, read, and write. You will need to implement those request builders according to the actual capabilities of the corresponding service.
   1. https://github.com/apache/incubator-opendal/blob/fdc8d8d2aea5d725a677244fae2b1a69075f9b25/core/src/services/s3/core.rs#L206
   2. https://github.com/apache/incubator-opendal/blob/fdc8d8d2aea5d725a677244fae2b1a69075f9b25/core/src/services/s3/core.rs#L235
   3. https://github.com/apache/incubator-opendal/blob/fdc8d8d2aea5d725a677244fae2b1a69075f9b25/core/src/services/s3/core.rs#L315
3. Map the operation to the request builder. In the backend.rs of the service, we will implement the presign method for Accessor. Within this method, we map the operation type in OpPresign to an actual request.
   1. https://github.com/apache/incubator-opendal/blob/fdc8d8d2aea5d725a677244fae2b1a69075f9b25/core/src/services/s3/backend.rs#L1056
4. Enable presign capability for our service. We are using behavior tests to ensure every service's behavior is the same. To enable testing for presign, simply enable the presign capability for the service. This capability will be checked during behavioral tests. You can achieve this by modifying the Accessor.info function implementation and adding presign: true to the Capability construction. So we will get:
   https://github.com/apache/incubator-opendal/blob/fdc8d8d2aea5d725a677244fae2b1a69075f9b25/core/src/services/s3/backend.rs#L910-L940
5. Finally, make sure the tests pass. Keep modifying your code until all the tests pass successfully.

Tasks:

• Add supporting presign for azblob #2118 @silver-ymz
• Add supporting presign support for gcs #2125 @silver-ymz

Waiting for reqsign side tasks finish

• obs
• oss

[cuichenli]

looks like reqsign supports both obs and oss now, may i pick this up?

[Xuanwo]

looks like reqsign supports both obs and oss now, may i pick this up?

Have fun!