Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Add Multichain API to @metamask/multichain #4813

Merged
merged 222 commits into from
Jan 22, 2025
Merged

Conversation

jiexi
Copy link
Contributor

@jiexi jiexi commented Oct 17, 2024

Explanation

This PR updates @metamask/multichain to add method handlers and middleware specific to the new Multichain API and which can be shared across the extension & mobile clients. The package includes implementations for managing multichain sessions, handling multichain RPC methods, and integrating multichain functionalities into the MetaMask extension. Key features of this package include:

  • Method Handlers: Implementations of the new RPC method handlers like wallet_createSession, wallet_invokeMethod, wallet_revokeSession, and wallet_getSession.
  • ScopesObject Transforms: Adds helpers that transform between NormalizedScopesObject and InternalScopesObject
  • Concurrent Eth Subscriptions: Adds helpers that orchestrate eth_subscriptions to numerous chains concurrently

These tools and utilities will be used in both clients (mobile + extension)'s multichain API implementations.

File Overview

  • packages/multichain/src/adapters/caip-permission-adapter-middleware.ts: Middleware for the EIP-1193 API that enforces a CAIP-25 permission for each request if that CAIP-25 permission was granted via wallet_createSession
  • packages/multichain/src/handlers/wallet-getSession.ts: Handlers for CAIP Multichain lifecycle methods except for wallet_createSession which seemed a little too platform specific to belong in a shared package currently
  • packages/multichain/src/middlewares/: Middleware for the Multichain API that helps facilitate concurrent eth subscriptions and for using @metamask/api-specs for method param validation for new CAIP Multichain methods
  • packages/multichain/src/scope/authorization.ts: Adds helpers that sort scopes based on if they are currently supported by the wallet (i.e. a network already exists the eip155 scope), if they could be supported by the wallet (i.e. the network does not already exist for the eip155 scope, but the dapp has provided EIP-3085 details for adding the network in the scopedProperties property of the wallet_createSession request), or if they cannot be served.
  • packages/multichain/src/scope/filter.ts: provides helpers used for the bucketing above in authorization.ts
  • types/@metamask/eth-json-rpc-filters.d.ts: Typedef for missing types in @metamask/eth-json-rpc-filters/subscriptionManager

References

Upstream: #4784
Downstream: None. This is the end.

Key Multichain API Standards implemented here:

Open PR that uses this new package for exposing the multichain API in the extension: MetaMask/metamask-extension#27782

Changelog

@metamask/multichain

  • ADDED: Adds getInternalScopesObject and getSessionScopes helpers for transforming between NormalizedScopesObject and InternalScopesObject.
  • ADDED: Adds caipPermissionAdapterMiddleware for enforcing CAIP-25 permission on the EIP-1193 API.
  • ADDED: Adds walletGetSession, walletInvokeMethod, and walletRevokeSession handlers.
  • ADDED: Adds multichainMethodCallValidatorMiddleware for validating Multichain API method params as defined in @metamask/api-specs.
  • ADDED: Adds MultichainMiddlewareManager to multiplex a request to other middleware based on requested scope.
  • ADDED: Adds MultichainSubscriptionManager to handle concurrent subscriptions across multiple scopes.
  • ADDED: Adds bucketScopes which groups the scopes in a NormalizedScopesObject based on if the scopes are already supported, could be supported, or are not supportable.
  • ADDED: Adds getSupportedScopeObjects helper for getting only the supported methods and notifications from each NormalizedScopeObject in a NormalizedScopesObject.

Checklist

  • I've updated the test suite for new or updated code as appropriate
  • I've updated documentation (JSDoc, Markdown, etc.) for new or updated code as appropriate
  • I've highlighted breaking changes using the "BREAKING" category above as appropriate
  • I've prepared draft pull requests for clients and consumer packages to resolve any breaking changes

jiexi and others added 30 commits October 10, 2024 14:02
## Explanation
This PR fixes a lot of the linting and typescript errors. still some
left but this covers a lot of it.


<!--
Thanks for your contribution! Take a moment to answer these questions so
that reviewers have the information they need to properly understand
your changes:

* What is the current state of things and why does it need to change?
* What is the solution your changes offer and how does it work?
* Are there any changes whose purpose might not obvious to those
unfamiliar with the domain?
* If your primary goal was to update one package but you found you had
to update another one along the way, why did you do so?
* If you had to upgrade a dependency, why did you do so?
-->

## References

<!--
Are there any issues that this pull request is tied to?
Are there other links that reviewers should consult to understand these
changes better?
Are there client or consumer pull requests to adopt any breaking
changes?

For example:

* Fixes #12345
* Related to #67890
-->

## Changelog

<!--
If you're making any consumer-facing changes, list those changes here as
if you were updating a changelog, using the template below as a guide.

(CATEGORY is one of BREAKING, ADDED, CHANGED, DEPRECATED, REMOVED, or
FIXED. For security-related issues, follow the Security Advisory
process.)

Please take care to name the exact pieces of the API you've added or
changed (e.g. types, interfaces, functions, or methods).

If there are any breaking changes, make sure to offer a solution for
consumers to follow once they upgrade to the changes.

Finally, if you're only making changes to development scripts or tests,
you may replace the template below with "None".
-->

### `@metamask/package-a`

- **<CATEGORY>**: Your change here
- **<CATEGORY>**: Your change here

### `@metamask/package-b`

- **<CATEGORY>**: Your change here
- **<CATEGORY>**: Your change here

## Checklist

- [ ] I've updated the test suite for new or updated code as appropriate
- [ ] I've updated documentation (JSDoc, Markdown, etc.) for new or
updated code as appropriate
- [ ] I've highlighted breaking changes using the "BREAKING" category
above as appropriate
- [ ] I've prepared draft pull requests for clients and consumer
packages to resolve any breaking changes

---------

Co-authored-by: Jiexi Luan <[email protected]>
## Explanation

<!--
Thanks for your contribution! Take a moment to answer these questions so
that reviewers have the information they need to properly understand
your changes:

* What is the current state of things and why does it need to change?
* What is the solution your changes offer and how does it work?
* Are there any changes whose purpose might not obvious to those
unfamiliar with the domain?
* If your primary goal was to update one package but you found you had
to update another one along the way, why did you do so?
* If you had to upgrade a dependency, why did you do so?
-->
Added ESM exports for multichain package

## References

<!--
Are there any issues that this pull request is tied to?
Are there other links that reviewers should consult to understand these
changes better?
Are there client or consumer pull requests to adopt any breaking
changes?

For example:

* Fixes #12345
* Related to #67890
-->

## Changelog

<!--
If you're making any consumer-facing changes, list those changes here as
if you were updating a changelog, using the template below as a guide.

(CATEGORY is one of BREAKING, ADDED, CHANGED, DEPRECATED, REMOVED, or
FIXED. For security-related issues, follow the Security Advisory
process.)

Please take care to name the exact pieces of the API you've added or
changed (e.g. types, interfaces, functions, or methods).

If there are any breaking changes, make sure to offer a solution for
consumers to follow once they upgrade to the changes.

Finally, if you're only making changes to development scripts or tests,
you may replace the template below with "None".
-->

### `@metamask/package-a`

- **<CATEGORY>**: Your change here
- **<CATEGORY>**: Your change here

### `@metamask/package-b`

- **<CATEGORY>**: Your change here
- **<CATEGORY>**: Your change here

## Checklist

- [ ] I've updated the test suite for new or updated code as appropriate
- [ ] I've updated documentation (JSDoc, Markdown, etc.) for new or
updated code as appropriate
- [ ] I've highlighted breaking changes using the "BREAKING" category
above as appropriate
- [ ] I've prepared draft pull requests for clients and consumer
packages to resolve any breaking changes
);
expect(middlewareSpy).not.toHaveBeenCalled();
expect(nextSpy).not.toHaveBeenCalled();
expect(endSpy).toHaveBeenCalled();
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't follow the test change here, shouldn't next be called and not end?

Copy link
Contributor Author

@jiexi jiexi Jan 17, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it's because eth_subscribe is the method being called in this example (which results in end() being called since this triggers the case where eth_subscribe is called but no middleware is registered to handle it since we remove it as part of this scenario). I can either overload this to test both eth_subscribe and other, or split it into two methods

EDIT: I realized that the "eth_subscribe" request scenario already exists but was named poorly. I've changed this scenario back to calling something other than "eth_subscribe" and this test now expects nextSpy to be called again

237eb59

@adonesky1 adonesky1 enabled auto-merge (squash) January 20, 2025 15:01
@adonesky1 adonesky1 requested a review from mcmire January 21, 2025 01:13
@jiexi
Copy link
Contributor Author

jiexi commented Jan 21, 2025

@metamaskbot publish-preview

Copy link
Contributor

Preview builds have been published. See these instructions for more information about preview builds.

Expand for full list of packages and versions.
{
  "@metamask-previews/accounts-controller": "21.0.1-preview-2ba45577",
  "@metamask-previews/address-book-controller": "6.0.2-preview-2ba45577",
  "@metamask-previews/announcement-controller": "7.0.2-preview-2ba45577",
  "@metamask-previews/approval-controller": "7.1.2-preview-2ba45577",
  "@metamask-previews/assets-controllers": "46.0.0-preview-2ba45577",
  "@metamask-previews/base-controller": "7.1.1-preview-2ba45577",
  "@metamask-previews/build-utils": "3.0.2-preview-2ba45577",
  "@metamask-previews/composable-controller": "10.0.0-preview-2ba45577",
  "@metamask-previews/controller-utils": "11.4.5-preview-2ba45577",
  "@metamask-previews/ens-controller": "15.0.1-preview-2ba45577",
  "@metamask-previews/eth-json-rpc-provider": "4.1.7-preview-2ba45577",
  "@metamask-previews/gas-fee-controller": "22.0.2-preview-2ba45577",
  "@metamask-previews/json-rpc-engine": "10.0.2-preview-2ba45577",
  "@metamask-previews/json-rpc-middleware-stream": "8.0.6-preview-2ba45577",
  "@metamask-previews/keyring-controller": "19.0.3-preview-2ba45577",
  "@metamask-previews/logging-controller": "6.0.3-preview-2ba45577",
  "@metamask-previews/message-manager": "12.0.0-preview-2ba45577",
  "@metamask-previews/multichain": "2.0.0-preview-2ba45577",
  "@metamask-previews/name-controller": "8.0.2-preview-2ba45577",
  "@metamask-previews/network-controller": "22.1.1-preview-2ba45577",
  "@metamask-previews/notification-services-controller": "0.16.0-preview-2ba45577",
  "@metamask-previews/permission-controller": "11.0.5-preview-2ba45577",
  "@metamask-previews/permission-log-controller": "3.0.2-preview-2ba45577",
  "@metamask-previews/phishing-controller": "12.3.1-preview-2ba45577",
  "@metamask-previews/polling-controller": "12.0.2-preview-2ba45577",
  "@metamask-previews/preferences-controller": "15.0.1-preview-2ba45577",
  "@metamask-previews/profile-sync-controller": "4.1.0-preview-2ba45577",
  "@metamask-previews/queued-request-controller": "8.0.2-preview-2ba45577",
  "@metamask-previews/rate-limit-controller": "6.0.2-preview-2ba45577",
  "@metamask-previews/remote-feature-flag-controller": "1.3.0-preview-2ba45577",
  "@metamask-previews/selected-network-controller": "20.0.2-preview-2ba45577",
  "@metamask-previews/signature-controller": "23.2.0-preview-2ba45577",
  "@metamask-previews/token-search-discovery-controller": "1.0.0-preview-2ba45577",
  "@metamask-previews/transaction-controller": "43.0.0-preview-2ba45577",
  "@metamask-previews/user-operation-controller": "22.0.0-preview-2ba45577"
}

Copy link
Contributor

@mcmire mcmire left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Had a few more questions, but they are very minor. I didn't see anything that stood out to me this round!

if (result.errors) {
errors.push(
...result.errors.map((e) => {
return transformError(e, p, paramToCheck) as JsonRpcError;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nit: Why do we need to typecast here?

const errors: JsonRpcError[] = [];
for (const param of methodToCheck.params) {
if (!isObject(params)) {
return [rpcErrors.invalidParams()] as JsonRpcError[];
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nit: Why do we need to typecast here?

@@ -57,7 +57,7 @@ export const addPermittedEthChainId = (
caip25CaveatValue: Caip25CaveatValue,
chainId: Hex,
): Caip25CaveatValue => {
const scopeString = `eip155:${parseInt(chainId, 16)}`;
const scopeString = `eip155:${hexToBigInt(chainId).toString(10)}`;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is one of the few times I've seen the chain ID converted to a bigint instead of a BN!

@adonesky1 adonesky1 merged commit 16b3c05 into main Jan 22, 2025
123 checks passed
@adonesky1 adonesky1 deleted the caip-multichain-api branch January 22, 2025 19:05
@adonesky1 adonesky1 mentioned this pull request Jan 22, 2025
adonesky1 added a commit that referenced this pull request Jan 22, 2025
## @metamask/multichain
## [3.0.0]

### Add

- Add key Multichain API methods
([#4813](#4813))
- Adds `getInternalScopesObject` and `getSessionScopes` helpers for
transforming between `NormalizedScopesObject` and
`InternalScopesObject`.
- Adds `walletGetSession`, `walletInvokeMethod`, and
`walletRevokeSession` handlers.
- Adds `multichainMethodCallValidatorMiddleware` for validating
Multichain API method params as defined in @metamask/api-specs.
- Adds `MultichainMiddlewareManager` to multiplex a request to other
middleware based on requested scope.
- Adds `MultichainSubscriptionManager` to handle concurrent
subscriptions across multiple scopes.
- Adds `bucketScopes` which groups the scopes in a
`NormalizedScopesObject` based on if the scopes are already supported,
could be supported, or are not supportable.
- Adds `getSupportedScopeObjects` helper for getting only the supported
methods and notifications from each `NormalizedScopeObject` in a
`NormalizedScopesObject`.
- Fixes `removeScope` mutator incorrectly returning malformed CAIP-25
caveat values ([#5183](#5183)).

### Changed
- Bump `@metamask/controller-utils` from `^11.4.4` to `^11.4.5`
([#5012](#5135))
- Bump `@metamask/permission-controller` from `^11.0.4` to `^11.0.5`
([#5012](#5135))
- Bump `@metamask/utils` to `^11.0.1` and `@metamask/rpc-errors` to
`^7.0.2` ([#5080](#5080))

---------

Co-authored-by: jiexi <[email protected]>
@adonesky1 adonesky1 mentioned this pull request Jan 22, 2025
adonesky1 added a commit that referenced this pull request Jan 22, 2025
## `@metamask/multichain`

## [2.1.0]

### Added

- Add key Multichain API methods
([#4813](#4813))
- Adds `getInternalScopesObject` and `getSessionScopes` helpers for
transforming between `NormalizedScopesObject` and
`InternalScopesObject`.
- Adds handlers for `wallet_getSession`, `wallet_invokeMethod`, and
`wallet_revokeSession` methods.
- Adds `multichainMethodCallValidatorMiddleware` for validating
Multichain API method params as defined in @metamask/api-specs.
- Adds `MultichainMiddlewareManager` to multiplex a request to other
middleware based on requested scope.
- Adds `MultichainSubscriptionManager` to handle concurrent
subscriptions across multiple scopes.
- Adds `bucketScopes` which groups the scopes in a
`NormalizedScopesObject` based on if the scopes are already supported,
could be supported, or are not supportable.
- Adds `getSupportedScopeObjects` helper for getting only the supported
methods and notifications from each `NormalizedScopeObject` in a
`NormalizedScopesObject`.

### Changed

- Bump `@metamask/controller-utils` from `^11.4.4` to `^11.4.5`
([#5012](#5135))
- Bump `@metamask/permission-controller` from `^11.0.4` to `^11.0.5`
([#5012](#5135))
- Bump `@metamask/utils` to `^11.0.1` and `@metamask/rpc-errors` to
`^7.0.2` ([#5080](#5080))

### Fixed

- Fixes `removeScope` mutator incorrectly returning malformed CAIP-25
caveat values ([#5183](#5183)).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants