Skip to content

Commit

Permalink
added a hyperparameters section in README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
Madjid-CH committed Jun 4, 2024
1 parent 0334f83 commit 8805878
Showing 1 changed file with 12 additions and 0 deletions.
12 changes: 12 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,7 @@
* [Prerequisites](#prerequisites)
* [Installation](#installation)
* [Usage](#usage)
* [Hyperparameters](#hyperparameters)

## About The Project

Expand Down Expand Up @@ -46,5 +47,16 @@ pip install -r requirements.txt
python run.py
```

## Hyperparameters

We compare MixMAS's performance against M2-Mixer. The hyperparameters of M2-Mixer are as follows:

| Dataset | Hidden Dim. | Patch Sizes | Token Dim. | Channel Dim. | Blocks (modality 1/ modality 2 / Fusion) | Params (M) |
|-----------|-------------|---------------------|------------|--------------|------------------------------------------|------------|
| MM-IMDB | 256 | 16 Image / 512 Text | 32 | 3072 | 4 / 4 / 2 | 16.7 |
| AV-MNIST | 128 | 14 Image / 56 Audio | 32 | 3072 | 4 / 4 / 2 | 8.3 |
| MIMIC-III | 64 | 24 Time-series / - | 16 | 64 | 1 / 2 / 1 | 0.029 |

All the blocks in the M2-Mixer are MLP-Mixer blocks.
For MixMAS,
the hyperparameters are the same except for the type of the blocks that will be selected during the micro benchmarking.

0 comments on commit 8805878

Please sign in to comment.