Skip to content

zihuixue/MKE

Folders and files

NameName
Last commit message
Last commit date

Latest commit

author
sherry xue
Aug 28, 2021
7600bd5 · Aug 28, 2021

History

3 Commits
Aug 28, 2021
Aug 14, 2021
Aug 14, 2021

Repository files navigation

MKE

[ICCV 2021] Multimodal Knowledge Expansion (MKE)

This repo provides the implementation of the following ICCV 2021 paper: "Multimodal Knowledge Expansion" (MKE). Paper, Project Page.

framework

(1) TwoMoon Example

We generate sythetic TwoMoon data. The data located at the upper moon and lower moon have true labels 0 and 1, and are colored by red and blue, respectively. Two modalities (α and β) are interpreted as observing from the X-axis and Y-axis.

Twomoon

Code: see TwoMoon/mke.ipynb

(2) RAVDESS Emotion Recogntion

Image + Audio emotion recognition

Dataset: The Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS). [link]

About

[ICCV 2021] Multimodal Knowledge Expansion

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published