Multimodal Learning

OSMO: Open-vocabulary Self-eMOtion Tracking featured image

OSMO: Open-vocabulary Self-eMOtion Tracking

OSIRIS is an egocentric multimodal LLM for continuous, open-vocabulary human-state tracking from smart glasses.

mohamed-abdelfattah
OSKAR: Omnimodal Self-supervised Knowledge Abstraction and Representation featured image

OSKAR: Omnimodal Self-supervised Knowledge Abstraction and Representation

OSKAR is a self-supervised multimodal foundation model that learns in the latent space by predicting masked multimodal features.

mohamed-abdelfattah