Action Recognition

OSKAR: Omnimodal Self-supervised Knowledge Abstraction and Representation featured image

OSKAR: Omnimodal Self-supervised Knowledge Abstraction and Representation

OSKAR is a self-supervised multimodal foundation model that learns in the latent space by predicting masked multimodal features.

mohamed-abdelfattah
MaskCLR: Attention-Guided Contrastive Learning for Robust Action Representation Learning featured image

MaskCLR: Attention-Guided Contrastive Learning for Robust Action Representation Learning

MaskCLR improves the robustness of transformer-based action recognition methods against noisy and incomplete skeletons.

mohamed-abdelfattah
S-JEPA: Joint Embedding Predictive Architecture for Self-Supervised Skeletal Action Recognition featured image

S-JEPA: Joint Embedding Predictive Architecture for Self-Supervised Skeletal Action Recognition

S-JEPA is an instantiation of JEPA for self-supervised skeletal action recognition.

mohamed-abdelfattah
Automated detection of isolated REM sleep behavior disorder using computer vision featured image

Automated detection of isolated REM sleep behavior disorder using computer vision

A computer-vision pipeline using conventional 2D sleep-lab cameras to automatically detect iRBD from REM movement dynamics with up to 91.9% accuracy.

mohamed-abdelfattah
Toward contactless human thermal monitoring: A framework for Machine Learning-based human thermo-physiology modeling augmented with computer vision featured image

Toward contactless human thermal monitoring: A framework for Machine Learning-based human thermo-physiology modeling augmented with computer vision

A machine-learning human thermo-physiology model (ML-HTPM) developed to predict thermal response.

mohamad-rida