Video-MMLU

LOVEU@CVPR2025 Track 1B: Multi-Discipline Lecture Understanding Challenge Leaderboard

arXiv

GitHub

Huggingface

Wenhao Chai

Gaoang Wang

Leaderboard

🤩 Welcome to the Video-MMLU lecture hall! Is your model ready to be tested?

Class is in session! Submit your scores to see if your models make the honor roll. Professor is waiting...

Please remember to report your frame rate and tokens per frame with each submission.

#F stands for the frame sampling number of the input video, and #T stands for the visual tokens per frame.

BibTeX

@@misc{song2025videommlumassivemultidisciplinelecture,
                    title={Video-MMLU: A Massive Multi-Discipline Lecture Understanding Benchmark}, 
                    author={Enxin Song and Wenhao Chai and Weili Xu and Jianwen Xie and Yuxuan Liu and Gaoang Wang},
                    year={2025},
                    eprint={2504.14693},
                    archivePrefix={arXiv},
                    primaryClass={cs.CV},
                    url={https://arxiv.org/abs/2504.14693}, 
                }