Xue, Bowen, GUARNERA, CLAUDIO, Zhao, Shuang et al. (1 more author) (2026) Physics-Guided Motion Loss for Video Generation Model. In: Conference proceedings, ICML 2026. ICML 2026 - Forty-Third International Conference on Machine Learning, 06-11 Jul 2026 ICML: International Conference on Machine Learning. ACM, KOR.
Abstract
Current video diffusion models generate visually compelling content but often struggle with physical motion, producing subtle artifacts like rubber-sheet deformations and inconsistent object motion. We introduce a frequency-domain physics prior that improves motion plausibility without modifying model architectures. Our method decomposes common motion patterns (translation, rotation, scaling) into lightweight spectral losses. Applied to Open-Sora, MVDIT, and Hunyuan, our approach improves both motion accuracy and action recognition by ∼11% on average on OpenVID-1M (relative), while maintaining visual quality. Additional results on Wan 2.1-14B show consistent gains on video-quality and physics-oriented metrics. User studies show 74-83% preference for our physics-enhanced videos. It also reduces warping error by 22-37% (depending on the backbone) and improves temporal consistency scores. These results indicate that simple, global spectral cues are an effective drop-in regularizer for physically plausible motion in video diffusion.
Metadata
| Item Type: | Proceedings Paper |
|---|---|
| Authors/Creators: |
|
| Copyright, Publisher and Additional Information: | This is an author-produced version of the published paper. Uploaded in accordance with the University’s Research Publications and Open Access policy. |
| Dates: |
|
| Institution: | The University of York |
| Academic Units: | The University of York > Faculty of Sciences (York) > Computer Science (York) |
| Date Deposited: | 03 Jun 2026 12:10 |
| Last Modified: | 02 Aug 2026 23:15 |
| Status: | Published |
| Publisher: | ACM |
| Series Name: | ICML: International Conference on Machine Learning |
| Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:241692 |
Download
Filename: Motion_aware_video_generative_model_.pdf
Description: Motion_aware_video_generative_model_
Licence: CC-BY 2.5
CORE (COnnecting REpositories)
CORE (COnnecting REpositories)