Pusan National University Develops Adaptive Multi-Expert Framework for Dynamic 3D Reconstruction

New framework explores how complementary experts can be combined to better model diverse motions in dynamic 3D scene

BUSAN, South Korea, Aug. 27, 2026 /PRNewswire/ -- Dynamic scene reconstruction is challenging because real-world scenes contain diverse types of motion, and no single motion representation consistently performs best across all scenarios. Researchers from Pusan National University developed a Mixture-of-Experts approaches that combine complementary dynamic representations to better capture diverse motions in dynamic 3D scenes. These approaches improve reconstruction quality while exploring different trade-offs between model flexibility, performance, and efficiency.

Many AI technologies depend on accurately reconstructing dynamic 3D environments, from self-driving vehicles to immersive virtual reality. However, representing the wide variety of motions found in real-world scenes remains a fundamental challenge because no single dynamic representation can consistently model the diverse motions encountered in practice. Different Dynamic Gaussian Splatting (DGS) methods perform well under specific conditions, as each motion representation has its own strengths and limitations. As a result, a single representation often struggles to generalize across heterogeneous real-world dynamics.

To address this limitation, a team of researchers led by Professor Kyeongbo Kong from Pusan National University developed two complementary Mixture-of-Experts frameworks that combine the strengths of multiple motion representations. MoE-GS independently trains multiple dynamic Gaussian models and then adaptively blends their outputs through learned expert routing. In contrast, MoDE integrates multiple deformation experts during joint optimization using a shared Gaussian representation. Rather than relying on a single motion model, these frameworks leverage the complementary strengths of multiple specialized models to improve dynamic scene reconstruction. This paper was made available online on July 13, 2026 in the IEEE Transactions on Pattern Analysis and Machine Intelligence.

"We conducted a systematic analysis, and have come to the understanding that no existing Dynamic Gaussian Splatting method consistently performs best across diverse scenarios. Motivated by this finding, we introduce MoE-GS, the first framework that adaptively combines multiple specialized dynamic Gaussian models through a Mixture-of-Experts architecture instead of relying on a single representation," explains Prof. Kong.

The researchers found that combining complementary experts enable more accurate reconstruction of complex scenes containing multiple types of motion than relying on a single dynamic representation. The adaptive routing strategy allows the framework to blend the most appropriate expert for each region and time step, improving reconstruction quality while maintaining flexibility across diverse dynamic scenarios.

The team believes this adaptive approach could enhance AI systems used in robotics, digital twins, autonomous systems, and spatial computing by enabling more reliable reconstruction of complex environments with heterogeneous motion. Looking ahead, they suggest that accurately modeling diverse real-world dynamics will become increasingly important as AI evolves toward interacting more naturally with the physical world. They hope their work will provide a valuable foundation for future research in dynamic scene understanding, world models, and Physical AI.

Finally, Prof. Kong concludes, "Our findings suggest that combining multiple specialized motion representations can be an effective way to handle heterogeneous dynamics that are difficult for a single representation to model consistently."

Reference
Title of original paper: On the Design of Mixture-of-Experts for Dynamic Gaussian Splatting
Journal: IEEE Transactions on Pattern Analysis and Machine Intelligence
DOI: https://doi.org/10.1109/tpami.2026.3712736

About Pusan National University
Website: https://www.pusan.ac.kr/eng/Main.do

Contact:
Goon-Soo Kim
82 51 510 7928
[email protected]

SOURCE Pusan National University