Physics-informed computer vision: A review and perspectives

C Banerjee, K Nguyen, C Fookes, K George - ACM Computing Surveys, 2024 - dl.acm.org
The incorporation of physical information in machine learning frameworks is opening and
transforming many application domains. Here the learning process is augmented through …

Physgaussian: Physics-integrated 3d gaussians for generative dynamics

T **e, Z Zong, Y Qiu, X Li, Y Feng… - Proceedings of the …, 2024 - openaccess.thecvf.com
We introduce PhysGaussian a new method that seamlessly integrates physically grounded
Newtonian dynamics within 3D Gaussians to achieve high-quality novel motion synthesis …

Neural radiance fields in the industrial and robotics domain: applications, research opportunities and use cases

E Šlapak, E Pardo, M Dopiriak, T Maksymyuk… - Robotics and Computer …, 2024 - Elsevier
The proliferation of technologies, such as extended reality (XR), has increased the demand
for high-quality three-dimensional (3D) graphical representations. Industrial 3D applications …

Physdreamer: Physics-based interaction with 3d objects via video generation

T Zhang, HX Yu, R Wu, BY Feng, C Zheng… - … on Computer Vision, 2024 - Springer
Realistic object interactions are crucial for creating immersive virtual experiences, yet
synthesizing realistic 3D object dynamics in response to novel interactions remains a …

Vr-gs: A physical dynamics-aware interactive gaussian splatting system in virtual reality

Y Jiang, C Yu, T **e, X Li, Y Feng, H Wang… - ACM SIGGRAPH 2024 …, 2024 - dl.acm.org
As 3D content becomes increasingly prevalent, there'sa growing focus on the development
of engagements with 3D virtual content. Unfortunately, traditional techniques for creating …

Physgen: Rigid-body physics-grounded image-to-video generation

S Liu, Z Ren, S Gupta, S Wang - European Conference on Computer …, 2024 - Springer
We present PhysGen, a novel image-to-video generation method that converts a single
image and an input condition (eg., force and torque applied to an object in the image) to …

Dynamic mesh-aware radiance fields

YL Qiao, A Gao, Y Xu, Y Feng… - Proceedings of the …, 2023 - openaccess.thecvf.com
Embedding polygonal mesh assets within photorealistic Neural Radience Fields (NeRF)
volumes, such that they can be rendered and their dynamics simulated in a physically …

Artificial intelligence for science in quantum, atomistic, and continuum systems

X Zhang, L Wang, J Helwig, Y Luo, C Fu, Y **e… - arxiv preprint arxiv …, 2023 - arxiv.org
Advances in artificial intelligence (AI) are fueling a new paradigm of discoveries in natural
sciences. Today, AI has started to advance natural sciences by improving, accelerating, and …

Reconstruction and simulation of elastic objects with spring-mass 3d gaussians

L Zhong, HX Yu, J Wu, Y Li - European Conference on Computer Vision, 2024 - Springer
Reconstructing and simulating elastic objects from visual observations is crucial for
applications in computer vision and robotics. Existing methods, such as 3D Gaussians …

Pie-nerf: Physics-based interactive elastodynamics with nerf

Y Feng, Y Shang, X Li, T Shao… - Proceedings of the …, 2024 - openaccess.thecvf.com
We show that physics-based simulations can be seamlessly integrated with NeRF to
generate high-quality elastodynamics of real-world objects. Unlike existing methods we …