Lightning Pose: improved animal pose estimation via semi-supervised learning, Bayesian ensembling and cloud-native open-source tools
Contemporary pose estimation methods enable precise measurements of behavior via
supervised deep learning with hand-labeled video frames. Although effective in many cases …
supervised deep learning with hand-labeled video frames. Although effective in many cases …
replicAnt: a pipeline for generating annotated images of animals in complex environments using Unreal Engine
Deep learning-based computer vision methods are transforming animal behavioural
research. Transfer learning has enabled work in non-model species, but still requires hand …
research. Transfer learning has enabled work in non-model species, but still requires hand …
Whole-body simulation of realistic fruit fly locomotion with deep reinforcement learning
The body of an animal influences how the nervous system produces behavior. Therefore,
detailed modeling of the neural control of sensorimotor behavior requires a detailed model …
detailed modeling of the neural control of sensorimotor behavior requires a detailed model …
Ponymation: Learning Articulated 3D Animal Motions from Unlabeled Online Videos
We introduce a new method for learning a generative model of articulated 3D animal
motions from raw, unlabeled online videos. Unlike existing approaches for 3D motion …
motions from raw, unlabeled online videos. Unlike existing approaches for 3D motion …
Linking cognitive strategy, neural mechanism, and movement statistics in group foraging behaviors
Foraging for food is a rich and ubiquitous animal behavior that involves complex cognitive
decisions, and interactions between different individuals and species. There has been …
decisions, and interactions between different individuals and species. There has been …
UPose3D: Uncertainty-Aware 3D Human Pose Estimation with Cross-view and Temporal Cues
We introduce UPose3D, a novel approach for multi-view 3D human pose estimation,
addressing challenges in accuracy and scalability. Our method advances existing pose …
addressing challenges in accuracy and scalability. Our method advances existing pose …
Mask as Supervision: Leveraging Unified Mask Information for Unsupervised 3D Pose Estimation
Y Yang, Y Qiao, X Sun - European Conference on Computer Vision, 2024 - Springer
Automatic estimation of 3D human pose from monocular RGB images is a challenging and
unsolved problem in computer vision. In a supervised manner, approaches heavily rely on …
unsolved problem in computer vision. In a supervised manner, approaches heavily rely on …
Relax, it doesn't matter how you get there: A new self-supervised approach for multi-timescale behavior analysis
Unconstrained and natural behavior consists of dynamics that are complex and
unpredictable, especially when trying to predict what will happen multiple steps into the …
unpredictable, especially when trying to predict what will happen multiple steps into the …
Application of a novel deep learning–based 3D videography workflow to bat flight
Studying the detailed biomechanics of flying animals requires accurate three‐dimensional
coordinates for key anatomical landmarks. Traditionally, this relies on manually digitizing …
coordinates for key anatomical landmarks. Traditionally, this relies on manually digitizing …
Ponymation: Learning 3D Animal Motions from Unlabeled Online Videos
We introduce Ponymation, a new method for learning a generative model of articulated 3D
animal motions from raw, unlabeled online videos. Unlike existing approaches for motion …
animal motions from raw, unlabeled online videos. Unlike existing approaches for motion …