The what, how, and why of naturalistic behavior

A Kennedy - Current opinion in neurobiology, 2022 - Elsevier
In the past few years, advances in machine learning have fueled an explosive growth of
descriptive and generative models of animal behavior. These new approaches offer higher …

Leaving flatland: Advances in 3D behavioral measurement

JD Marshall, T Li, JH Wu, TW Dunn - Current Opinion in Neurobiology, 2022 - Elsevier
Animals move in three dimensions (3D). Thus, 3D measurement is necessary to report the
true kinematics of animal movement. Existing 3D measurement techniques draw on …

The Mouse Action Recognition System (MARS) software pipeline for automated analysis of social behaviors in mice

C Segalin, J Williams, T Karigo, M Hui, M Zelikowsky… - Elife, 2021 - elifesciences.org
The study of naturalistic social behavior requires quantification of animals' interactions. This
is generally done through manual annotation—a highly time-consuming and tedious …

Multi-animal 3D social pose estimation, identification and behaviour embedding with a few-shot learning framework

Y Han, K Chen, Y Wang, W Liu, Z Wang… - Nature Machine …, 2024 - nature.com
The quantification of animal social behaviour is an essential step to reveal brain functions
and psychiatric disorders during interaction phases. While deep learning-based approaches …

The Caltech Fish Counting dataset: a benchmark for multiple-object tracking and counting

J Kay, P Kulits, S Stathatos, S Deng, E Young… - … on Computer Vision, 2022 - Springer
Abstract We present the Caltech Fish Counting Dataset (CFC), a large-scale dataset for
detecting, tracking, and counting fish in sonar videos. We identify sonar videos as a rich …

Videoprism: A foundational visual encoder for video understanding

L Zhao, NB Gundavarapu, L Yuan, H Zhou… - arxiv preprint arxiv …, 2024 - arxiv.org
We introduce VideoPrism, a general-purpose video encoder that tackles diverse video
understanding tasks with a single frozen model. We pretrain VideoPrism on a …

Self-supervised keypoint discovery in behavioral videos

JJ Sun, S Ryou, RH Goldshmid… - Proceedings of the …, 2022 - openaccess.thecvf.com
We propose a method for learning the posture and structure of agents from unlabelled
behavioral videos. Starting from the observation that behaving agents are generally the …

Mixed strategy Nash equilibrium for crowd navigation

M Muchen Sun, F Baldini, K Hughes… - … Journal of Robotics …, 2024 - journals.sagepub.com
Robots navigating in crowded areas should negotiate free space with humans rather than
fully controlling collision avoidance, as this can lead to freezing behavior. Game theory …

BKinD-3D: self-supervised 3D keypoint discovery from multi-view videos

JJ Sun, L Karashchuk, A Dravid… - Proceedings of the …, 2023 - openaccess.thecvf.com
Quantifying motion in 3D is important for studying the behavior of humans and other
animals, but manual pose annotations are expensive and time-consuming to obtain. Self …

Simple Behavioral Analysis (SimBA) as a platform for explainable machine learning in behavioral neuroscience

NL Goodwin, JJ Choong, S Hwang, K Pitts… - Nature …, 2024 - nature.com
The study of complex behaviors is often challenging when using manual annotation due to
the absence of quantifiable behavioral definitions and the subjective nature of behavioral …