Video description: A survey of methods, datasets, and evaluation metrics

N Aafaq, A Mian, W Liu, SZ Gilani, M Shah - ACM Computing Surveys …, 2019 - dl.acm.org
Video description is the automatic generation of natural language sentences that describe
the contents of a given video. It has applications in human-robot interaction, hel** the …

[HTML][HTML] Generative models, linguistic communication and active inference

KJ Friston, T Parr, Y Yufik, N Sajid, CJ Price… - Neuroscience & …, 2020 - Elsevier
This paper presents a biologically plausible generative model and inference scheme that is
capable of simulating communication between synthetic subjects who talk to each other …

[PDF][PDF] Walk the talk: Connecting language, knowledge, and action in route instructions

M MacMahon, B Stankiewicz, B Kuipers - Def, 2006 - cdn.aaai.org
Following verbal route instructions requires knowledge of language, space, action and
perception. We present MARCO, an agent that follows free-form, natural language route …

Designing ecosystems of intelligence from first principles

KJ Friston, MJD Ramstead, AB Kiefer… - Collective …, 2024 - journals.sagepub.com
This white paper lays out a vision of research and development in the field of artificial
intelligence for the next decade (and beyond). Its denouement is a cyber-physical …

Embodied human computer interaction

J Pustejovsky, N Krishnaswamy - KI-Künstliche Intelligenz, 2021 - Springer
In this paper, we argue that embodiment can play an important role in the design and
modeling of systems developed for Human Computer Interaction. To this end, we describe a …

[PDF][PDF] De-hallucinator: Iterative grounding for llm-based code completion

A Eghbali, M Pradel - arxiv preprint arxiv:2401.01701, 2024 - jespereggers.com
Large languages models (LLMs) trained on datasets of publicly available source code have
established a new state-of-the-art in code completion. However, these models are mostly …

The mechanics of embodiment: A dialog on embodiment and computational modeling

G Pezzulo, LW Barsalou, A Cangelosi… - Frontiers in …, 2011 - frontiersin.org
Embodied theories are increasingly challenging traditional views of cognition by arguing
that conceptual representations that constitute our knowledge are grounded in sensory and …

Actions in the eye: Dynamic gaze datasets and learnt saliency models for visual recognition

S Mathe, C Sminchisescu - IEEE transactions on pattern …, 2014 - ieeexplore.ieee.org
Systems based on bag-of-words models from image features collected at maxima of sparse
interest point operators have been used successfully for both computer visual object and …

Semantic linking through spaces for cyber-physical-socio intelligence: A methodology

H Zhuge - Artificial intelligence, 2011 - Elsevier
Humans consciously and subconsciously establish various links, emerge semantic images
and reason in mind, learn linking effect and rules, select linked individuals to interact, and …

Machine morality: bottom-up and top-down approaches for modelling human moral faculties

W Wallach, C Allen, I Smit - Machine ethics and robot ethics, 2020 - taylorfrancis.com
The implementation of moral decision making abilities in artificial intelligence (AI) is a
natural and necessary extension to the social mechanisms of autonomous software agents …