LANGUAGE & ROBOTS Lab 

The Cognitive View of Intelligence

Welcome to our Language and Robots Lab! Here, Language is explored from within its natural environment, that of Embodied and Enactive Interaction. Robots are developed with a human-centric perspective, to assist, interact and contribute to a better world. We embrace the new Generative AI era that has just started, searching though for cognitive ways to make it better.  We believe that the embodied cognition approach can provide a real breakthrough for achieving Artificial General Intelligence; thus, we focus on multimodal, multisensory cognition and the fundamental role of Natural Language.  Join us in this trip for research and development that integrates Language, Perception and Action taking into consideration how the human brain works. Let’s build together the next generation of intelligent agents that can engage into verbal interaction with humans and correlate what they perceive, do and say/hear!

MORE

Research   highlights

minimalist grammar of action

The Minimalist Grammar of Action. A formal specification of the structure of action, which employs the Chomskyan generative transformation grammar paradigm and is corroborated by neurobiological evidence. A minimal set of production rules in the sensorimotor domain in which the tool and affected object complements of an action have a primary role can be employed to produce any -and only feasible-  goal-directed action. Recursion, merge and move apply not only in human language, but in human action too.

PRAXICON Semantic Network

The PRAXICON Semantic Memory. A dynamic, recursive and referential semantic network with biological basis. Nodes in the PRAXICON may have a physical or abstract reference pertaining to entities, movements and features with multiple representations (symbolic, perceptual, motoric). It’s an embodied knowledge graph; associations are simple or recursive in nature and pertain to a finite set of pragmatic relation types. Stay tuned for the full release of the network (5K concepts, 15K associations, in English, Greek & French)!

COSMOROE cross media semantics framework

The COSMOROE Cross Modal Relations. A Framework for modeling the semantic interplay between different means of expression, when formulating multimodal messages. Verbal and perceptual representations of objects, agents, movements, gestures, events, and abstract concepts engage into a semantic interplay that ranges from simple one-to-one equivalence relations to forced equivalence (metonymic and metaphoric cases), contradiction, and complementarity.

POETICON Lithic Tools Object Affordances Experiments

The Poeticon Lithic Tools Multimodal Object Affordances Dataset. A Nature-published, large scale dataset on object affordances which resulted from a series of naturalistic cognitive experiments. Lithic tools as stimuli and a thinking aloud method elicited 95 hours of spontaneous speech from 120 participants comprising semantic information on object features, affordances and related arguments (justification, analogies etc.), as well as a rich set of pantomimes, gestures & exploratory acts.

snapshots in time