Towards Cognitive-and-Immersive Systems: Experiments in a Shared (or common) Blockworld Framework

by   Matthew Peveler, et al.

As computational power has continued to increase, and sensors have become more accurate, the corresponding advent of systems that are cognitive-and-immersive (CAI) has come to pass. CAI systems fall squarely into the intersection of AI with HCI/HRI: such systems interact with and assist the human agents that enter them, in no small part because such systems are infused with AI able to understand and reason about these humans and their beliefs, goals, and plans. We herein explain our approach to engineering CAI systems. We emphasize the capacity of a CAI system to develop and reason over a "theory of the mind" of its humans partners. This capacity means that the AI in question has a sophisticated model of the beliefs, knowledge, goals, desires, emotions, etc. of these humans. To accomplish this engineering, a formal framework of very high expressivity is needed. In our case, this framework is a cognitive event calculus, a partciular kind of quantified multi-modal logic, and a matching high-expressivity planner. To explain, advance, and to a degree validate our approach, we show that a calculus of this type can enable a CAI system to understand a psychologically tricky scenario couched in what we call the cognitive blockworld framework (CBF). CBF includes machinery able to represent and plan over not merely blocks and actions, but also agents and their mental attitudes about other agents.


COKE: A Cognitive Knowledge Graph for Machine Theory of Mind

Theory of mind (ToM) refers to humans' ability to understand and infer t...

Adaptation and Communication in Human-Robot Teaming to Handle Discrepancies in Agents' Beliefs about Plans

When agents collaborate on a task, it is important that they have some s...

Deep Interpretable Models of Theory of Mind For Human-Agent Teaming

When developing AI systems that interact with humans, it is essential to...

Vygotskian Autotelic Artificial Intelligence: Language and Culture Internalization for Human-Like AI

Building autonomous artificial agents able to grow open-ended repertoire...

It Takes Two to Tango: Towards Theory of AI's Mind

Theory of Mind is the ability to attribute mental states (beliefs, inten...

Best-Response Bayesian Reinforcement Learning with Bayes-adaptive POMDPs for Centaurs

Centaurs are half-human, half-AI decision-makers where the AI's goal is ...

A DIKW Paradigm to Cognitive Engineering

Though the word cognitive has a wide range of meanings we define cogniti...

Please sign up or login with your details

Forgot password? Click here to reset