INTUITIV
Intuitive-nonverbal and informative-verbal robot-human communication
PROJECT DESCRIPTION
Intuitive communication meets intelligent robots
OBJECTIVES
In the INTUITIV project, non-verbal and verbal forms of human-robot communication are being developed for reference applications in the rehabilitation sector. The focus is on the investigation of the navigation dynamics, obstacles avoidance strategies and travel path of an autonomous robot in a hospital environment.
The objective is to build understanding and trust on the side of patients and caregivers for the actions of the robotic system. Likewise, the influence of iconic information in the form of sounds, displays, simulated eye movements, etc. on the perceptibility and the necessity of the appropriate use of linguistic communication will be analyzed.
Thus, a situation-adapted selection of the most adequate interaction option in each case is to be ensured. The long-term adaptation of communication to a user can thus be enabled and dynamically developed through an iterative evaluation process.
INNOVATION & METHODOLOGY
By exploring non-verbal and verbal forms of communication, new approaches to human-technology interaction are developed in addition to motor movements of the robot, and prerequisites for a successful user-centered exchange of information are created.
OUR CONTRIBUTION
Within the scope of the project, Gestalt Robotics mainly performs tasks with a focus on image processing and visual navigation. This includes the determination of robot motion from camera images, the detection of persons, and the detection of obstacles and interfering objects to avoid collisions.
In addition, methods for determining the position and orientation (pose) of objects are implemented to enable grasping, presentation, and transfer operations.
Key facts
Robot for the humans
Pick up at the reception
Guides the guests to the destination
Is considerate of people
Highly Adaptive
Orients itself to the movements of people
Communicates via image and sound with video analysis and voice recognition
Safe Navigation
Global path network planning
Cooperative mission planning
Robust navigation in hospital environment
Environmental Understanding
Object pose detection
Person recognition
Visual pose estimation
PartnerS & CONSORTIUM
E&K ROBOTICS GmbH
Project management, adaptation of own robot platform, handling of legal issues, development of software (together with Gestalt Robotics): navigation, motion planning, location determination, environment recognition, and mission and motion planning
Deutsches Forschungszentrum für Künstliche Intelligenz (DFKI)
Intuitive movement patterns, self-localization in busy environments, global mission and path planning, speech dialogues; situation-adapted dialog capabilities, flexible dialog strategies with semantic long-term memory, dialog modeling, integration
HFC Human Factors Consult GmbH
Set up a laboratory environment, conduct laboratory studies and field studies, develop criteria for implementing intuitive movement behaviors, evaluate user testing
Johannesbad Saarschleife AG & Co. KG
Prototypical realization of a novel low-power information display with enhanced resolution and integration to an optical module
Funding
Federal Ministry of Education and Research
Program
“Mensch-Technik-Interaktion: Technik zum Menschen bringen”, Förderschwerpunkt: “Roboter für Assistenzfunktionen”
Duration
06.2018 – 05.2021
Project Management Agency
VDI/VDE Innovation + Technik GmbH
ProjeCt poster
Project poster (German) as printable PDF
This project is/was financed with funding provided by the Federal Ministry of Education and Research under the “Mensch-Technik-Interaktion: Technik zum Menschen bringen” program and managed by the VDI/VDE Innovation + Technik GmbH. The author is responsible for the content of this publication.