Human-Robot Communication System for an Isolated Environment

Isanka Diddeniya, Indika Wanniarachchi, Hansi Gunasinghe, Chinthaka Premachandra, Hiroharu Kawanaka

Research output: Contribution to journalArticlepeer-review

Abstract

In this paper, we demonstrated a service robot navigation system based on the Message Queuing Telemetry Transport (MQTT) protocol communication system that updates the real-time robot states for multiple users. The proposed office assistant robot (OABot) consists of a navigable structure, a mobile app, and a central control workstation and these three components intercommunicate via a wireless network. The voice-recognition mobile app is used to interact with users with voice commands; these voice commands are processed inside the workstation and actions are assigned to the moving robot accordingly. The robot can navigate inside the room using real-time maps while localizing itself in the environment. In addition, the robot is equipped with a digital camera to identify people in predefined locations in the room. The WiFi communication system is provided with RESTful and Mosquitto servers for better human-robot communication. Hence, multiple users are notified about the robot status through updates on the real-time states via the MQTT protocol. The developed system successfully navigates to the instructed destinations and identifies the target person with an average accuracy of 96%. Most importantly, in an isolated indoor environment with social distancing restrictions to perform, the proposed system is essentially useful for contactless delivery.

Original languageEnglish
Pages (from-to)63258-63269
Number of pages12
JournalIEEE Access
Volume10
DOIs
Publication statusPublished - 2022

Keywords

  • Human-robot interaction
  • MQTT protocol
  • RESTful
  • robot navigation

ASJC Scopus subject areas

  • Computer Science(all)
  • Materials Science(all)
  • Engineering(all)
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Human-Robot Communication System for an Isolated Environment'. Together they form a unique fingerprint.

Cite this