Towards on-site collaborative robotics : voice control, co-speech gesture and context-specific object recognition via ad-hoc communication

Thibault Schwartz, Sebastian Andraos, Jonathan Nelson, Chris Knapp, Bertrand Arnold

Research output: Chapter in Book / Conference PaperConference Paper

Abstract

![CDATA[This work presents a novel set of accessible and unified hardware and software solutions that facilitate the implementation of natural human-machine interactions, as required by collaborative robotics in both indoor and outdoor environments. This extensible framework supports vocal control, co-speech gestures, and object recognition with feature tracking and adaptive resolution. The interactions are based on a new network messaging protocol that allows any device using TCP/IP to share variables with the full abstraction of the original machine software platform and can therefore be used synchronously by a vast array of equipment including CNC machines, industrial robots, construction equipment, mobile devices and PLCs. We conclude with the description of a testing scenario to be deployed during the conference workshop.]]
Original languageEnglish
Title of host publicationRobotic Fabrication in Architecture, Art and Design 2016
PublisherSpringer
Pages388-397
Number of pages10
ISBN (Print)9783319263762
DOIs
Publication statusPublished - 2016
EventRob/Arch Robotic Fabrication in Architecture, Art and Design -
Duration: 1 Jan 2016 → …

Conference

ConferenceRob/Arch Robotic Fabrication in Architecture, Art and Design
Period1/01/16 → …

Keywords

  • human-robot interaction
  • artificial intelligence

Fingerprint

Dive into the research topics of 'Towards on-site collaborative robotics : voice control, co-speech gesture and context-specific object recognition via ad-hoc communication'. Together they form a unique fingerprint.

Cite this