dc.contributor.author | Smolic, Aljosa | |
dc.contributor.author | Chalasani, Tejo | |
dc.date.accessioned | 2020-02-18T17:19:46Z | |
dc.date.available | 2020-02-18T17:19:46Z | |
dc.date.issued | 2019 | |
dc.date.submitted | 2019 | en |
dc.identifier.citation | Chalasani, T. & Smolic, A., Simultaneous Segmentation and Recognition: Towards more accurate Ego Gesture Recognition, 2019 | en |
dc.identifier.other | Y | |
dc.description | PUBLISHED | en |
dc.description.abstract | Ego hand gestures can be used as an interface in AR and
VR environments. While the context of an image is impor-
tant for tasks like scene understanding, object recognition,
image caption generation and activity recognition, it plays a
minimal role in ego hand gesture recognition. An ego hand
gesture used for AR and VR environments conveys the same
information regardless of the background. With this idea
in mind, we present our work on ego hand gesture recogni-
tion that produces embeddings from RBG images with ego
hands, which are simultaneously used for ego hand seg-
mentation and ego gesture recognition. To this extent, we
achieved better recognition accuracy (96.9%) compared to
the state of the art (92.2%) on the biggest ego hand gesture
dataset available publicly. We present a gesture recognition
deep neural network which recognises ego hand gestures
from videos (videos containing a single gesture) by gener-
ating and recognising embeddings of ego hands from image
sequences of varying length. We introduce the concept of
simultaneous segmentation and recognition applied to ego
hand gestures, present the network architecture, the train-
ing procedure and the results compared to the state of the
art on the EgoGesture dataset [31]. | en |
dc.language.iso | en | en |
dc.rights | Y | en |
dc.subject | Hand gestures | en |
dc.subject | Virtual reality | en |
dc.subject | Augmented reality | en |
dc.title | Simultaneous Segmentation and Recognition: Towards more accurate Ego Gesture Recognition | en |
dc.type | Conference Paper | en |
dc.type.supercollection | scholarly_publications | en |
dc.type.supercollection | refereed_publications | en |
dc.identifier.peoplefinderurl | http://people.tcd.ie/smolica | |
dc.identifier.rssinternalid | 212557 | |
dc.rights.ecaccessrights | openAccess | |
dc.subject.TCDTheme | Creative Technologies | en |
dc.subject.TCDTag | Multimedia & Creativity | en |
dc.subject.darat_impairment | Other | en |
dc.status.accessible | N | en |
dc.contributor.sponsor | SFI stipend | en |
dc.contributor.sponsorGrantNumber | 15/RP/277 | en |
dc.identifier.uri | https://arxiv.org/pdf/1909.08606.pdf | |
dc.identifier.uri | http://hdl.handle.net/2262/91580 | |