Utilize este identificador para referenciar este registo:
https://hdl.handle.net/1822/70952
Título: | Human action recognition using an image-based temporal and spatial representation |
Autor(es): | Silva, Vinicius Corrêa Alves Soares, Filomena Esteves, João Sena Vercelli, Gianni |
Palavras-chave: | Autism spectrum disorder Human action recognition Human computer interaction |
Data: | Out-2020 |
Editora: | IEEE |
Revista: | International Congress on Ultra Modern Telecommunications and Control Systems and Workshops |
Resumo(s): | Researchers have been using different technological solutions (platforms) as intervention tools with children with Autism Spectrum Disorder (ASD), who typically present difficulties in engaging and interacting with their peers. Social robots, one example of these technological solutions, are often unaware of their game partners, preventing the automatic adaptation of their behaviour to the user. Therefore, enriching the interaction between the user and the platform, lightening up the cognitive burden on the human operator, may be a valuable contribution. An information that can be used to enrich this interaction and, consequently, adapt the system behaviour is the recognition of different actions of the user through skeleton pose data from depth sensors. The present work proposes a method to automatically detect in real-time typical and stereotypical actions of children with ASD by using the Intel RealSense and the Nuitrack SDK to detect and extract the user joints coordinates. A Convolution Neural Network learning model trained on the different actions is used to classify the different patterns of behaviour. The model achieved an average accuracy of 92.6±0.5% on the test data. The entire pipeline runs on average at 31 FPS. |
Tipo: | Artigo em ata de conferência |
URI: | https://hdl.handle.net/1822/70952 |
ISBN: | 9781728192819 |
e-ISBN: | 978-1-7281-9281-9 |
DOI: | 10.1109/ICUMT51630.2020.9222408 |
ISSN: | 2157-0221 |
Versão da editora: | https://ieeexplore.ieee.org/document/9222408 |
Arbitragem científica: | yes |
Acesso: | Acesso restrito UMinho |
Aparece nas coleções: |
Ficheiros deste registo:
Ficheiro | Descrição | Tamanho | Formato | |
---|---|---|---|---|
Human-action-Silva.pdf Acesso restrito! | 737,76 kB | Adobe PDF | Ver/Abrir |