| Naslov: | Capturing Conversational Gestures for Embodied Conversational Agents Using an Optimized Kaneda–Lucas–Tomasi Tracker and Denavit–Hartenberg-Based Kinematic Model |
|---|
| Avtorji: | ID Močnik, Grega (Avtor)
ID Kačič, Zdravko (Avtor)
ID Šafarič, Riko (Avtor)
ID Mlakar, Izidor (Avtor), et al. |
|---|
| Datoteke: |  sensors-22-08318-v4_(2).pdf (5,04 MB)
MD5: 5306D97DC6FF127430067B1CC1BE5D1F
 https://www.mdpi.com/1424-8220/22/21/8318
|
|---|
| Jezik: | Angleški jezik |
|---|
| Vrsta gradiva: | Članek v reviji |
|---|
| Tipologija: | 1.01 - Izvirni znanstveni članek |
|---|
| Organizacija: | FERI - Fakulteta za elektrotehniko, računalništvo in informatiko
|
|---|
| Opis: | In order to recreate viable and human-like conversational responses, the artificial entity, i.e., an embodied conversational agent, must express correlated speech (verbal) and gestures (non-verbal) responses in spoken social interaction. Most of the existing frameworks focus on intent planning and behavior planning. The realization, however, is left to a limited set of static 3D representations of conversational expressions. In addition to functional and semantic synchrony between verbal and non-verbal signals, the final believability of the displayed expression is sculpted by the physical realization of non-verbal expressions. A major challenge of most conversational systems capable of reproducing gestures is the diversity in expressiveness. In this paper, we propose a method for capturing gestures automatically from videos and transforming them into 3D representations stored as part of the conversational agent’s repository of motor skills. The main advantage of the proposed method is ensuring the naturalness of the embodied conversational agent’s gestures, which results in a higher quality of human-computer interaction. The method is based on a Kanade–Lucas–Tomasi tracker, a Savitzky–Golay filter, a Denavit–Hartenberg-based kinematic model and the EVA framework. Furthermore, we designed an objective method based on cosine similarity instead of a subjective evaluation of synthesized movement. The proposed method resulted in a 96% similarity. |
|---|
| Ključne besede: | conversational gestures, 3D gestures, motor skills, gesture reconstruction, kinematics, embodied conversational agents, Kanade–Lucas–Tomasi tracker, Denavit–Hartenberg |
|---|
| Status publikacije: | Objavljeno |
|---|
| Verzija publikacije: | Objavljena publikacija |
|---|
| Poslano v recenzijo: | 08.09.2022 |
|---|
| Datum sprejetja članka: | 27.10.2022 |
|---|
| Datum objave: | 29.10.2022 |
|---|
| Založnik: | MDPI |
|---|
| Leto izida: | 2022 |
|---|
| Št. strani: | str. 8318 |
|---|
| Številčenje: | Vol. 22, no. 21 |
|---|
| PID: | 20.500.12556/DKUM-83622-bf7c05a8-687f-36cd-f0bc-46410cd07243  |
|---|
| UDK: | 004.5 |
|---|
| eISSN: | 1424-8220 |
|---|
| COBISS.SI-ID: | 127923459 |
|---|
| DOI: | 10.3390/s22218318 |
|---|
| ISSN pri članku: | 1424-8220 |
|---|
| Avtorske pravice: | © 2022 by the authors |
|---|
| Datum objave v DKUM: | 20.01.2023 |
|---|
| Število ogledov: | 763 |
|---|
| Število prenosov: | 171 |
|---|
| Metapodatki: |    |
|---|
| Področja: | Ostalo
|
|---|
|
:
|
Kopiraj citat |
|---|
| | | | Skupna ocena: | (0 glasov) |
|---|
| Vaša ocena: | Ocenjevanje je dovoljeno samo prijavljenim uporabnikom. |
|---|
| Objavi na: |  |
|---|
Postavite miškin kazalec na naslov za izpis povzetka. Klik na naslov izpiše
podrobnosti ali sproži prenos. |
