{"id":5434,"date":"2023-10-14T14:45:04","date_gmt":"2023-10-14T05:45:04","guid":{"rendered":"https:\/\/carelab.info\/?p=5434"},"modified":"2025-01-03T16:38:01","modified_gmt":"2025-01-03T07:38:01","slug":"prof-perusquias-paper-was-presented-at-acm-icmi-2023","status":"publish","type":"post","link":"https:\/\/carelab.info\/en\/2023\/10\/14\/prof-perusquias-paper-was-presented-at-acm-icmi-2023\/","title":{"rendered":"Prof. Perusquia&#8217;s paper was presented at ACM ICMI 2023"},"content":{"rendered":"<p>Prof. Perusquia&#8217;s following paper\u00a0<span style=\"box-sizing: border-box; margin: 0px; padding: 0px;\">was presented at\u00a0<a href=\"https:\/\/icmi.acm.org\/2023\/\" target=\"_blank\" rel=\"noopener\">ACM ICMI 2023 (2023 25th ACM International Conference on Multimodal Interaction)<\/a>, <\/span>held from 9-13 October in Paris, France.<\/p>\n<ul>\n<li>Deffrennes, A., Vincent, L., Pivette, M., El Haddad, K., Bailey, J.D., Perusqu\u00eda-Hern\u00e1ndez, M., Alarc\u00e3o, S.M., Dutoit, T. &#8220;<a href=\"https:\/\/dl.acm.org\/doi\/10.1145\/3610661.3617155\" class=\"broken_link\">The Limitations of Current Similarity-Based Objective Metrics In the Context of Human-Agent Interaction Applications<\/a>&#8220;<\/li>\n<\/ul>\n<p><strong>(Abstract)<\/strong> There are two main ways of evaluating a model generating an interactive virtual agent\u2019s expressions. The first is through subjective perception tests, and the second is through objective metrics, which usually compare the model\u2019s generated expressions to a test set of expressions considered the ground truth. In this work, we argue that using such objective metrics comparing generated expressions, to expressions contained in a test set limits the accuracy of the evaluation by failing to consider expressions that are different from the test set, but are still valid and well-perceived by users. We support this argument through experiments showing that different expression sequences are well perceived as listening responses to the same speaker\u2019s utterance.<\/p>\n<p><img loading=\"lazy\" class=\"alignnone size-full wp-image-5441\" src=\"https:\/\/carelab.info\/wp-content\/uploads\/2023\/10\/ICMI2023_Deffrennespaper.png\" alt=\"\" width=\"1662\" height=\"826\" srcset=\"https:\/\/carelab.info\/wp-content\/uploads\/2023\/10\/ICMI2023_Deffrennespaper.png 1662w, https:\/\/carelab.info\/wp-content\/uploads\/2023\/10\/ICMI2023_Deffrennespaper-300x149.png 300w, https:\/\/carelab.info\/wp-content\/uploads\/2023\/10\/ICMI2023_Deffrennespaper-768x382.png 768w, https:\/\/carelab.info\/wp-content\/uploads\/2023\/10\/ICMI2023_Deffrennespaper-1536x763.png 1536w\" sizes=\"(max-width: 1662px) 100vw, 1662px\" \/><\/p>\n<p>&nbsp;<\/p>","protected":false},"excerpt":{"rendered":"<p>Prof. Perusquia&#8217;s following paper\u00a0was presented at\u00a0ACM ICMI 2023 (2023 25th ACM International Conference on Multimodal Interaction), held from 9-13 October in Paris, France. Deffrennes, A., Vincent, L., Pivette, M., El Haddad, K., Bailey, J.D., Perusqu\u00eda-Hern\u00e1ndez, M., Alarc\u00e3o, S.M., Dutoit, T. <a class=\"more-link\" href=\"https:\/\/carelab.info\/en\/2023\/10\/14\/prof-perusquias-paper-was-presented-at-acm-icmi-2023\/\">More &#8230;<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"pgc_meta":""},"categories":[1],"tags":[],"aioseo_notices":[],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/carelab.info\/en\/wp-json\/wp\/v2\/posts\/5434"}],"collection":[{"href":"https:\/\/carelab.info\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/carelab.info\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/carelab.info\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/carelab.info\/en\/wp-json\/wp\/v2\/comments?post=5434"}],"version-history":[{"count":4,"href":"https:\/\/carelab.info\/en\/wp-json\/wp\/v2\/posts\/5434\/revisions"}],"predecessor-version":[{"id":5463,"href":"https:\/\/carelab.info\/en\/wp-json\/wp\/v2\/posts\/5434\/revisions\/5463"}],"wp:attachment":[{"href":"https:\/\/carelab.info\/en\/wp-json\/wp\/v2\/media?parent=5434"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/carelab.info\/en\/wp-json\/wp\/v2\/categories?post=5434"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/carelab.info\/en\/wp-json\/wp\/v2\/tags?post=5434"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}