{"id":5434,"date":"2023-10-14T14:45:04","date_gmt":"2023-10-14T05:45:04","guid":{"rendered":"https:\/\/carelab.info\/?p=5434"},"modified":"2025-01-03T16:38:01","modified_gmt":"2025-01-03T07:38:01","slug":"prof-perusquias-paper-was-presented-at-acm-icmi-2023","status":"publish","type":"post","link":"https:\/\/carelab.info\/ja\/2023\/10\/14\/prof-perusquias-paper-was-presented-at-acm-icmi-2023\/","title":{"rendered":"\u30da\u30eb\u30b9\u30ad\u30a2\u52a9\u6559\u306e\u8ad6\u6587\u304c ACM ICMI 2023 \u306b\u3066\u767a\u8868\u3055\u308c\u307e\u3057\u305f"},"content":{"rendered":"<p>\u30da\u30eb\u30b9\u30ad\u30a2\u52a9\u6559\u306e\u5171\u8457\u8ad6\u6587\u304c\u300110\u6708\uff19\u65e5\u304b\u308913\u65e5\u306b\u30d5\u30e9\u30f3\u30b9\u30fb\u30d1\u30ea\u3067\u958b\u50ac\u3055\u308c\u305f<span style=\"box-sizing: border-box; margin: 0px; padding: 0px;\">\u00a0<a href=\"https:\/\/icmi.acm.org\/2023\/\" target=\"_blank\" rel=\"noopener\">ACM ICMI 2023 (2023 25th ACM International Conference on Multimodal Interaction)<\/a>\u00a0\u306b\u3066\u767a\u8868\u3055\u308c\u307e\u3057\u305f\u3002<\/span><\/p>\n<ul>\n<li>Deffrennes, A., Vincent, L., Pivette, M., El Haddad, K., Bailey, J.D., Perusqu\u00eda-Hern\u00e1ndez, M., Alarc\u00e3o, S.M., Dutoit, T. &#8220;<a href=\"https:\/\/dl.acm.org\/doi\/10.1145\/3610661.3617155\" class=\"broken_link\">The Limitations of Current Similarity-Based Objective Metrics In the Context of Human-Agent Interaction Applications<\/a>&#8220;<\/li>\n<\/ul>\n<p><strong>(Abstract)<\/strong> There are two main ways of evaluating a model generating an interactive virtual agent\u2019s expressions. The first is through subjective perception tests, and the second is through objective metrics, which usually compare the model\u2019s generated expressions to a test set of expressions considered the ground truth. In this work, we argue that using such objective metrics comparing generated expressions, to expressions contained in a test set limits the accuracy of the evaluation by failing to consider expressions that are different from the test set, but are still valid and well-perceived by users. We support this argument through experiments showing that different expression sequences are well perceived as listening responses to the same speaker\u2019s utterance.<\/p>\n<p><img loading=\"lazy\" class=\"alignnone size-full wp-image-5441\" src=\"https:\/\/carelab.info\/wp-content\/uploads\/2023\/10\/ICMI2023_Deffrennespaper.png\" alt=\"\" width=\"1662\" height=\"826\" srcset=\"https:\/\/carelab.info\/wp-content\/uploads\/2023\/10\/ICMI2023_Deffrennespaper.png 1662w, https:\/\/carelab.info\/wp-content\/uploads\/2023\/10\/ICMI2023_Deffrennespaper-300x149.png 300w, https:\/\/carelab.info\/wp-content\/uploads\/2023\/10\/ICMI2023_Deffrennespaper-768x382.png 768w, https:\/\/carelab.info\/wp-content\/uploads\/2023\/10\/ICMI2023_Deffrennespaper-1536x763.png 1536w\" sizes=\"(max-width: 1662px) 100vw, 1662px\" \/><\/p>","protected":false},"excerpt":{"rendered":"<p>\u30da\u30eb\u30b9\u30ad\u30a2\u52a9\u6559\u306e\u5171\u8457\u8ad6\u6587\u304c\u300110\u6708\uff19\u65e5\u304b\u308913\u65e5\u306b\u30d5\u30e9\u30f3\u30b9\u30fb\u30d1\u30ea\u3067\u958b\u50ac\u3055\u308c\u305f\u00a0A <a class=\"more-link\" href=\"https:\/\/carelab.info\/ja\/2023\/10\/14\/prof-perusquias-paper-was-presented-at-acm-icmi-2023\/\">More &#8230;<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"pgc_meta":""},"categories":[1],"tags":[],"aioseo_notices":[],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/carelab.info\/ja\/wp-json\/wp\/v2\/posts\/5434"}],"collection":[{"href":"https:\/\/carelab.info\/ja\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/carelab.info\/ja\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/carelab.info\/ja\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/carelab.info\/ja\/wp-json\/wp\/v2\/comments?post=5434"}],"version-history":[{"count":4,"href":"https:\/\/carelab.info\/ja\/wp-json\/wp\/v2\/posts\/5434\/revisions"}],"predecessor-version":[{"id":5463,"href":"https:\/\/carelab.info\/ja\/wp-json\/wp\/v2\/posts\/5434\/revisions\/5463"}],"wp:attachment":[{"href":"https:\/\/carelab.info\/ja\/wp-json\/wp\/v2\/media?parent=5434"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/carelab.info\/ja\/wp-json\/wp\/v2\/categories?post=5434"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/carelab.info\/ja\/wp-json\/wp\/v2\/tags?post=5434"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}