Modeling human-agent interaction using bayesian network technique

Yukiko Nakano, Kazuyoshi Murata, Mika Enomoto, Yoshiko Arimoto, Yasuhiro Asa, Hirohiko Sagawa

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Task manipulation is direct evidence of understanding, and speakers adjust their utterances that are in progress by monitoring listener's task manipulation. Aiming at developing animated agents that control multimodal instruction dialogues by monitoring users' task manipulation, this paper presents a probabilistic model of fine-grained timing dependencies among multimodal communication behaviors. Our preliminary evaluation demonstrated that our model quite accurately judges whether the user understand the agent's utterances and predicts user's successful mouse manipulation, suggesting that the model is useful in estimating user's understanding and can be applied to determining the next action of an agent.

Original languageEnglish
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Pages5-12
Number of pages8
Volume4914 LNAI
DOIs
Publication statusPublished - 2008
Externally publishedYes
Event21st Annual Conference of The Japanese Society for Artificial Intelligence, JSAI 2007 - Miyazaki, Japan
Duration: 2007 Jun 182007 Jun 22

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume4914 LNAI
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other21st Annual Conference of The Japanese Society for Artificial Intelligence, JSAI 2007
CountryJapan
CityMiyazaki
Period07/6/1807/6/22

Fingerprint

Bayesian networks
Monitoring
Communication

ASJC Scopus subject areas

  • Biochemistry, Genetics and Molecular Biology(all)
  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Nakano, Y., Murata, K., Enomoto, M., Arimoto, Y., Asa, Y., & Sagawa, H. (2008). Modeling human-agent interaction using bayesian network technique. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 4914 LNAI, pp. 5-12). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4914 LNAI). https://doi.org/10.1007/978-3-540-78197-4_2

Modeling human-agent interaction using bayesian network technique. / Nakano, Yukiko; Murata, Kazuyoshi; Enomoto, Mika; Arimoto, Yoshiko; Asa, Yasuhiro; Sagawa, Hirohiko.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 4914 LNAI 2008. p. 5-12 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4914 LNAI).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Nakano, Y, Murata, K, Enomoto, M, Arimoto, Y, Asa, Y & Sagawa, H 2008, Modeling human-agent interaction using bayesian network technique. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). vol. 4914 LNAI, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 4914 LNAI, pp. 5-12, 21st Annual Conference of The Japanese Society for Artificial Intelligence, JSAI 2007, Miyazaki, Japan, 07/6/18. https://doi.org/10.1007/978-3-540-78197-4_2
Nakano Y, Murata K, Enomoto M, Arimoto Y, Asa Y, Sagawa H. Modeling human-agent interaction using bayesian network technique. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 4914 LNAI. 2008. p. 5-12. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-540-78197-4_2
Nakano, Yukiko ; Murata, Kazuyoshi ; Enomoto, Mika ; Arimoto, Yoshiko ; Asa, Yasuhiro ; Sagawa, Hirohiko. / Modeling human-agent interaction using bayesian network technique. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 4914 LNAI 2008. pp. 5-12 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{480461ebbab44900827d65203e37a318,
title = "Modeling human-agent interaction using bayesian network technique",
abstract = "Task manipulation is direct evidence of understanding, and speakers adjust their utterances that are in progress by monitoring listener's task manipulation. Aiming at developing animated agents that control multimodal instruction dialogues by monitoring users' task manipulation, this paper presents a probabilistic model of fine-grained timing dependencies among multimodal communication behaviors. Our preliminary evaluation demonstrated that our model quite accurately judges whether the user understand the agent's utterances and predicts user's successful mouse manipulation, suggesting that the model is useful in estimating user's understanding and can be applied to determining the next action of an agent.",
author = "Yukiko Nakano and Kazuyoshi Murata and Mika Enomoto and Yoshiko Arimoto and Yasuhiro Asa and Hirohiko Sagawa",
year = "2008",
doi = "10.1007/978-3-540-78197-4_2",
language = "English",
isbn = "354078196X",
volume = "4914 LNAI",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "5--12",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

}

TY - GEN

T1 - Modeling human-agent interaction using bayesian network technique

AU - Nakano, Yukiko

AU - Murata, Kazuyoshi

AU - Enomoto, Mika

AU - Arimoto, Yoshiko

AU - Asa, Yasuhiro

AU - Sagawa, Hirohiko

PY - 2008

Y1 - 2008

N2 - Task manipulation is direct evidence of understanding, and speakers adjust their utterances that are in progress by monitoring listener's task manipulation. Aiming at developing animated agents that control multimodal instruction dialogues by monitoring users' task manipulation, this paper presents a probabilistic model of fine-grained timing dependencies among multimodal communication behaviors. Our preliminary evaluation demonstrated that our model quite accurately judges whether the user understand the agent's utterances and predicts user's successful mouse manipulation, suggesting that the model is useful in estimating user's understanding and can be applied to determining the next action of an agent.

AB - Task manipulation is direct evidence of understanding, and speakers adjust their utterances that are in progress by monitoring listener's task manipulation. Aiming at developing animated agents that control multimodal instruction dialogues by monitoring users' task manipulation, this paper presents a probabilistic model of fine-grained timing dependencies among multimodal communication behaviors. Our preliminary evaluation demonstrated that our model quite accurately judges whether the user understand the agent's utterances and predicts user's successful mouse manipulation, suggesting that the model is useful in estimating user's understanding and can be applied to determining the next action of an agent.

UR - http://www.scopus.com/inward/record.url?scp=49949116749&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=49949116749&partnerID=8YFLogxK

U2 - 10.1007/978-3-540-78197-4_2

DO - 10.1007/978-3-540-78197-4_2

M3 - Conference contribution

AN - SCOPUS:49949116749

SN - 354078196X

SN - 9783540781967

VL - 4914 LNAI

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 5

EP - 12

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

ER -