Usefulness, localizability, humanness, and language-benefit: additional evaluation criteria for natural language dialogue systems

Article English OPEN
AbuShawar, B; Atwell, E;
  • Publisher: Springer

Human–computer dialogue systems interact with human users using natural language. We used the ALICE/AIML chatbot architecture as a platform to develop a range of chatbots covering different languages, genres, text-types, and user-groups, to illustrate qualitative aspect... View more
  • References (39)
    39 references, page 1 of 4

    Abu Shawar, B., and Atwell, E. (2010). Chatbots: Can they serve as natural language interfaces to QA corpus? Proceedings of the Sixth IASTED International Conference Advances in Computer Science and Engineering (ACSE 2010), pp. 183-188.

    Aust, H., Oerder, M., Seide, F., and Steinbiss, V. (1995). The Philips Automatic Train Timetable Information System. Speech Communication 17: 249-262.

    Chai, J., Horvath, V., Nicolov, N., Stys-Budzikowska, M., Kambhatla, N., and Zadrozny, W. (2001b). Natural language sales assistant Ð A web-based dialog system for online sales. In Proceedings of the Thirteenth Innovative Applications of Artificial Intelligence Conference, pp. 19-26. The AAAI Press.

    Chai, J., Lin, J., Zadrozny, W., Ye, Y., Stys-Budzikowska, M., Horvath, V., Kambhatla, N., and Wolf, C. (2001a). The role of a natural language conversational interface in online sales: a case studyÓ. International Journal of Speech Technology, 4(3/4): 285-295.

    Colby, K. (1073). Simulation of belief systems. In R. Schank and K. Colby (Eds.), Computer Models of Thought and Language, San Francisco: Freeman, pp. 251-286.

    Colby, K., (1975). Artificial Paranoia: A Computer Simulation of Paranoid Processes. New York, NY, USA: Pergamon Press.

    Crockett, K., Bandar, Z., O'Shea , J. and Mclean, D. (2009). Bullying and debt: Developing novel applications of dialogue systems. In A. Jšnsson, J. Alexandersson, D. Traum and I. Zukerman (Eds.), Proceedings of the 6th IJCAI Workshop on Knowledge and Reasoning in Practical Dialogue Systems, Palo Alto, CA, USA: AAAI (

    Cunningham, H. (1999). A definition and short history of language engineering. Journal of Natural Language Engineering, 5(1): 1-16.

    Dahlbaeck, N., Jonsson, A., and Ahrenberg, A. (1993). Wizard of Oz studies: Why and how? Proceedings of Intelligent User Interfaces (IUI 93). New York, NY, USA: ACM Press. pp. 193-200.

    Dybkjaer, L., Bernsen, N.O. and Minker, W. (2004). Evaluation and usability of multimodal spoken language dialogue systems. Speech Communication 43(1-2): 33-54.

  • Metrics
Share - Bookmark