Automatic summary assessment for intelligent tutoring systems

Article English OPEN
He, Yulan ; Hui, Siu C. ; Quan, Tho T. (2009)

Summary writing is an important part of many English Language Examinations. As grading students' summary writings is a very time-consuming task, computer-assisted assessment will help teachers carry out the grading more effectively. Several techniques such as latent semantic analysis (LSA), n-gram co-occurrence and BLEU have been proposed to support automatic evaluation of summaries. However, their performance is not satisfactory for assessing summary writings. To improve the performance, this paper proposes an ensemble approach that integrates LSA and n-gram co-occurrence. As a result, the proposed ensemble approach is able to achieve high accuracy and improve the performance quite substantially compared with current techniques. A summary assessment system based on the proposed approach has also been developed.
  • References (23)
    23 references, page 1 of 3

    Arroyo, I., Beck, J., Woolf, B., Beal, C., Schultz, K., 2000. Macroadapting animalwatch to gender and cognitive di®erences with respect to hint interactivity and symbolism. In: Gauthier, G., Frasson, C., VanLehn, K. (Eds.), Intelligent Tutoring Systems. LNCS 1839. pp. 574{583.

    Bransford, J., Brown, A., Cocking, R., 2000. How People Learn: Brain, Mind, and Experience & School. National Academy Press, Washington, DC.

    Chang, K., Chen, I., Sung, Y., 2002. The e®ect of concept mapping to enhance text comprehension and summarization. The Journal of Experimental Education 71 (1), 5{23.

    Chi, M., Siler, S., Jeong, H., Yamaguchi, T., Hausmann, R., 2001. Learning from human tutoring. Cognitive Science 25, 471{533.

    Clark, R., 2004. Design document for a guided experiential learning course. Final report on contract DAAD 19-99-D-0046-0004 from TRADOC to the Institute for Creative Technologies and the Rossier School of Education.

    Domingos, P., 2000. Bayesian averaging of classi¯ers and the over¯tting problem. In: Proceedings of the 17th International Conference on Machine Learning. Morgan Kaufmann, San Francisco, CA, pp. 223{230.

    Landauer, T., Foltz, P., Laham, D., 1998. Introduction to latent semantic analysis. Discourse Processes 25, 259{284.

    Landauer, T., Laham, D., Rehder, B., Schreiner, M. E., 1997. How well can passage meaning be derived without using word order? a comparison of latent semantic analysis and humans. In: Proceedings of the 19th Annual Conference of the Cognitive Science Society.

    Lane, H., August 2006. Intelligent tutoring systems: Prospects for guided practice and e±cient learning. In: Army's Science of Learning Workshop. Hampton, VA.

    Lee, J., 2005. O-Level English. Singapore Asian Publications (S) Pte Ltd.

  • Metrics
    0
    views in OpenAIRE
    0
    views in local repository
    65
    downloads in local repository

    The information is available from the following content providers:

    From Number Of Views Number Of Downloads
    Aston Publications Explorer - IRUS-UK 0 65
Share - Bookmark