Logo UK Logo MFF

The Prague Bulletin of Mathematical Linguistics


computational linguistics journal

ÚFAL
PBML

EVALD – a Pioneer Application for Automated Essay Scoring in Czech

Kateřina Rysová, Magdaléna Rysová, Michal Novák, Jiří Mírovský, Eva Hajičová

References:

  1. Ellis B. Page. The Use of the Computer in Analyzing Student Essays International Review of Education 14, pages 210–225, Springer, Berlin / Heidelberg, 1968. (http://doi.org/10.1007/BF01419938)
  2. Helen B. Ajay, P. I. Tillett, and Ellis B. Page. Analysis of Essays by Computer (AEC-II) Final Report to the National Center for Educational Research and Development, U.S. Department of Health, Education, and Welfare (Project No. 80101), pages 231, U.S. Department of Health, Education, and Welfare, Washington, D.C., 1973.
  3. Karel Šebesta, Hana Goláňová, Jana Letafková, and others. AKCES 1, data/software, LINDAT/CLARIN digital library at the Institute of Formal and Applied Linguistics, Charles University, Prague, Czech Republic, 2016.
  4. Maram F. Al-Jouie and Aqil M. Azmi. Automated Evaluation of School Children Essays in Arabic Procedia Computer Science: Arabic Computational Linguistics 117, pages 19 - 22, 2017. (http://doi.org/10.1016/j.procs.2017.10.089)
  5. Adriane Boyd, Jirka Hana, Lionel Nicolas, Detmar Meurers, Katrin Wisniewski, Andrea Abel, Karin Schöne, Barbora Štindlová, and Chiara Vettori. The MERLIN corpus: Learner language and the CEFR In Proceedings of the 9th International Conference on Language Resources and Evaluation (LREC 2014), pages 1281–1288, European Language Resources Association, Reykjav{í}k, Iceland, 2014.
  6. Bartosz Broda, Bartłomiej Nitoń, Włodzimierz Gruszczyński, and Maciej Ogrodniczuk. Measuring Readability of Polish Texts: Baseline Experiments In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14), pages 573–580, European Languages Resources Association (ELRA), Reykjavik, Iceland, 2014.
  7. Jill Burstein, Karen Kukich, Susanne Wolff, Chi Lu, and Martin Chodorow. Computer analysis of essays, Annual meeting of the National Council of Measurement in Education, San Diego, CA, 1998.
  8. Daniel Castro-Castro, Rocío Lannes-Losada, Montse Maritxalar, Ianire Niebla, Celia Pérez-Marqués, Nancy C. Álamo-Suárez, and Aurora Pons-Porrata. A Multilingual Application for Automated Essay Scoring In Advances in Artificial Intelligence – IBERAMIA 2008, pages 243–251, Springer Berlin Heidelberg, Berlin, Heidelberg, 2008. (http://doi.org/10.1007/978-3-540-88309-8_25)
  9. Karel Šebesta, Zuzanna Bedřichová, Kateřina Šormová, and others. AKCES 5 (CzeSL-SGT), data/software, LINDAT/CLARIN digital library at the Institute of Formal and Applied Linguistics, Charles University, Prague, Czech Republic, 2014.
  10. Peter W. Foltz, Darrell Laham, and Thomas K. Landauer. The Intelligent Essay Assessor: Applications to Educational Technology Interactive Multimedia Electronic Journal of Computer-Enhanced Learning 1, pages 939–944, 1999.
  11. Tsunenori Ishioka and Masayuki Kameda. Automated Japanese Essay Scoring System Based on Articles Written by Experts In Proceedings of the 21st International Conference on Computational Linguistics and the 44th Annual Meeting of the Association for Computational Linguistics, pages 233–240, Association for Computational Linguistics, Stroudsburg, PA, USA, 2006. (http://doi.org/10.3115/1220175.1220205)
  12. Philipp Koehn. Statistical Significance Tests for Machine Translation Evaluation In Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing, pages 388–395, Association for Computational Linguistics, Barcelona, Spain, 2004.
  13. Leah S. Larkey. Automatic Essay Grading Using Text Categorization Techniques In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 90–95, Association for Computing Machinery, New York, NY, USA, 1998. (http://doi.org/10.1145/290941.290965)
  14. Benoit Lemaire and Philippe Dessus. A System to Assess the Semantic Content of Student Essays Journal of Educational Computing Research 24, pages 305–320, SAGE Publications, 2001. (http://doi.org/10.2190/G649-0R9C-C021-P6X3)
  15. Michal Novák, Kateřina Rysová, Magdaléna Rysová, and Jiří Mírovský. Incorporating Coreference to Automatic Evaluation of Coherence in Essays In Statistical Language and Speech Processing, pages 58–69, Springer International Publishing, Cham, Switzerland, 2017. (http://doi.org/10.1007/978-3-319-68456-7_5)
  16. Michal Novák, Jiří Mírovský, Kateřina Rysová, and Magdaléna Rysová. Topic–Focus Articulation: A Third Pillar of Automatic Evaluation of Text Coherence In Advances in Computational Intelligence, pages 96–108, Springer International Publishing, Cham, Switzerland, 2018. (http://doi.org/10.1007/978-3-030-04497-8_8)
  17. Michal Novák, Jiří Mírovský, Kateřina Rysová, and Magdaléna Rysová. Exploiting Large Unlabeled Data in Automatic Evaluation of Coherence in Czech In Text, Speech, and Dialogue, pages 197–210, Springer International Publishing, Cham, Switzerland, 2019. (http://doi.org/10.1007/978-3-030-27947-9_17)
  18. Ellis B. Page. The Imminence of... Grading Essays by Computer Phi Delta Kappan 47, pages 238–243, Phi Delta Kappa International, 1966.
  19. Ellis B. Page and Nancy S. Petersen. The Computer Moves into Essay Grading: Updating the Ancient Test Phi Delta Kappan 76, pages 561–565, Phi Delta Kappa International, 1995.
  20. Kateřina Rysová, Magdaléna Rysová, Jiří Mírovský, and Michal Novák. Introducing EVALD – Software Applications for Automatic Evaluation of Discourse in Czech In Proceedings of the International Conference Recent Advances in Natural Language Processing, pages 634–641, INCOMA Ltd., Varna, Bulgaria, 2017. (http://doi.org/10.26615/978-954-452-049-6_082)
  21. Kateřina Rysová, Magdaléna Rysová, and Jiří Mírovský. Automatic evaluation of surface coherence in L2 texts in Czech In Proceedings of the 28th Conference on Computational Linguistics and Speech Processing ROCLING XXVIII (2016), pages 214–228, The Association for Computational Linguistics and Chinese Language Processing ({ACLCLP}), Taipei, Taiwan, 2016.
  22. Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, Jake Vanderplas, Alexandre Passos, David Cournapeau, Matthieu Brucher, Matthieu Perrot, and Édouard Duchesnay. Scikit-learn: Machine Learning in Python Journal of Machine Learning Research 12, pages 2825–2830, JMLR.org, 2011.
  23. Milena Hnátková, Michal Křen, Pavel Procházka, and Hana Skoumalová. The SYN-series Corpora of Written Czech In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14), pages 160–164, European Language Resources Association (ELRA), Reykjavik, Iceland, 2014.
  24. Martin Popel and Zdeněk Žabokrtský. TectoMT: Modular NLP Framework In Proceedings of the 7th International Conference on Advances in Natural Language Processing, pages 293–304, Springer-Verlag, Berlin, Heidelberg, 2010. (http://doi.org/10.1007/978-3-642-14770-8_33)
  25. Fridolin Wild, Christina Stahl, Gerald Stermsek, Yoseba Penya, and Gustaf Neumann. Factors Influencing Effectiveness in Automated Essay Scoring with LSA In Proceedings of the Conference on Artificial Intelligence in Education: Supporting Learning Through Intelligent and Socially Informed Technology, pages 947–949, IOS Press, Amsterdam, The Netherlands, 2005.
  26. Kaja Zupanc and Zoran Bosnić. Advances in the Field of Automated Essay Evaluation Informatica 4, pages 383–396, 2015.