


default search action
8th EVIA@NTCIR 2017: Tokyo, Japan
- Nicola Ferro, Ian Soboroff:
Proceedings of the 8th International Workshop on Evaluating Information Access co-located with the 13th NTCIR Conference on the Evaluation of Information Access Technologies (NTCIR 2017), Tokyo, Japan, December 5, 2017. CEUR Workshop Proceedings 2008, CEUR-WS.org 2017
Evaluation Measures and Test Collections
- Zhaohao Zeng, Cheng Luo, Lifeng Shang, Hang Li, Tetsuya Sakai:
Test Collections and Measures for Evaluating Customer-Helpdesk Dialogues. 1-9 - Marco Ferrante, Nicola Ferro, Silvia Pontarollo:
An Interval-Like Scale Property for I. R. Evaluation Measures. 10-15 - Tetsuya Sakai:
Evaluating Evaluation Measures with Worst-Case Confidence Interval Widths. 16-19
Assessment and Automatic Evaluation
- Kotaro Sakamoto, Hideyuki Shibuki, Madoka Ishioroshi, Akira Fujita, Yoshinobu Kano, Teruko Mitamura, Tatsunori Mori, Noriko Kando:
Automatic Evaluation of World History Essay Using Chronological and Geographical Measures. 20-23 - Tetsuya Sakai:
Towards Automatic Evaluation of Multi-Turn Dialogues: A Task Design that Leverages Inherently Subjective Annotations. 24-30 - Tetsuya Sakai:
The Effect of Inter-Assessor Disagreement on IR System Evaluation: A Case Study with Lancers and Students. 31-38 - Tetsuya Sakai:
Unanimity-Aware Gain for Highly Subjective Assessments. 39-42

manage site settings
To protect your privacy, all features that rely on external API calls from your browser are turned off by default. You need to opt-in for them to become active. All settings here will be stored as cookies with your web browser. For more information see our F.A.Q.