The 2nd Workshop on "Evaluation & Comparison of NLP Systems" Co-located at EMNLP 2021

We are pleased to announce the following best paper awards for both regular research papers and shared task submissions.

Research Papers

 Best Paper Award Winner

Testing Cross-Database Semantic Parsers With Canonical Utterances
Heather Lent, Semih Yavuz, Tao Yu, Tong Niu, Yingbo Zhou, Dragomir Radev and Xi Victoria Lin

 Honorable Mentions

Referenceless Parsing-Based Evaluation of AMR-to-English Generation
Emma Manning and Nathan Schneider

SeqScore: Addressing Barriers to Reproducible Named Entity Recognition Evaluation
Chester Palen-Michel, Nolan Holley and Constantine Lignos

All the winning papers above were selected by the organizers based on final assessments by our steering commitee members (Ani Nenkova, Sebastian Ruder, and Caiming Xiong) amongst papers put forward by the organizers and the reviewers.

Shared Task Submissions

 Best Overall Approach

Error Identification for Machine Translation with Metric Embedding and Attention
Raphael Rubino, Atsushi Fujita and Benjamin Marie

 Best Explainability Approach

IST-Unbabel 2021 Submission for the Explainable Quality Estimation Shared Task
Marcos Treviso, Nuno M. Guerreiro, Ricardo Rei and André F. T. Martins

The winning submissions above were chosen by the organizers mainly based on their performance on the shared task leaderboards, with the quality of the paper and the resourcefulness of the approach as additional criteria.