Recognition of excellent work is very important. In particular, we see the role of best/outstanding paper awards as being two-fold: On the one hand, it is a chance for the conference program committee to highlight papers it found particularly compelling and promote them to a broader audience. On the other hand, it provides recognition to the authors and may help advance their careers.
From the perspective of both of these functions we think it is critical that different kinds of excellent work be recognized. Accordingly, we have established an expanded set of categories in which an award will be given for COLING 2018. The categories are:
- Best linguistic analysis
- Best NLP engineering experiment
- Best reproduction paper
- Best resource paper
- Best position paper
- Best survey paper
- Best evaluation, for a paper that does their eval very well
- Most reproducible, where the paper’s work is highly reproducible
- Best challenge, for a paper that sets a new challenge
- Best error analysis, where the linguistic analysis of failures is exemplary
The first six of these correspond to our paper types. The last cross-cut those categories, at least to a certain extent. We hope that ‘Best evaluation’ and ‘Most reproducible’ in particular will provide motivation for raising the bar in best practice in these areas.
A winner will be selected for each category by a best paper committee. However, while there are more opportunities for recognition, we’ve also raised the minimum requirements for winning a prize. Namely, any work with associated code or other resources must make that openly available, and do so before the best paper committee finished selecting works.
We’ve taken this step to provide a solid reward for those who share their work and help advance our field (see e.g. “Sharing is Caring”, Nissim et al. 2017, Computational Linguistics), without excluding others (e.g. industrial authors) who cannot easily share work from participating in COLING 2018’s many tracks.
We look forward with great anticipation to this collection of papers!