POLEVAL 2021

Welcome to PolEval 2021!

PolEval is a SemEval-inspired evaluation campaign for natural language processing tools for Polish. Submitted tools compete against one another within certain tasks selected by organizers, using available data and are evaluated according to pre-established procedures.

PolEval 2021 Tasks

In 2021 the following tasks have been carried out:

1. Punctuation restoration from read text
2. Evaluation of translation quality assessment metrics
3. Post-correction of OCR results
4. Question answering challenge

Discussions

Please join our Discord server to discuss PolEval competition in general and ask task-specific questions.

Previous editions

The tasks and results of previous editions are available through the links below:

• PolEval 2020
• PolEval 2019
• PolEval 2018
• PolEval 2017

PolEval introduction (in Polish)

Info

October 25, 2021

• PolEval 2021 results were presented at the AI & NLP conference. Please take a look at the proceedings and presentations.

September 15, 2021

• The gold-standard annotations for test data are available. Please check Task descriptions for links.

September 6, 2021

• The results of PolEval 2021 are available through our evaluation platform.

June 24, 2021

• PolEval 2021 Tasks were presented at Polish NLProc Meetup.

June 14, 2021

• Task 4: Question answering challenge has been published!

May 18, 2021

• Task descriptions and data for Tasks 1, 2 and 3 has been published!

February 5, 2021

• Call for Tasks for PolEval 2021 has started!