ChEMU consists of information extraction tasks over chemical reactions described in patents (https://chemu-patent-ie.github.io/). The goal of the task 1 (NER) was to identify chemical compounds and other entities involved in chemical reactions (like time, temperature, yield) in patents text and to assign a type to each entity according to its role in the context of the reaction.
The model developed by the DeST team (lasige_BioTM) outperformed the baseline model and was the third best result:
Exact evaluation
|
Precision |
Recall |
F1-Score |
Baseline |
0.9071 |
0.9071 |
0.8893 |
DeST |
0.9327 |
0.9457 |
0.9392 |
Relaxed evaluation
|
Precision |
Recall |
F1-Score |
Baseline |
0.9208 |
0.9504 |
0.9354 |
DeST |
0.9583 |
0.9960 |
0.9768 |