DUC 05

ERSS 2005: Coreference-Based Summarization Reloaded

Abstract
We present ERSS\,2005, our entry to this year's DUC competition. With only slight modifications from last year's version to accommodate the more complex context information present in DUC\,2005, we achieved a similar performance to last year's entry, ranking roughly in the upper third when examining the ROUGE-1 and Basic Element score. We also participated in the additional manual evaluation based on the new Pyramid method and performed further evaluations based on the Basic Elements method and the automatic generation of Pyramids. Interestingly, the ranking of our system differs greatly between the different measures; we attempt to analyse this effect based on correlations between the different results using the Spearman coefficient.
Full Paper
DUC05.pdf
BibTex Entry