repro_eval: A Python Interface to Reproducibility Measures of System-oriented IR Experiments

January 19, 2022 Β· Declared Dead Β· πŸ› European Conference on Information Retrieval

πŸ‘» CAUSE OF DEATH: Ghosted
No code link whatsoever

"No code URL or promise found in abstract"

Evidence collected by the PWNC Scanner

Authors Timo Breuer, Nicola Ferro, Maria Maistro, Philipp Schaer arXiv ID 2201.07599 Category cs.IR: Information Retrieval Citations 15 Venue European Conference on Information Retrieval Last Checked 4 months ago
Abstract
In this work we introduce repro_eval - a tool for reactive reproducibility studies of system-oriented information retrieval (IR) experiments. The corresponding Python package provides IR researchers with measures for different levels of reproduction when evaluating their systems' outputs. By offering an easily extensible interface, we hope to stimulate common practices when conducting a reproducibility study of system-oriented IR experiments.
Community shame:
Not yet rated
Community Contributions

Found the code? Know the venue? Think something is wrong? Let us know!

πŸ“œ Similar Papers

In the same crypt β€” Information Retrieval

Died the same way β€” πŸ‘» Ghosted