Chuweb21D: A Deduped English Document Collection for Web Search Tasks

Z Chu, T Sakai, Q Ai, Y Liu - … of the Annual International ACM SIGIR …, 2023 - dl.acm.org
As a traditional information retrieval task, ad hoc web search has long been an important
part of IR research and evaluation tracks (eg TREC, NTCIR and CLEF). A crawled, large …

On the Ordering of Pooled Web Pages, Gold Assessments, and Bronze Assessments

T Sakai, S Tao, N Chen, Y Li, M Maistro, Z Chu… - ACM Transactions on …, 2023 - dl.acm.org
The present study leverages a recent opportunity we had to create a new English web
search test collection for the NTCIR-16 We Want Web (WWW-4) task, which concluded in …

Relevance assessments for web search evaluation: Should we randomise or prioritise the pooled documents?(CORRECTED VERSION)

T Sakai, S Tao, Z Zeng - arxiv preprint arxiv:2211.00981, 2022 - arxiv.org
In the context of depth-$ k $ pooling for constructing web search test collections, we
compare two approaches to ordering pooled documents for relevance assessors: the …