From Little Things Big Things Grow: A Collection with Seed Studies for Medical Systematic Review Literature Search

04/06/2022
by   Shuai Wang, et al.
0

Medical systematic review query formulation is a highly complex task done by trained information specialists. Complexity comes from the reliance on lengthy Boolean queries, which express a detailed research question. To aid query formulation, information specialists use a set of exemplar documents, called `seed studies', prior to query formulation. Seed studies help verify the effectiveness of a query prior to the full assessment of retrieved studies. Beyond this use of seeds, specific IR methods can exploit seed studies for guiding both automatic query formulation and new retrieval models. One major limitation of work to date is that these methods exploit `pseudo seed studies' through retrospective use of included studies (i.e., relevance assessments). However, we show pseudo seed studies are not representative of real seed studies used by information specialists. Hence, we provide a test collection with real world seed studies used to assist with the formulation of queries. To support our collection, we provide an analysis, previously not possible, on how seed studies impact retrieval and perform several experiments using seed-study based methods to compare the effectiveness of using seed studies versus pseudo seed studies. We make our test collection and the results of all of our experiments and analysis available at http://github.com/ielab/sysrev-seed-collection

READ FULL TEXT

page 3

page 4

research
12/08/2021

Seed-driven Document Ranking for Systematic Reviews: A Reproducibility Study

Screening or assessing studies is critical to the quality and outcomes o...
research
12/28/2021

Mirror Matching: Document Matching Approach in Seed-driven Document Ranking for Medical Systematic Reviews

When medical researchers conduct a systematic review (SR), screening stu...
research
08/01/2023

Generative Query Reformulation for Effective Adhoc Search

Performing automatic reformulations of a user's query is a popular parad...
research
09/19/2022

Automated MeSH Term Suggestion for Effective Query Formulation in Systematic Reviews Literature Search

High-quality medical systematic reviews require comprehensive literature...
research
12/01/2021

MeSH Term Suggestion for Systematic Review Literature Search

High-quality medical systematic reviews require comprehensive literature...
research
06/20/2020

Improving Query Safety at Pinterest

Query recommendations in search engines is a double edged sword, with un...
research
12/18/2022

MeSH Suggester: A Library and System for MeSH Term Suggestion for Systematic Review Boolean Query Construction

Boolean query construction is often critical for medical systematic revi...

Please sign up or login with your details

Forgot password? Click here to reset