Report on the 7th International Workshop on Bibliometric-enhanced Information Retrieval (BIR 2018)

04/10/2018 ∙ by Philipp Mayr, et al. ∙ Association for Computing Machinery Salle du Cap 0

The Bibliometric-enhanced Information Retrieval (BIR) workshop series has started at ECIR in 2014 and serves as the annual gathering of IR researchers who address various information-related tasks on scientific corpora and bibliometrics. We welcome contributions elaborating on dedicated IR systems, as well as studies revealing original characteristics on how scientific knowledge is created, communicated, and used. This report presents all accepted papers at the 7th BIR workshop at ECIR 2018 in Grenoble, France.

READ FULL TEXT VIEW PDF
POST COMMENT

Comments

There are no comments yet.

Authors

page 3

This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.

1 Introduction

The Bibliometric-enhanced Information Retrieval (BIR) workshop series has started at ECIR in 2014 [1] and serves as the annual gathering of IR researchers who address various information-related tasks on scientific corpora and bibliometrics [2]. The workshop features original approaches to search, browse, and discover value-added knowledge from scientific documents and related information networks (e.g., terms, authors, institutions, references).

The current incarnation is a continuation of the evolution of our workshop series. The first BIR workshops set the research agenda by introducing the workshop topics, illustrating state-of-the-art methods, reporting on current research problems, and brainstorming about common interests. For the fourth workshop, co-located with the ACM/IEEE-CS JCDL 2016, we broadened the workshop scope and interlinked the BIR workshop with the natural language processing (NLP) and computational linguistics field 

[3]. This joint activity has been continued in 2017 at SIGIR in the second BIRNDL workshop [4].

This 7th full-day BIR workshop at ECIR 2018111http://bit.ly/bir2018 aimed to foster a common ground for the incorporation of bibliometric-enhanced services (including text mining functionality) into scholarly search engine interfaces. In particular we addressed specific communities, as well as studies on large, cross-domain collections. This workshop strived to feature contributions from core bibliometricians and core IR specialists who already operate at the interface between scientometrics and IR.

2 Overview of the papers

This year’s workshop hosted two keynotes as well as a set of regular papers and two demos222Workshop proceedings are available at: http://ceur-ws.org/Vol-2080/. The publications are briefly outlined in the following subsections.

2.1 Keynotes

This workshop featured two inspirational keynotes to kick-start thinking and discussion on the workshop topic. They were followed by paper presentations and demos (Fig. 1) in a format that we found to be successful at previous BIR workshops.

Cyril Labbé tackled a hot topic in his keynote titled “Trends in gaming indicators: On failed attempts at deception and their computerised detection” [5]. He outlined various efforts to manipulate indicators by tricking the scientific community (e.g., by submitting automatically generated papers). Other issues undermining the trust we place in peer-reviewed science were examined, such as data–results mismatch impeding the reproduction of results in cancer research. Labbé surveyed his recent work in these areas while reflecting on the potential of B+IR (bibliometrics and information retrieval) to address these critical issues.

Ralf Schenkel presented in his keynote “Integrating and exploiting metadata sources in a bibliographic information system” [6] an in-depth summary of recent metadata activities in the computer science bibliography DBLP, which is maintained by Schloss Dagstuhl and University of Trier. He outlined procedures for monitoring, selecting, and prioritizing computer science venues for inclusion in the DBLP bibliography. A special focus was given to author disambiguation and utilization of citation data.

Figure 1: A sense of the atmosphere at the BIR workshop.

2.2 Regular papers

Sarol, Liu, and Schneider proposed a citation and text-based publication retrieval framework [7]. After the user provides some seed articles, the system collects papers connected by citations and applies a combination of citation- and text-based filtering methods. The framework is evaluated in a systematic reviewing task.

Ollagnier, Fournier, and Bellot highlighted the central references of a paper based on the mining of its fulltext, quantifying the occurences of all in-text references [8]. They benchmarked this approach compared to a system in production at OpenEdition,333https://www.openedition.org and discuss the results in terms of enhanced relevance.

In their article on query expansion, Rattinger, Le Goff, and Guetl combined word embeddings and co-authorship relations [9]. The set of documents used for pseudo-relevance feedback was enriched by similar documents from co-authors, applying a locally trained Word2Vec model. Adding similar documents from co-authors significantly improved the baseline.

Bertin and Atanassova reported on the construction of the InTeReC dataset [10]. Utilising different section types from PLOS articles, InTeReC consists of within-text references and their surrounding sentences. Additionally, verb phrases were extracted, providing an idea of the nature of the reference.

Kacem and Mayr investigated the usage and influence of a specific search stratagem – the Journal Run – in an academic search engine log file [11]. They studied the frequency and stage of use of journal run as well as its impact on sessions. The authors found that the frequency of usage of the analyzed journals is not related to the impact factor within these sessions and that the size of the journal (Bradford Zones) has an insignificant correlation.

2.3 Demo papers

Cataldi, Di Caron, and Schifanella designed the -index to evaluate the degree of dependence of a researcher with respect to his/her co-authors over time. They implemented this indicator and demonstrate it online444http://d-index.di.unito.it with DBLP as a bibliographic datasource [12].

The demo paper by Bessagnet presented a framework combining thematic, temporal, and spatial features of Twitter tweets in the field of Human and Social Sciences [13]. The author promoted 5 W dimensions (who, when, what, where, why) for the analysis of tweets.

3 Outlook

While the past workshops laid the foundations for further work and also made the benefit of bringing information retrieval and bibliometrics together more explicit, there are still many challenges ahead. One of them is to provide infrastructures and testbeds for the evaluation of retrieval approaches that utilise bibliometrics and scientometrics. To this end, a focus of the proposed workshop and the discussion was on real experimentations (including demos) and industrial participation. This line was started in a related workshop at JCDL (BIRNDL 2016) and continued at SIGIR (BIRNDL 2017), but with a focus on digital libraries and computational linguistics. Given the complex information needs scholars are usually facing, we emphasized on information retrieval and information seeking and searching aspects.

In July 2018 we will run the third iteration of the BIRNDL workshop555http://wing.comp.nus.edu.sg/birndl-sigir2018/

at the 41st SIGIR conference in Ann Arbor, MI, USA. In conjunction with the BIRNDL workshop, the 4th CL-SciSumm Shared Task in Scientific Document Summarization

666http://wing.comp.nus.edu.sg/cl-scisumm2018/ will be hold.

4 Further Reading

In 2015 we published a first special issue on “Combining Bibliometrics and Information Retrieval” in the Scientometrics journal [2]. A special issue on “Bibliometrics, Information Retrieval and Natural Language Processing in Digital Libraries” will appear in 2018 in the International Journal on Digital Libraries [14]. Another special issue on “Bibliometric-enhanced Information Retrieval and Scientometrics” is in preparation for the Scientometrics journal.

Since 2016 we maintain the “Bibliometric-enhanced-IR Bibliography”777https://github.com/PhilippMayr/Bibliometric-enhanced-IR_Bibliography/ that collects scientific papers which appear in collaboration with the BIR/BIRNDL organizers. We invite interested researchers to join this project and contribute related publications.

5 Acknowledgement

We wish to thank all those who have contributed to the workshop proceedings: all the contributing authors and the many reviewers who generously offered their time and expertise888The list of PC members can be found at https://www.gesis.org/en/services/events/events-archive/conferences/ecir-workshops/ecir-workshop-2018/.

References

  • [1] Mayr, P., Scharnhorst, A., Larsen, B., Schaer, P., Mutschke, P.: Bibliometric-Enhanced Information Retrieval. In: 36th European Conference on IR Research, ECIR 2014, Amsterdam, The Netherlands (2014) 798–801
  • [2] Mayr, P., Scharnhorst, A.: Scientometrics and Information Retrieval: Weak-links revitalized. Scientometrics 102(3) (2015) 2193–2199
  • [3] Cabanac, G., Chandrasekaran, M.K., Frommholz, I., Jaidka, K., Kan, M.Y., Mayr, P., Wolfram, D.: Report on the Joint Workshop on Bibliometric-enhanced Information Retrieval and Natural Language Processing for Digital Libraries (BIRNDL 2016). SIGIR Forum 50(2) (2016) 36–43
  • [4] Mayr, P., Chandrasekaran, M.K., Jaidka, K.: Report on the 2nd Joint Workshop on Bibliometric-enhanced Information Retrieval and Natural Language Processing for Digital Libraries (BIRNDL 2017). SIGIR Forum 51(3) (2017) 107–113
  • [5] Labbé, C.: Trends in gaming indicators: On failed attempts at deception and their computerised detection. In: Proc. of the Seventh Workshop on Bibliometric-enhanced Information Retrieval (BIR), Grenoble, France, CEUR-WS.org (2018) 6–15
  • [6] Schenkel, R.: Integrating and exploiting public metadata sources in a bibliographic information system. In: Proc. of the Seventh Workshop on Bibliometric-enhanced Information Retrieval (BIR), Grenoble, France, CEUR-WS.org (2018) 16–21
  • [7] Sarol, M.J., Liu, L., Schneider, J.: Testing a citation and text-based framework for retrieving publications for literature reviews. In: Proc. of the Seventh Workshop on Bibliometric-enhanced Information Retrieval (BIR), Grenoble, France, CEUR-WS.org (2018) 22–33
  • [8] Ollagnier, A., Fournier, S., Bellot, P.: BIBLME RecSys: Harnessing bibliometric measures for a scholarly paper recommender system. In: Proc. of the Seventh Workshop on Bibliometric-enhanced Information Retrieval (BIR), Grenoble, France, CEUR-WS.org (2018) 34–45
  • [9] Rattinger, A., Goff, J.M.L., Guetl, C.: Local word embeddings for query expansion based on co-authorship and citations. In: Proc. of the Seventh Workshop on Bibliometric-enhanced Information Retrieval (BIR), Grenoble, France, CEUR-WS.org (2018) 46–53
  • [10] Bertin, M., Atanassova, I.: InTeReC: An in-text reference corpus for applying natural language processing to bibliometrics. In: Proc. of the Seventh Workshop on Bibliometric-enhanced Information Retrieval (BIR), Grenoble, France, CEUR-WS.org (2018) 54–62
  • [11] Kacem, A., Mayr, P.: Users are not influenced by high impact and core journals while searching. In: Proc. of the Seventh Workshop on Bibliometric-enhanced Information Retrieval (BIR), Grenoble, France, CEUR-WS.org (2018) 63–75
  • [12] Cataldi, M., Caro, L.D., Schifanella, C.: All for one or one for all? Analyzing collaboration patterns in research environments. In: Proc. of the Seventh Workshop on Bibliometric-enhanced Information Retrieval (BIR), Grenoble, France, CEUR-WS.org (2018) 76–79
  • [13] Bessagnet, M.N.: A generic framework to perform comprehensive analysis of tweets. In: Proc. of the Seventh Workshop on Bibliometric-enhanced Information Retrieval (BIR), Grenoble, France, CEUR-WS.org (2018) 80–85
  • [14] Mayr, P., Frommholz, I., Cabanac, G., Chandrasekaran, M.K., Jaidka, K., Kan, M.Y., Wolfram, D.: Introduction to the Special Issue on Bibliometric-Enhanced Information Retrieval and Natural Language Processing for Digital Libraries (BIRNDL). International Journal on Digital Libraries (2017)