CASCONet: A Conference dataset

06/28/2017 ∙ by Dixin Luo, et al. ∙ 0

Knowledge mobilization and translation describes the process of moving knowledge from research and development (R&D) labs into environments where it can be put to use. There is increasing interest in understanding mechanisms for knowledge mobilization, specifically with respect to academia and industry collaborations. These mechanisms include funding programs, research centers, and conferences, among others. In this paper, we focus on one specific knowledge mobilization mechanism, the CASCON conference, the annual conference of the IBM Centre for Advanced Studies (CAS). The mandate of CAS when it was established in 1990 was to foster collaborative work between the IBM Toronto Lab and university researchers from around the world. The first CAS Conference (CASCON) was held one year after CAS was formed in 1991. The focus of this annual conference was, and continues to be, bringing together academic researchers, industry practitioners, and technology users in a forum for sharing ideas and showcasing the results of the CAS collaborative work. We collected data about CASCON for the past 25 years including information about papers, technology showcase demos, workshops, and keynote presentations. The resulting dataset, called "CASCONet" is available for analysis and integration with related datasets. Using CASCONet, we analyzed interactions between R&D topics and changes in those topics over time. Results of our analysis show how the domain of knowledge being mobilized through CAS had evolved over time. By making CASCONet available to others, we hope that the data can be used in additional ways to understand knowledge mobilization and translation in this unique context.

READ FULL TEXT VIEW PDF
POST COMMENT

Comments

There are no comments yet.

Authors

page 4

page 5

This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.

I Introduction

There is increasing interest in understanding how knowledge transfer and mobilization takes place. At the same time, the number of available datasets and accessible analysis tools is growing. Many efforts have been made to make conference datasets available and new techniques have been developed for analyzing conference data for the purpose of understanding outcomes such as knowledge mobilization. Vasilescu et al. [1] present a dataset of software engineering conferences that contains historical data about the publications and the composition of program committees for eleven well-established conferences. This historical data is intended to assist conference steering committees or program committee chairs in assessing their selection process or to help prospective authors decide on conferences to which they should submit their work . Hayat and Lyons analyzed the social structure of the CASCON conference paper co-authorship network and proposed potential actions that might be taken to further develop the CASCON community [2]. They also analyzed the co-authorship ego networks of the ten most central authors in twenty-four years of papers published in the proceedings of CASCON using social network analysis and proposed a typology that differentiates three styles of co-authorship [3]. Solomon presented an in-depth analysis of past and present publishing practices in academic computer science conference and journal publications (from DBLP) to suggest the establishment of a more consistent publishing standard [4]. Many other datasets about conference and journal publications have also been proposed, e.g., the NIPS dataset [5], the Microsoft Academic Graph (MAG) [6], and the AMiner database222https://aminer.org/. Interesting analyses have been proposed and carried out on some of these data sets. For example, a relatively new topic model is proposed in [5]

and verified on the NIPS dataset — the dynamics of topics on NIPS over time are analyzed quantitatively, e.g., standard neural networks (“NNs backpropagation”) were extremely popular until the early 90s; however, after this, papers on this topic went through a steady decline, only to increase in popularity later on. Moreover, the popularity of deep architectures and convolutional neural networks (“deep learning”) steadily increased over these 29 years, to the point that deep learning was the most popular among all topics in NIPS in 2015. A heterogeneous entity graph of publications is proposed in MAG 

[6], which has potential to improve academic information retrieval and recommendation systems.

In this paper, we describe a specific conference dataset and demonstrate how analyses performed on that dataset can provide insights into mechanisms of knowledge transfer. We consider the CASCON conference, the annual conference of the IBM Centre for Advanced Studies (CAS). The mandate of CAS when it was established in was to foster collaborative work between IBM Toronto and university researchers from around the world [7]. It is a unique knowledge mobilization and translation environment, specifically designed to facilitate the transfer of technology from university research into IBM products and processes. The CASCONet dataset presented in this paper is unique in that it includes not only data about authors and papers but also data about all aspects of the CASCON conference.

Figure 1: The CASCONet schema

The first CAS Conference (CASCON) was held in , one year after CAS was formed. The focus of this conference was, and continues to be, bringing together researchers, government employees, industry practitioners, and technology users in a forum for sharing ideas and results of CAS collaborative work [7]. The CASCON conference is an interesting object of study in this way because it is an annual conference of the IBM Center for Advanced Studies (CAS), a unique center for knowledge mobilization and translation. Furthermore, rather than focusing on a narrow topic area in computer science research, CASCON’s mandate is broader, covering many topics in computer science and software engineering with a focus around industry / university collaborations. It is therefore interesting to understand what kinds of unique knowledge mobilization structures can be identified by analyzing data about CASCON.

The central data element of the CASCONet dataset is “person” and each person’s role in CASCON activities is described through the data. CASCONet includes the author role and provides title, author, and publication year for over 800 CASCON papers. The workshop chair role includes workshop title, workshop chair, and year. The keynote data associates people (presenters) with keynote titles and year. Finally, the demos data links demo presenter to title and year. The people, papers, themes of the workshops, topics of the keynote presentations, and the products and tools presented in the demos over the past 25 years reflect the evolving processes and knowledge mobilization in the CASCON community and may provide a glimpse into the field of computer science (advanced methods and techniques, challenges and urgent problems, innovation, and applications) overtime. As an example of the kinds of analyses that can be performed on this dataset, we present basic statistics of CASCON and analyze the temporal dynamics of topics presented at CASCON. We believe that this dataset and analyses such as these may provide researchers of computer science and social science with a new resource to study the co-evolution of academic and industry communities.

Ii Properties of CASCONet

The first CASCON took place in . More than researchers, technologists, developers, and decision makers attend CASCON each year. CASCONet contains data about a total of people who have written papers, presented demos, delivered keynote presentations, and organized workshops. Fig. 1 shows the schema of CASCONet.

(a) Numbers of papers
(b) Numbers of workshops
(c) Numbers of demos
Figure 2: The basic statistics of CASCON over time

[c] Topic Top 10 words Users and Business User, Internet, task, trust, model, resource, web, information, database, search Cloud and Web Services Cloud, web, service, application, design, development, integral, user, code, URL Systems System, model, distributed, computing, database, user, management, paper, application, information Programs and Code Program, performance, compiler, language, parallel, class, oriented, object, code, Java Applications Interaction, application, user, mobile, interface, device, information, visual, tool, support Networks and Security Security, network, cache, local, communication, enterprise, layer, server, grid, privacy Software Software, design, analysis, engine, tool, approach, test, development, process, performance Databases Database, usage, system, transaction, optimization, query, DB2, data, user, system Data Analysis Data, analytic, user, mining, decision, event, distribution, information, business, system Algorithms Algorithm, problem, performance, architecture, system, cluster, design, time, schedule, test

Table I: Top words of topics

Person. According to the dataset, of the people who authored papers at CASCON have published more than one paper in CASCON. The most number of papers published by one person is . There are people whose time span of authoring papers in CASCON is greater than years. There are only people who have participated in CASCON in all roles, as author, workshop chair, demo organizer, and keynote speaker.

Papers. Fig. 2(a) shows the number of CASCON papers published each year. The CASCON main conference has accepted a relatively stable number of papers for each year since . In the early years, a greater number of papers were accepted to CASCON. Then in and , in addition to the main conference, an IBM Dublin CAS symposium was held. An “emerging technology track” and a “short paper track” were added in . In CASCONet, the papers are identified by their types: “technical papers”; “short papers”; “emerging papers”; or, “symposium papers”.

Workshops and demos. Fig. 2(b) illustrates the number of workshops held at CASCON each year. Workshops provide attendees with opportunities to learn new technologies, learn about concepts, identify collaboration opportunities, share results, and engage in discussions around specific topics. The dynamics of the number of workshops is quite different from that of the number of papers published each year. The years between and saw a greater number of workshops than previous to then or since. Fig. 2(c) shows the numbers of demos over the years. Note that there are not any records available for demos exhibited between - and for and .

Iii Topics of CASCONet Papers Over Time

In this section, we establish a topic model for CASCON papers, with the aim to capture the evolution of topics over time, and quantify and analyze the influences between pairs of topics. This is one of many kinds of analyses that can be carried out on the CASCONet dataset.

Topic Model of Papers. The topic model of CASCON papers was extracted using Latent Dirichlet allocation (LDA) [8]. We collected the nouns, verbs, and adjectives in the titles of all the CASCON papers from to , and built a word corpus.

“topics” were extracted as bags of words using LDA, by calculating the conditional probabilities

and . We first set and learned the LDA model. Then, using as features of topics, we clustered topics into higher-level topics based on the correlations among the topic features. The words having the highest conditional probability in each topic are shown in Table I. We manually summarized the semantic meaning of topics and labeled them as “users and business”, “cloud and web services”, “systems”, “programs and code”, “applications”, “networks and security”, “software”, “databases”, “data analysis” and “algorithms”.

For each paper, we can take the the topic with the highest conditional probability as the theme of the paper. We can then calculate the distribution of topics over years by counting the number of papers corresponding to different topics in each year. Fig. 3 visualizes the distribution of topics over year. In the early years of CASCON (-), we see that “software”, “systems”, and “programs and code” are the predominant topics — papers about these three topics occupy most of the accepted submissions. Between 1991 and 1995, the average percentage of CASCON papers about “software”, “systems”, and “programs and code” are , , and , respectively. With the development of interest in cloud computing [9], more papers in this area appeared in CASCON starting in . Moreover, “software” is one of the main topics in nearly all of the CASCON conferences, while the numbers of papers in “users and business”, “networks and security” and “algorithms” are relatively small but stable over all years.

(a) Topic distribution over time
(b) Box plot of topic distribution
Figure 3: The visualization of topic distribution.

Granger Causality Analysis of Topics.

After identifying the topics hidden in the papers’ titles, we further analyzed the causal relationships among the topics. We developed a dynamic model of topics based on a vector auto-regressive (VAR) model 

[10] and analyzed the Granger causality [11, 12, 13] of topics based on this model. Specifically, we calculated the distributions of the topics over the years according to the results of LDA model, denoted as . Considering as an instance of time series, we describe its transition process by learning the following 1-order vector auto-regressive model:

(1)

Here is a transition matrix, whose element measures the influence -th topic imposes on the -th topic. If (), the -th topic is understood to trigger (suppress) the -th topic in the next time-stamp (in this case, year). if, and only if, the -th topic is locally independent on the

-th topic. The first term of the objective function minimizes the estimation error of the time series. Furthermore, considering the fact that generally a topic is only related to a subset of topics 

[14, 15], we impose a sparse constraint, , on the transition matrix . The VAR model can be learned effectively by using the alternating direction method of multipliers (ADMM) method.

According to the work in [12, 13], the transition matrix is actually the adjacent matrix of a Granger causality graph  [11], where the node set contains topics and the edge set indicates the Granger causality of topics. For , we say that the -th topic “Granger causes” the -th topic if and only if , which is equivalent to . Fig. 4 shows the inferred transition matrix, where the topics are sorted in descending order according to their self-triggering intensity , . We find several interesting phenomena.

  • Endogenous and exogenous topics. In Fig. 4, the element is labeled as black when , which indicates that the triggering from to is so weak that we can ignore the Granger causality from to . We find that “cloud and web services”, “systems”, “applications”, “programs and code” and “software” have positive while the other five topics have . This means that these five topics (“cloud and web services”, “systems”, “applications”, “programs and code” and “software”) are endogenous topics of CASCON, which, once introduced, tend to appear continuously over the years, while the other five topics are exogenous topics influenced by endogenous topics. In other words, for each exogenous topic, its appearance is mainly caused by other topics rather than itself, and its appearance in any given year does not contribute to its future appearance. From this perspective, it seems that CASCON is a conference focused on the fundamental engineering problems of computer science, e.g., systems and software engineering. The higher-level problems, such as user experience, network security, data analysis and so on, seem to be more complementary to the conference. This observation may relate to the focus of the IBM Toronto Lab and knowledge mobilization within the CAS community.

  • Positive and negative triggering patterns. We do not impose any nonnegative constraints on the optimization problem (1) so that some of the elements of are negative. We find that most of the ’s are positive (light green and yellow in Fig. 4) while some of them are negative (dark green ones in Fig. 4). Positive triggering patterns indicate that the corresponding two topics are highly-correlated with each other. For example, the “Security” topic is likely triggered by other topics because the security problem is related to many fields of computer science, e.g., system security, cloud security, client information security, and security algorithms, etc. On the other hand, negative suppressing patterns may indicate that the corresponding topics have a competitive relationship in CASCON. It is natural that when the time available for paper presentations at a conference is fixed, the total number of publications is limited as well. As a result, when the number of papers about one topic is dominant at the conference, the submission and acceptance of paper on other topices may be suppressed accordingly. For example, the “systems” topic is a technical topic while the “users and business” topic is a business-related topic. These two topics are competitive — papers on systems tend to be selected over papers on business topics and vice versa. The inverse phenomenon would happen when organizers want to increase business interactions.

Figure 4: The transition matrix of topics.

Iv Conclusion

CASCON is a longtime conference held by the IBM Canada Lab Centre for Advanced Studies (CAS), which provides us with an interesting dataset “CASCONet”. In this paper, we introduced the data we collected and presented some preliminary analyses. Our CASCONet dataset is available on https://github.com/iDBKMTI/CASCONet. In the future, we will collect more data about IBM CAS, and study the correlation between CASCON and the development of CAS itself, in order to better understand the mechanism of collaboration, knowledge translation and output.

Acknowledgment

This research was partially funded by an NSERC Strategic Partnership Grant.

References

  • [1] B. Vasilescu, A. Serebrenik, and T. Mens, “A historical dataset of software engineering conferences,” in Proceedings of the 10th Working Conference on Mining Software Repositories.   IEEE Press, 2013, pp. 373–376.
  • [2] Z. Hayat and K. Lyons, “The evolution of the cascon community: a social network analysis,” in Proceedings of the 2010 Conference of the Center for Advanced Studies on Collaborative Research.   IBM Corp., 2010, pp. 1–12.
  • [3] T. Hayat and K. Lyons, “A typology of collaborative research networks,” Online Information Review, vol. 41, no. 2, pp. 155–170, 2017.
  • [4] J. Solomon, “Programmers, professors, and parasites: Credit and co-authorship in computer science,” Science and Engineering Ethics, vol. 15, no. 4, pp. 467–489, 2009.
  • [5] V. Perrone, P. A. Jenkins, D. Spano, and Y. W. Teh, “Poisson random fields for dynamic feature models,” arXiv preprint arXiv:1611.07460, 2016.
  • [6] A. Sinha, Z. Shen, Y. Song, H. Ma, D. Eide, B.-j. P. Hsu, and K. Wang, “An overview of microsoft academic service (mas) and applications,” in Proceedings of the 24th International Conference on World Wide Web.   ACM, 2015, pp. 243–246.
  • [7] S. G. Perelgut, G. M. Silberman, K. A. Lyons, and K. Bennet, “Overview: the centre for advanced studies,” IBM Systems Journal, vol. 36, no. 4, pp. 474–488, 1997.
  • [8] D. M. Blei, A. Y. Ng, and M. I. Jordan, “Latent dirichlet allocation,”

    Journal of machine Learning research

    , vol. 3, pp. 993–1022, 2003.
  • [9] M. Armbrust, A. Fox, R. Griffith, A. D. Joseph, R. Katz, A. Konwinski, G. Lee, D. Patterson, A. Rabkin, I. Stoica et al., “A view of cloud computing,” Communications of the ACM, vol. 53, no. 4, pp. 50–58, 2010.
  • [10] H. Lütkepohl,

    Vector autoregressive models

    .   Springer, 2011.
  • [11] C. W. Granger, “Investigating causal relations by econometric models and cross-spectral methods,” Econometrica: Journal of the Econometric Society, pp. 424–438, 1969.
  • [12] S. Basu, A. Shojaie, and G. Michailidis, “Network granger causality with inherent grouping structure,” Journal of Machine Learning Research, vol. 16, pp. 417–453, 2015.
  • [13] H. Xu, M. Farajtabar, and H. Zha, “Learning granger causality for hawkes processes,” in ICML, 2016.
  • [14]

    D. Luo, H. Xu, Y. Zhen, B. Dilkina, H. Zha, X. Yang, and W. Zhang, “Learning mixtures of markov chains from aggregate data with structural constraints,”

    IEEE Transactions on Knowledge and Data Engineering, vol. 28, no. 6, pp. 1518–1531, 2016.
  • [15] D. Luo, H. Xu, Y. Zhen, X. Ning, H. Zha, X. Yang, and W. Zhang, “Multi-task multi-dimensional hawkes processes for modeling event sequences,” in IJCAI, 2015.