Predicting Knowledge Gain during Web Search based on Multimedia Resource Consumption

by   Christian Otto, et al.

In informal learning scenarios the popularity of multimedia content, such as video tutorials or lectures, has significantly increased. Yet, the users' interactions, navigation behavior, and consequently learning outcome, have not been researched extensively. Related work in this field, also called search as learning, has focused on behavioral or text resource features to predict learning outcome and knowledge gain. In this paper, we investigate whether we can exploit features representing multimedia resource consumption to predict of knowledge gain (KG) during Web search from in-session data, that is without prior knowledge about the learner. For this purpose, we suggest a set of multimedia features related to image and video consumption. Our feature extraction is evaluated in a lab study with 113 participants where we collected data for a given search as learning task on the formation of thunderstorms and lightning. We automatically analyze the monitored log data and utilize state-of-the-art computer vision methods to extract features about the seen multimedia resources. Experimental results demonstrate that multimedia features can improve KG prediction. Finally, we provide an analysis on feature importance (text and multimedia) for KG prediction.



There are no comments yet.


page 1

page 2

page 3

page 4


Predicting User Knowledge Gain in Informational Search Sessions

Web search is frequently used by people to acquire new knowledge and to ...

System Analysis And Design For Multimedia Retrieval Systems

Due to the extensive use of information technology and the recent develo...

SaL-Lightning Dataset: Search and Eye Gaze Behavior, Resource Interactions and Knowledge Gain during Web Search

The emerging research field Search as Learning investigates how the Web ...

Understanding user search processes across varying cognitive levels

Web is often used for finding information and with a learning intention....

Investigating Correlations of Automatically Extracted Multimodal Features and Lecture Video Quality

Ranking and recommendation of multimedia content such as videos is usual...

Nemoz - A Distributed Framework for Collaborative Media Organization

Multimedia applications have received quite some interest. Embedding the...

Performance Effectiveness of Multimedia Information Search Using the Epsilon-Greedy Algorithm

In the search and retrieval of multimedia objects, it is impractical to ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.