Design by Immersion: A Transdisciplinary Approach to Problem-Driven Visualizations

While previous work exists on how to conduct and disseminate insights from problem-driven visualization projects and design studies, the literature does not address how to accomplish these goals in transdisciplinary teams in ways that advance all disciplines involved. In this paper we introduce and define a new methodological paradigm we call design by immersion, which provides an alternative perspective on problem-driven visualization work. Design by immersion embeds transdisciplinary experiences at the center of the visualization process by having visualization researchers participate in the work of the target domain (or domain experts participate in visualization research). Based on our own combined experiences of working on cross-disciplinary, problem-driven visualization projects, we present six case studies that expose the opportunities that design by immersion enables, including (1) exploring new domain-inspired visualization design spaces, (2) enriching domain understanding through personal experiences, and (3) building strong transdisciplinary relationships. Furthermore, we illustrate how the process of design by immersion opens up a diverse set of design activities that can be combined in different ways depending on the type of collaboration, project, and goals. Finally, we discuss the challenges and potential pitfalls of design by immersion.

READ FULL TEXT VIEW PDF

Authors

page 3

page 4

08/01/2019

Data Changes Everything: Challenges and Opportunities in Data Visualization Design Handoff

Complex data visualization design projects often entail collaboration be...
09/14/2020

ColVis: Collaborative Visualization Design Workshops for Diverse User Groups

Understanding different types of users' needs can even be more critical ...
11/23/2020

Designing for Interpersonal Museum Experiences

What does the age of participation look like from the perspective of a m...
08/02/2018

A Framework for Creative-Visualization Opportunities Workshops

Applied visualization researchers often work closely with domain collabo...
09/13/2021

Visualization for Villainy

Visualization has long been seen as a dependable and trustworthy tool fo...
08/26/2020

Insights From Experiments With Rigor in an EvoBio Design Study

Design study is an established approach of conducting problem-driven vis...
08/05/2021

Professional Differences: A Comparative Study of Visualization Task Performance and Spatial Ability Across Disciplines

Problem-driven visualization work is rooted in deeply understanding the ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.

1 Related Work

Our work builds and expands on previous research in problem-driven visualization and design studies. Design by immersion is related to grounded evaluation [IsenbergEtAl2008] and pre-design empiricism [BrehmerEtAl2014], both of which advocate the use of exploratory qualitative studies to inform design. However, the activities and themes in our approach go beyond treating the other domain as the object of study.

1.1 Frameworks to Guide Problem-Driven Visualization

A number of frameworks and guidelines attempt to systematize the process of problem-driven visualization, conducting design studies, and working with domain experts. Munzner’s nested model [Munzner2009] deconstructs problem-driven visualization design into four components (domain problem and data characterization; operation and data type abstraction; visual encoding and interaction design; and algorithm design) while emphasizing evaluation. Design study methodology was described in the nine-stage framework by Sedlmair et al. [SedlmairEtAl2012], which provides the high-level stages of a design study. Their work and discussions highlight the multidisciplinary nature of visualization design studies. The Design Activity Framework [McKennaEtAl2014] contributes structure to the process by breaking visualization design down into a set of activities (understand, ideate, make, deploy) that consist of motivations, methods, and outcomes. Wong et al. [WongBELIV2018] present a characterization of domain experts, features of visualization systems for those experts, and corresponding design guidelines. However, visualization literature tends to separate visualization and domain experts into explicitly distinct groups [Munzner2009, SedlmairEtAl2012, McKennaEtAl2014, WongBELIV2018]. There is often an implicit or explicit assumption that the visualization researcher designs a visualization for a particular domain (or problem) [vandeMoerePurchase2011, Kindlemann2014, rind2016, house2005]. Such perspectives do not capture the possibility and potential benefits of design by immersion—a deeply collaborative visualization design process where domain-inspired solutions arise from transdisciplinary practices and contribute to all disciplines involved.

Nevertheless, design by immersion aligns with and extends existing themes in the literature. For example, Simon et al. [SimonEurovis2015] introduce the design study Liaison role in which an individual team member (either a domain or visualization expert) with additional knowledge in the “other” discipline facilitates visualization design by, in part, serving as a knowledge conduit between disciplines. There are similarities between Liaison-supported design studies and design by immersion, and an immersed researcher is well positioned to serve as a Liaison. Transitioning to design by immersion involves shifting from a role-based paradigm with an individual bridging the separate domain and visualization spheres to a collaborative process that brings together the two spheres. Design by immersion can be considered as a broader transdisciplinary approach and mindset that aims at collaboratively identifying and leveraging synergies between the domain and visualization spheres, allowing visualization design processes and roles to fluidly evolve, eventually blurring disciplinary boundaries.

1.2 Action Design Research

Considering design research from beyond the field of visualization, strategies exist that offer a wider view of the role of the target domain in visualization design. For example, Action Design Research (ADR) approaches design from the perspective that technological artifacts represent both design knowledge (visualization theory) and design context (target domain knowledge and influences from users) [SeinEtAl2011, McCurdyEtAl2016]. ADR emphasizes the interconnected nature of: 1) building tools, 2) intervening in the target domain via these tools, and 3) evaluating what has been built. In ADR, these tasks are tightly bound in successive build-intervene-evaluate cycles where “evaluation is not a separate stage of the research process that follows building” [SeinEtAl2011, p.43]. However, ADR promotes an artifact-centric perspective to design with a particular focus on evolution as well as target domain intervention and disruption. It does not explore transdisciplinary opportunities and their impact.

1.3 Participatory Design

Designers are increasingly focused on including users and stakeholders in the design process. For example, participatory design (e.g.,  [schuler1993participatory]) is explicitly multidisciplinary and collaborative. Participatory design has been used by a number of visualization researchers (e.g.,  [Henry2006, Chevalier2010, roberts2016sketching, Mendez2018, lloyd2011human]), and Sanders et al. have previously proposed a framework to organize participatory design tools and processes [sanders2010framework]. Based on Muller’s survey [Muller2007] of participatory design approaches, its characteristic interdisciplinarity (what Muller calls hybridity) stems from settings, activities and artifacts that encourage the creation of interdisciplinary spaces where designers and users meet to discuss and actively work through potentially differing perspectives. In the context of visualization, participatory design varies substantially from discussions with domain experts [Henry2006, Chevalier2010], through potential users sketching design solutions [roberts2016sketching, Mendez2018] and using real domain data as a mediator in data-driven wireframes and prototypes [lloyd2011human], to domain experts creating paper prototypes of their ideas [Henry2006]. While design by immersion aligns with ideas of stakeholder involvement as in participatory design, it also goes beyond them. In design by immersion, collaborations between stakeholders and designers shift from being structured through interdisciplinary spaces, artifacts and decisions to involving the personal acquisition of skills and field expertise in the visualization domain and/or the stakeholders’ domain. Design by immersion emphasizes the transdisciplinary transformation of individuals and the opportunities these transformations present for design. By engaging potential users and stakeholders in the design process, participatory design invites crossover between domains, and could serve as a starting point for transitioning to design by immersion.

1.4 Transdisciplinary Visualization Work

Design by immersion also relates to ideas from the digital humanities where visualization has started to play an increasingly important role as a new methodology [Jaenicke_2016]. Hinrichs et al. have discussed the role of visualization as a mediator between visualization and humanities researchers, and as a transdisciplinary speculative process advancing all disciplines involved [Hinrichs_2018a]. This work emphasizes the importance of considering visualization as a process that not only enables communication between different disciplines, but also allows a collaborative reflection on assumptions inherent in each discipline. Our work builds on this research by defining and situating design by immersion in the broader transdisciplinary context of problem-driven visualization.

Design by Immersion Activities Enrich Domain Understanding Explore
New Spaces Build
Relationships

 

D-1 Undertake domain-specific data analysis independently

 


 

D-2 Enrich datasets meaningfully by deriving new data

 


 

D-3 Analyze data collaboratively with domain experts

 


S-1
Observe domain experts practices unobtrusively in situ

S-2
Keep documentation of experiences

S-3
Interview collaborators 2

S-4
Attend meetings and discussions in the other domain


 

P-1 Develop visualizations in the context of evolving collaborative research projects with multiple disciplines

 


 

P-2 Develop visual encodings that explicitly incorporate and take inspiration from domain knowledge and practices

 


 

P-3 Start ideating early in the design process using pre-existing domain knowledge

 


 

P-4 Iterate rapidly and collaboratively on designs by leveraging informal domain expert feedback

 


 

P-5 Self-critique designs from the visualization and domain perspectives

 


L-1
Engage directly with both domain-specific and visualization literature

L-2
Gain broader exposure to domain concepts beyond domain problem

L-3
Establish domain-based design considerations for visualizations

L-4
Receive informal training from collaborators

L-5
Participate in simulations of domain work

 

C-1 Use language that resonates with collaborators

 


 

C-2 Relate across disciplines through common knowledge and experiences

 


 

C-3 Engage in informal peer-to-peer communication with domain experts about domain science and visualizations

 


 

C-4 Translate concepts and material for design team members coming from
predominantly visualization or target domain backgrounds

 



 

C-5 Brainstorm with collaborators about methods that would best elicit implicit knowledge

 


Table 1: Activities and their connections to the opportunities of design by immersion. Activities are classified as Data analysis, Study methods, Prototyping, Learning about the domain, and Communicating with collaborators. Numbers in the three columns are linked to the case studies.
Figure 1: The immersive skills space. Immersion can result in improving skills in both visualization and domain areas. Traversal of this space from novice to expert involves choosing where and how much time to commit to skill acquisition along the two dimensions.

2 Design by Immersion

This paper is motivated by our—the authors’—experience of transdisciplinarity in our own individual collaborative visualization design projects. We collectively found it difficult to connect these experiences to the design processes and strategies in the visualization literature. While working on different projects, engaging with different domains, all of us had similar experiences with immersion. Reflecting on and discussing our design approaches, we found that all of us had in some way engaged with activities typical of the “other” domain and, in this way, drifted towards becoming members of this “other” community. We all found this immersion to be challenging but also transformative and enriching to our projects and our own perspectives on research. While our approaches and experiences took on different forms, taken together they illustrate a unique transdiciplinary approach to problem-driven visualization we define as design by immersion.

Design by Immersion is a methodology for problem-driven visualization design where visualization researchers (or target domain experts) engage with and participate in the work of another domain such that visualization design, solutions, and knowledge emerge from these transdisciplinary experiences and interactions.

This definition is based on our own transdisciplinary visualization projects as discussed below in Section 3 to illustrate and explicate design by immersion. We intentionally chose this methodology of characterizing design by immersion based on a small yet diverse number of exemplary visualization case studies that we know well as this enabled us to discuss the nuances of this design approach. While indications of design by immersion may be present in previous design studies, extracting traces of this approach from such work would be difficult without insider knowledge of these studies. We expect that future instantiating of design by immersion will expand perspectives on and understanding of design by immersion.

From a visualization perspective, design by immersion means to immerse oneself in the target domain and to engage with the data and analysis processes in the ways that domain experts do, to inform visualization processes and design. From the perspective of a domain expert, it means to engage with visualization as a design and thinking process in order to help explore and define approaches or solutions to a problem. This method is a flexible approach to problem-driven visualization design that can take on many forms, depending on the disciplines and types of collaborators.

Our definition exhibits four themes, and we use them as lenses to connect our case studies to our design by immersion definition.

Communal. Researchers enter into each others’ domains, and existing communities with their own actors and cultures.

Personal. Researchers become intimately concerned with, affected by and personally involved in the other domain.

Active. Researchers actively engage in the other domain, participating in domain activities, not just observing activities.

Emergent. The processes and results of this approach have their origins in and emerge from transdisciplinary interactions between visualization and the target domain.

A key characteristic of design by immersion is that researchers transform and enrich their knowledge and skills through transdisciplinary experiences as demonstrated in Figure 1. Each discipline is represented as an axis. The expertise of collaborators in their own “home” discipline (visualization or target domain) can vary, as represented in these axes that span from “novice” to “expert”. There is variation among visualization researchers (and domain experts) in terms of expertise, such as graduate students vs. senior researchers. It is common for visualization experts to have minimal knowledge or expertise in the target domain, and vice versa. These boundary cases are represented by the red and blue rectangles (see Figure 1). Of course, there are people who are novices in both the target domain and visualization, corresponding to the lower bound on the knowledge space (the orange square in Figure 1). Design by immersion results in increasing one’s skills and knowledge in disciplines other than one’s own. Maximum time commitment can even result in becoming a dual citizen (the purple square in Figure 1), although this is a rare achievement and not a required result of design by immersion. Design by immersion typically leads to a drift of (some or all) involved researchers within this knowledge space (as discussed in [HinrichsEtAl2017]). We do not suggest that there is a correct trajectory to take, this depends on the project and the people involved. However, an awareness of this knowledge space and where one would locate oneself can help reflection on collaborative practices and design activities already taking place. We will identify how we have “drifted” through this knowledge space as we discuss our case studies.

The case study descriptions that follow culminate in a series of descriptive tables which can be used as a starting point for new projects. Table 1 lists activities that can benefit a research project. Table 2 provides guidance for understanding the stages of research for those activities. Table 3 describes possible themes and reflective questions to consider, and Section 6 describes potential problems to watch out for.

3 Immersion Case Studies

Our case studies cover a wide variety of domains, including computational linguistics, medicine, literary analysis, transport studies and chemistry. While the literature lacks a characterization of design by immersion, we draw on a number of existing studies that exemplify immersion [IsenbergEtAl2008, BrehmerEtAl2014, WoodEtAl2014, HinrichsEtAl2016, BradleyEtAl2016]. This is not intended as an exhaustive characterization of immersion but rather to illustrate how the ideas in this paper arose from independent places and projects, while capturing the richness and multifacted nature of design by immersion. We use each case study as a way to reveal transdisciplinary activities using Letter-# to refer to the activities in Table 1. These activities have been grouped as data analysis, study methods, prototyping, learning about the other domain, and communicating across domains, though some could be classified in multiple categories. Some activities appeared across multiple case studies as highlighted in Table 1, so we focus on detailing a subset associated with each case study.

3.1 Case Study #1: Apprenticeship

One approach to design by immersion is for a visualization researcher to participate in domain activities (an upward movement in Figure 1).

Context: Collins et al. [Collins2009] recount a visualization researcher using immersive observation to become an apprentice in the context of computational linguistics, and thus gain first-hand experience in statistical machine translation. In this case, the visualization researcher’s first-hand experiences in the target domain provided a contextualized understanding of it, which informed the visualization design process. The researcher’s experiences were a combination of being an immersed intern in the team and consciously exploring the current use of visualization like a type of qualitative pre-design study.

Activities and Design Discussion: In this case, the lead visualization researcher had some prior knowledge of computational linguistics. The domain expert collaborators worked specifically on statistical machine translation and trained the visualization researcher to carry out common domain analysis tasks (L-4). The visualization researcher subsequently engaged in independent analysis with standard tools, generated his own domain-specific findings (D-1, Personal, Active), and validated his findings with domain experts. By using pre-existing domain knowledge, the immersive researcher was able to start the visualization ideation process early, sharing visualization sketches with computational linguistics experts on a daily basis (P-3, Communal). Through shared work environments and meetings, this period involved rapid, collaborative design iterations tightly coupled to informal domain expert feedback (P-4), quickly converging on the design of Bubble Sets (Emergent[Collins2009]. During these experiences, the immersed researcher kept a journal, which the research team subsequently leveraged to understand the domain’s data and work practices (S-2).

Benefits and Impact: Insights into the domain problem went beyond those elicited through initial interviews with domain experts. Through experiencing the analysis process first-hand, the visualization researcher was better equipped to identify opportunities where interaction design and visualization could improve the workflow. This work highlights how, through immersion, visualization researchers can engage in independent domain-specific data analysis to gain their own understanding of the target domain and its processes (D-1).

3.2 Case Study #2: In-situ Simulation

Here we illustrate immersion from both directions, achieved through both visualization researchers and medical experts brainstorming together to derive novel immersive methods.

Context: Some domains, such as medicine, require particular sensitivity and one might think that design by immersion would not be an option. However, the medical domain is one in which domain-specific technology design may be particularly important.

Activities and Design Discussion: First, the medical collaborator spent considerable time with the visualization group to understand the importance of pre-design empirical work [BrehmerEtAl2014] (S-4, Communal). Next, members of the visualization team observed medical experts in-situ, as in job shadowing, a common learning practice in the medical field (S-1). Recognizing that this produced insufficient insight for effective design, the team brainstormed together alternative methods (C-5, Communal, Emergent) to address the challenge of enabling in-situ interviews with internists (doctors who consult on internal medical problems), without putting a strain on their already busy and high-pressure workdays. With the medical collaborator and considerable advice from an ethics board (Communal), the visualization researchers designed what was essentially an in-situ interview (S-3) where the doctors gave a medical consult in the context of their working environment, minimizing their time commitment and maximizing the potential of observing their diagnostic process in a close-to-real situation [BrehmerEtAl2014, ZukPhDThesis]. For the internists, who had agreed to be approached for a consult on pulmonary embolism (PE), the visualization researcher could approach them in the hospital halls, and in a manner similar to how one doctor asks another, ask for a consult on a (non-existent) PE patient (Personal, Active). The visualization researcher could then, through this simulated consultation, gain a deeper understanding of doctors’ diagnostic practices (L-5).

Benefits and Impact: Building on extensive transdisciplinary collaboration, the team designed software based on the doctors’ own processes (Emergent), using Bayesian reasoning to provide support and revealing data uncertainty when necessary. In a pre-clinical trial comparing the use of this software to a 20 minute refresher lecture, 19 out of 20 doctors did equivalently or better. Now, a professionally programmed version is in clinical trial.

3.3 Case Study #3: Immersion in Visualization

Researchers from other domains can immerse themselves in visualization resulting in a rightward movement in the space of Figure 1.

Context: This case study, reported by Bradley et al. [BradleyEtAl2016]

, shows the humanities embracing both visualization and the visualization community’s methodology. The authors identify a gap in existing visualization techniques for language, introducing a vector space model (L-DNA) to address it. They evaluate L-DNA with a diverse group of participants to highlight the technique’s potential and critique its design.

Activities and Design Discussion: The lead author, Bradley, originally sought out experts in visualization because he had produced mathematical work that his primary domain of English literature was incapable of evaluating. He found value in learning about the visualization process (L-1) because it allowed him to query his own research in new and interesting ways, and convinced him to pursue work as a dual citizen in both research domains.

In this instance, the author was not formally trained in mathematics, and needed a domain expert to help translate mathematical ideas into readable equations. This was a unique situation for both scholars as they learned the language and symbols of each other’s domains (C-4, Communal, Personal). The openness of the visualization experts to embrace ideas that had their conception in another discipline was a necessary part of this collaboration (C-1). One of the difficulties of immersion in a foreign domain is that lack of knowledge of prior work and terminology make it difficult to communicate with domain experts, even if the ideas are novel and relevant. Quite a lot of work was done in translation (Active), essentially defining common terminology to support conversation. By training, an English scholar’s view of language is fundamentally different than those in technical fields, so as conversations became deeper and more theoretical, there was an inverse relationship with the time it took to agree on terminology. While this process was sometimes described as frustrating, it was also exciting in that both parties felt that they were learning from each other while approaching a common goal. This type of immersion can be challenging because it is dependent on both parties being motivated by a process that can be confusing and time consuming.

Benefits and Impact: All researchers reported learning new ways of thinking about their own domains (Emergent) by considering how to describe their own tacit knowledge in ways that their colleagues could understand. The willingness of one researcher to immerse themselves fully in the domain of their colleagues led to developments that enabled solving problems in both domains (Emergent) and resulted in the publication of a new method for representing words and documents in a reversible vector space.

3.4 Case Study #4: Reciprocal Immersion

Design by immersion can also take on a reciprocal character where visualization and domain experts immerse themselves in each others’ research approaches and practices, resulting in a vertical upward movement of the visualization researcher in the expertise space and a rightward movement of the domain expert (see Figure 1).

Context: Hinrichs et al. [HinrichsEtAl2016] worked at the intersection of visualization and literary studies to analyze the characteristics of a largely unknown collection of science fiction anthologies. In this project, initial research questions were vague and open-ended due to the underexplored character of the literary collection in focus. The data collection, analysis, and accompanying visualizations evolved over the course of the collaboration (P-1) and were shaped by the design by immersion practices that the team established (Emergent).

Activities and Design Discussion: Throughout the project, team members from literary studies and visualization independently engaged with the collection and its evolving data using their own domain specific approaches. The literary scholars engaged in archival work and the classification of the science fiction anthologies from a literary perspective while the visualization expert, even before concrete data was available, developed sketches of ideas (on paper and in computational form) for a visualization system that could facilitate the analysis of the anthologies from different perspectives (P-1,P-3). As the project took place across two continents, the visualization researcher could not be involved in the archival work or classification process, or directly observe the practices of the literary scholars first-hand. Immersion in each others’ research practices happened instead through frequent online discussions (C-3) that helped form joint transdisciplinary perspectives on the project (Communal) that would ultimately facilitate contributions to literary studies [ForliniEtAl2018], visualization [HinrichsEtAl2016] and beyond [Hinrichs_2018a]. Here, the ever evolving visualization sketches were found to be a central point as they became mediators between the two disciplines in that they exposed certain ideas and assumptions from both a literary and visualization perspective. For example, literary scholars rejected certain visualization ideas that would shape the interpretation of the collected data in unwanted ways (P-2). The visualization sketches raised questions that informed new angles to the ongoing data collection and archival work (D-2). More specifically, documenting these discussions alongside all visualization sketches helped the researchers reflect on their collaborative process (S-2). While immersion initially took place in the form of team meetings, the researchers also started to immerse themselves in the “other” domain, by reading and discussing relevant literature (L-1) and by co-authoring articles and participating in each others’ conferences (Personal, Active). Throughout the project, the team members supported immersion in each other’s fields. More generally, domain experts can help visualization researchers immerse themselves and visualization researchers can reciprocate.

Benefits and Impact: The visualization and literary researchers evolved concurrently and influenced one another significantly. This transdisciplinary collaboration enabled by design by immersion has fundamentally shaped the research team and enriched but also changed each team member’s perspective on their own field. They have “drifted” away from their own domain toward those of their collaborative partners [HinrichsEtAl2017]. This case study shows that design by immersion as a process is well suited to work in the context of evolving collaborative visualization-driven research projects involving disciplines where research goals and questions are still in-flux (P-1).

3.5 Case Study #5: Dual Citizens

The deepest form of immersion occurs where a researcher is both a visualization expert and a domain expert — a dual citizen occupying the top-right space in Figure 1. In this case study, reported by Wood et al. [WoodEtAl2014], we consider problem solving by researchers with expertise in both visualization design and transport studies.

Context: The problem motivating this collaboration between academics and transport planners was the efficient provision and expansion of a major bicycle-share scheme in London, UK. Those directly involved included transport authority analytics experts, transport policy managers, and ‘dual citizen’ academics with both visualization and geography/transport backgrounds (P-1).

Activities and Design Discussion: A key activity in the initial discussion between transport authority members and academics was the establishment of trust (Personal)—a genuine belief among participants that the investment involved in collaboration will be beneficial in addressing the motivating problem. Having dual citizens involved helped by demonstrating a commitment to the domain (C-1, Personal, Active), providing a common (transport-related) framework for dialogue (Communal, C-2), and demonstrating recognizable expertise. This accelerated the transition to the analytics phase of the collaboration (Active) where data and visualization provided the mediation artifacts for discussion (P-4). In parallel with this collaborative activity between academics and transport authority members, dual citizenship supported participation in the academic transport studies community including methodological innovation in the use of transport visual analytics (Emergent). Importantly, members of the transport authority participated in joint publication and presentation in the academic transport studies sector (S-4, Personal, Communal, Active, Emergent) — something unlikely to have occurred without the dual citizenship of some of the participants.

Benefits and Impact: Immersion via dual citizenship can speed up the process of collaboration, especially at the trust establishment phase of a project. It also offered a wider range of opportunities for impact (operational, policy, academic visualization, and transport studies) than might otherwise have been the case. It provided a structure for the PhD of one of the participants and career development for another (Personal). It assisted in the use of visualization as mediation between the analytics and senior policy members of the transport authority. This deeper immersion also opened up other parallel channels of mutually supporting activity in the arts and museum sectors [WoodEtAl2014].

3.6 Case Study #6: Dual Immersion

Design by immersion was used as part of a collaboration to create novel visualizations in the chemistry domain  [Codorniu_2014, Codorniu_2015]. Here, we discuss how dual immersion was used to achieve an effective visualization design.

Context: The team comprised a visualization researcher, two chemical researchers, and a researcher immersed in both visualization and chemistry. At the start of the collaboration, the immersive researcher was developing both his visualization and chemistry expertise in order to become a dual citizen of both research communities. We focus on the impact his immersion in chemistry had on visualization design.

The immersive researcher initially saw an opportunity to address chemistry data analysis challenges through visualization, and the collaborative team evolved because he actively chose to enter into these complicated research spaces. The team was originally what Kirby and Meyer [KirbyMeyer-2013] call a multidisciplinary team; trying to solve a research challenge in one domain by leveraging multiple domains such that team members had clear roles. However, the distinction between visualization researcher and domain expert became fluid. By the end of the collaboration, all team members warranted recognition for having helped advance both visualization and chemistry. It is important to note that transdisciplinary activity need not apply to full teams to be useful. Here, one researcher on the team acted in a transdisciplinary context, and it helped shape the way the entire team worked together.

Activities and Design Discussion: Having an immersive researcher in both chemistry and visualization enabled knowledge development within the team. Leveraging his existing chemistry knowledge, the immersive researcher familiarized himself with project-relevant chemistry literature (L-1). Coordination and cross-disciplinary learning were achieved through informal peer-to-peer discussions (C-3) facilitated by shared domain knowledge (C-2) and through casual learning opportunities facilitated by sharing office space and informal observations (S-1, Communal). He also engaged in more formal one-on-one and collaborative discussions with the domain researchers about the chemical processes they were studying, chemical research challenges, and potential visualizations. In particular, one of the domain researchers invited him to collaboratively analyze some chemistry data (D-3, Communal, Personal, Active), which strengthened their collaborative relationship and enriched the immersive researcher’s understanding of the data analysis challenges. On the visualization side, the immersive researcher regularly discussed visualizations and the corresponding chemistry with the visualization researcher, acting as a translator between the visualization and chemistry experts (C-4). During the collaboration, the immersive researcher kept sketches, personal notes and prototypes which were valuable in reflecting on the design process (S-2). Furthermore, he started to self-critique his designs from both the chemistry and visualization perspectives as the project and his immersion progressed (P-5). The collaboration resulted in several visualizations, for example Radially-Angularly Mapped Trajectory (RAMT) plots  [Codorniu_2014, Codorniu_2015]. While RAMT plots resolve a specific domain analysis challenge, they incorporate additional domain concepts that were not directly connected to the domain challenge nor the chemistry researchers’ data characterizations. Instead, these domain concepts emerged as relevant during the design process. Immersion helped the researchers gain a broader exposure to domain concepts (L-2), which they leveraged to: develop domain-inspired visual encodings that explicitly incorporated domain knowledge (P-2, Emergent), and reveal domain-based design considerations for visualizations (L-3, Emergent).

Benefits and Impact: The project resulted in novel visualizations that advanced chemical understanding, and yielded publishable insights [Codorniu_2014, Codorniu_2015]. It revealed design considerations for future molecular visualization. The resulting chemistry visualizations also raised visualization questions, and inspired subsequent work exploring emphasis in information visualization [HallEtAl2016].

4 Relating Immersion to Design Opportunities

To support other researchers engaging in design by immersion, we reflected on our shared experiences using six case studies from our recent problem-driven visualization work. In all of the case studies, researchers immersed themselves to varying extents in multiple domains through different strategies. Collectively, our case studies point out the benefits of this process. We have identified three opportunities. (1) Design by immersion enriches domain understanding through personal domain experiences. (2) It facilitates the exploration of new domain-inspired research and design spaces, and (3) it promotes the building of mutual and productive transdisciplinary relationships that advance all disciplines involved. Table 1 connects these opportunities to the design activities detailed in the previous section.

4.1 Enrich Domain Understanding through Personal Domain Experiences

Gaining an understanding of a target domain plays a central role in models of problem-driven visualization design (e.g.,  [Munzner2009, SedlmairEtAl2012, McKennaEtAl2014]). Immersion enables researchers to leverage a variety of activities to enrich their understanding of a target domain. What makes design by immersion distinct is the personal component of how a researcher understands a target domain. Researchers can engage in collaborative data analysis with domain experts (D-3), or analyze domain data independently to gain first-hand experiences with existing tools (D-1). An immersed researcher can unobtrusively observe domain experts in situ (S-1), or directly engage in peer-to-peer communication with them about both the domain science and visualizations (C-3). For additional perspectives on the domain, an immersed researcher can consult domain literature (L-1). Similarly, previous work has suggested that visualization researchers read domain literature (e.g., [Wijk2006, SedlmairEtAl2012]), and immersion will help them gain more from this activity. Through immersion, researchers also gain deeper exposure to the concepts and problems of other domains beyond visualization challenges (L-2). In each of these activities, the researcher either engages directly with domain material, or explores the domain through personal exchanges with domain experts that emphasize peer-to-peer relationships. By participating in the target domain, the researcher confronts domain challenges and creates actionable mental models of the domain. As a researcher starts to design visualizations following (or as part of) immersion, the goal is to develop a richer personal understanding of the target domain.

Researchers can also use immersion-supported activities to evaluate domain descriptions (e.g., S-1, D-3, C-3), particularly when they leverage their domain experiences and connections to access new external domain experts for validation purposes. In the context of Munzner’s nested model [Munzner2009], immersion can facilitate both exploratory and summative evaluations—pre-design studies aimed at gaining a understanding of a domain situation and post-design evaluations aimed at assessing research output quality in the context of the domain situation. McKenna et al. [McKennaEtAl2014] also distinguish methods that generate an understanding of a domain task and those that evaluate an existing characterization of a task. Immersion empowers researchers to enrich their domain understanding through personal domain experiences, and provides mechanisms for evaluating domain descriptions. Immersion can also potentially support approaches aimed at achieving “immersive” tool evaluations (e.g., see  [ShneidermanBELIV2006]).

4.2 Explore New Domain Inspired Spaces

Design by immersion provides an alternative perspective on how researchers can explore visualization solution spaces. For example, through immersion, researchers can realize visual encodings that explicitly leverage domain knowledge and practices beyond those captured by domain problem characterization and subsequent abstraction (P-2), in part due to their broader exposure to domain concepts (L-2). While previous work has suggested that deriving new data types is part of visualization design[McKennaEtAl2014], an immersed researcher, with both domain experience and visualization knowledge, is particularly well positioned to manipulate and extend datasets in meaningful ways (D-2). Wood et al. detail an example of this in their work [WoodEtAl2014]. In turn, immersion can help meet the design guidelines of Wong et al. [WongBELIV2018] that outline how researchers designing visualizations for domain experts should use domain terminology in their designs.

Immersion also opens up alternative design paths. Immersed researchers can concurrently characterize new domain problems and ideate by leveraging their existing experiences and knowledge of the domain (P-3). In contrast, previous work (e.g.,  [Munzner2009, SedlmairEtAl2012, McKennaEtAl2014]) takes the perspective that visualization projects involve an initially ordered progression from domain characterization to ideation. Design by immersion involves visualization researchers iterating frequently and collaboratively on designs with domain experts (P-4) so that visualizations are intertwined combinations of input from domain expert collaborators, visualization and domain influences, and prototype development, aligning well with the build-intervene-evaluate cycles of ADR [SeinEtAl2011]. The tight coupling of visualization and domain during design by immersion also empowers researchers to design visualizations in the context of evolving collaborative projects (P-1), and potentially when domain needs are open-ended [HinrichsEtAl2016]. In contrast, previous work [Munzner2009, SedlmairEtAl2012, McKennaEtAl2014] generally emphasizes visualization design scenarios where domain experts have relatively stable tasks and workflows.

Immersion also changes how visualization researchers consider and explore solution spaces as they generate visualization designs. Immersion enables the researcher to critique their designs from both the domain and visualization perspectives (P-5). This dual self-critiquing is complementary to external critiques from domain experts. Self-critiquing from the domain perspective is similar to Neustaedter and Sengers’ autobiographical design process [Neustaedter2012]. Autobiographical design is a type of design research in HCI that relies on “extensive, genuine usage by those creating or building the system” [Neustaedter2012, p.514]. They advocate that researchers leveraging autobiographical design should keep formal records to facilitate reflection on their design processes. We recommend that immersed researchers should similarly keep their own records if they want to reflect on their design processes following an immersive project, particularly given that design by immersion generally involves blurred roles. Documenting the process both helps reflecting on the domain and navigating the design process  [HinrichsEtAl2016] (S-2).

Design by immersion can potentially reveal new problem spaces through mutual shaping. Mutual shaping is a principle of ADR [SeinEtAl2011, McCurdyEtAl2016], and refers to how members of the design team come from differing backgrounds, but learn from each other and shape one another’s ideas. In particular, “Through close collaboration the team members learn about each other’s expertise, sometimes offering valuable insight into another member’s primary research domain” [McCurdyEtAl2016, p.514]. We experienced this during two of the case studies (RAMT plots and the L-DNA project [BradleyEtAl2016]). Outsiders are well positioned to question assumptions and reveal new challenges that the other domain has not considered.

By having both visualization and domain knowledge, an immersive designer brings broader knowledge, perspectives, and skills when addressing a domain’s visualization challenges and critiquing visualizations. The close connections established between the researcher and their domain expert collaborators pushes the design process away from a cyclic interaction. Knowing the target domain and exploring the visualization space become intertwined.

4.3 Build Interdisciplinary Relationships

Through immersion, visualization researchers share more in common with their domain expert counterparts, facilitating greater rapport among collaborators. By embracing design by immersion, a visualization researcher can utilize language that resonates with their domain collaborators (C-1); the value of which has been noted by others[ShneidermanBELIV2006, SimonEurovis2015]. Moreover, akin to Liaisons [SimonEurovis2015], immersed researchers can relate to domain experts through common knowledge or experiences (C-2), engage in informal peer-to-peer communication (C-3), collaboratively analyze data with domain experts (D-3), and translate ideas for non-immersed members of a design team (C-4). These activities, in addition to helping establish domain understanding, help immersive designers to create cohesive teams. Greater rapport and cohesion can establish the trust and openness necessary for effective collaborations. Furthermore, strong relationships with domain experts offer new opportunities, such as access to an extended network of domain experts, and provide a firm basis for engaging in more ambitious future work. While Sedlmair et al. [SedlmairEtAl2012] identify poor rapport with collaborators as a potential pitfall for design studies, the visualization literature generally does not emphasize that building bridges between visualization and other domains requires visualization researchers to build effective personal relationships with researchers in other domains. Design by immersion can help visualization researchers build these personal relationships.

5 How to Immerse Yourself

Immersing oneself and engaging in design by immersion are two interconnected research processes. The activities in Table 1 are intended as practical approaches to facilitate the construction of customized immersion trajectories. There are many activities in Table 1 and not every design by immersion project will use all possible activities. In fact, one of the challenges of design by immersion is that there are many possible immersion trajectories, and one needs to navigate these possibilities while remaining sensitive to one’s immersion domain. What is appropriate in the context of one domain may not be suitable for another domain. There is also the challenge of deciding when to stop; immersion trajectories do not necessarily need to culminate in dual citizenship. In light of this complexity, we aim to empower people to develop their own trajectories. To this end, we first illustrate the diversity of possible trajectories leveraging our case studies, and then provide a framework for constructing immersion trajectories.

5.1 Example Trajectories

Immersion trajectories may vary considerably depending on the project, team members, and domains. To illustrate the diversity of possible trajectories, we review the trajectories for Case Studies #4 and #6.

In Case Study #4, the two immersed researchers originated from literary studies and visualization. They facilitated each other’s immersion, which was shaped by the idea of developing visualizations in an evolving transdisciplinary project (P-1). The immersion trajectories involved data-driven activities (domain-specific analysis D-1, deriving new data D-2, and collaborative data analysis using methods from literary studies and visualization D-3). Visualization and prototyping followed a speculative approach, that paralleled these data-driven activities (P-3), in particular: developing visual encodings that explicitly took inspiration from domain knowledge and practices (P-2), and iterating rapidly and collaboratively on designs by leveraging informal domain expert feedback (P-4). Key to the immersion for both researchers were frequent discussions of emerging insights from archival work and visualization (C-3). Current visualization prototypes (on paper and digital) as manifestations of insights, assumptions and questions became the centre of these discussions that also included design critiques from visualization and literary studies perspectives (P-5). While immersion happened as part of these discussions, documenting them enabled later reflections on how immersion had affected the course of the project and project outcomes as well as the researchers themselves (S-2).

In Case Study #6

, the immersed chemistry researcher’s trajectory involved data-driven activities, learning about the visualization domain, communicating with collaborators, and study methods, some of which are domain expert analogs of activities in Table 

1. For example, the researcher took a course in visualization, read introductory visualization literature (L-1), and then undertook independent design sketching and digital prototyping (D-1). He started participating in a visualization research group, which involved attending the group’s meetings and engaging in informal peer-to-peer discussions about visualization (C-3). Through this engagement, he was able to observe visualization design practices unobtrusively in-situ (S-1), in addition to critiquing and designing visualizations collaboratively with visualization researchers (D-3). Longer term, he attended visualization conferences, and collaborated with visualization researchers on visualization projects beyond chemistry-specific applications.

The differences in these trajectories highlight how specific low-level characteristics of immersion can differ between projects. Therefore, we have generated a framework with several sets of questions to help guide researchers as they construct their own immersion trajectories.

5.2 Constructing an Immersion Trajectory

Researchers need to carefully consider and construct their own immersion trajectories while respecting the specifics of their own interests and personalities, immersion domain and research goals, as well as collaborators. Design by immersion is not a cure all. However, in our experience, it tends to lead to rich insights and changes in both personal and collaborative perspectives, advancing all disciplines involved. We provide a framework for constructing immersion trajectories in order to enable other researchers (within and outside of the visualization domain) to leverage design by immersion.

5.2.1 Considering Your Own Interests & Contextual Factors

Researchers choosing to start design by immersion projects should carefully consider why and how they will build transdisciplinary relationships, and, thus, surround themselves with a support group.

What are your own interests? — It can be important to reflect on your own interests and what draws you toward this type of approach. Maybe your profile is already interdisciplinary and you wish to experience work in another domain in more detail. Maybe you wish to incorporate another domain’s perspective as you feel it may deliver key aspects to your project and/or research interests. In any case, it can be valuable to consider personal goals. What would you like to get out of the transdisciplinary collaboration? What do you think you might contribute to the collaboration and/or immersion?

Stages Immersion Trajectory Activities
Stage #1: Establishing basic
domain
knowledge
Take introductory course(s) in a domain if you have no prior education or experience with that domain
Find a domain expert who is willing to support the immersion process
Read introductory background domain
literature
Start attending group meetings of domain
researchers
Stage #2:
Gaining
domain
research exposure
Read domain research literature
Start working co-located with domain experts
Undertake independent domain-specific data analysis
Work collaboratively with domain experts to tackle domain questions and data analysis
challenges
Stage #3:
Establishing
broader
domain reputation
Collaboratively engage with domain experts to prepare a domain-specific paper related to your work with them
Attend domain-specific events
(e.g., a conference)
Table 2: An example immersion trajectory.

Who will be your critical domain supporter(s)? — The immersion process will be easier if you have at least one close domain supporter who is willing to invest themselves in the immersion process and make long-term commitments to your work. This strong supporter will likely be the domain partner for your immersive project, so that there is an incentive for them to make long-term commitments. One key feature of this supporter should be an openness in facilitating your immersion, potentially by allowing you access to their work processes and even their work environment. Much of the guidance from Sedlmair et al. [SedlmairEtAl2012] about selecting potential collaborators applies to finding an appropriate domain supporter. Ideally, as your immersion progresses, you should cultivate your connections to the domain community, and develop a succession plan, in order both to raise up supporters for future projects, and to develop contingency connections in the event that your current supporter can no longer be a part of the project as a result of, for example, relocation or institutional realignment.

Who will be your supporting cast? — Also consider the broader types of support. Are you cultivating casual relationships with other domain experts? These relationships do not need to be as strong or time intensive as the relationship with your critical domain supporter, but having a broader network will make it easier to get additional perspectives on the domain, related concepts, and challenges.

Concrete Experience Themes[MorrisILE2019] Immersive Experience Questions
Hands on participation: Involved, active, participants in real-world uncontrived scenarios How will you be active and participating in the domain?
If the real-world activity was modified to make it accessible to you (the visualization researcher), how specifically has the activity changed? How might those changes affect your understandings of the domain?
Situated in context: Rich contextual information What are the contextual factors influencing the activity and your participation (for example, social factors)?
Which contextual factors does your design respect, and which are you disrupting?
Critical reflection: Contextual conditions of problem considered How will you reflect on your activities and experiences to develop your own mental models and domain understanding?
Purposeful — pragmatic: Solving real-world problems How could the activity (as completed by you or a domain expert) help advance the domain?
Risk — novel problems: Out of comfort zone: temporary destabilization What are the specific risks associated with you activity?
What is your own risk tolerance?
Table 3: Questions for immersive experiences as inspired by experiential learning literature. Concrete experience themes are quoted directly from Morris’ recent review on concrete experience and experiential learning [MorrisILE2019, p.4].

5.2.2 Selecting Activities

We suggest breaking down immersion trajectories into three stages that may be sequentially arranged or re-visited iteratively, depending on the project. These stages are:

Stage #1

Establishing basic domain knowledge

Stage #2

Gaining domain research exposure

Stage #3

Establishing a broader domain reputation

These stages are outlined in the brief immersion trajectory exemplar in Table 2. The three stages are transferable across immersion trajectories, although the extent of Stage #3 is quite variable. Stage #3 represents a significant time investment, so some visualization researchers may choose to stop at Stage #2. However, establishing a broader domain reputation has potential benefits. For example, it might be helpful for recruiting domain experts as participants for studies.

Researchers can populate the three stages using activities from Table 1, as illustrated in Table 2. We have ordered the activities in Table 2 according to one possible immersion trajectory. They are not numbered because we envision that some of them can occur concurrently, and the activities may be reordered depending on a particular researcher’s preferences or target domain. Some steps could occur as part of multiple stages. For example, starting to attend group meetings could be part of Stage #1 or Stage #2. Table 2 is meant as a starting template, and can be adapted according to the activities chosen from Table 1.

When selecting activities from Table 1, we recommend researchers consider the themes and questions provided in Table 3. In the introduction to this paper, we highlighted that design by immersion relates to experiential learning, and we build on this idea here to inform the planning of immersion trajectories. More specifically, Morris reviewed the education literature to understand the nature of concrete experience, which is foundational to experiential learning, and extracted five related themes [MorrisILE2019] as provided in Table 3. We have used these themes as a starting point for constructing the questions in Table 3 to help guide researchers as they engage in immersion and select corresponding activities. Our questions in Table 3 are provisional, and we expect that they will be revised and expanded by future work. In general, educational literature on experiential learning could help inform and enhance the community’s understanding of what constitutes good domain experiences for achieving design by immersion.

6 Design by Immersion Challenges

While design by immersion provides opportunities, it also has its challenges, which we have gathered from our case studies and experiences.

Time Commitment — Immersion can place substantial demands on a researcher’s time. This is not a unique characteristic of this approach. As Munzner [Munzner2009, p.927] states, “The domain problem characterization stage is both difficult and time consuming to do properly.” What is particularly demanding is the double counting of certain activities, such as engaging and keeping up-to-date with two distinct bodies of literature. However, we highlight again, that design by immersion allows for different levels of trajectories in the immersive skill space (see Figure 1), and becoming a “dual citizen” is not necessarily the goal. This being said, design by immersion does align with recent trends in the visualization community for researchers to specialize in particular application areas, such as BioVis, SecurityVis, or Digital Humanities.

Keeping Track of the Process & the Process On-Track — Design by immersion is suited to visualization design in the context of evolving, open-ended domain projects. This is an exciting opportunity, but also a potential challenge as keeping a focus can be difficult as new perspectives and new questions emerge. As a project evolves, many ideas will crop up, some to be immediately explored while others may be interesting but “better left for another day.”

Navigating Research Identities — Researchers may also find it challenging to navigate multiple research identities, specifically their visualization identities and their domain identities. Sticking too tightly with one’s “home” domain identity can make immersion and insights less enriching. However, maintaining separate identities is important. Failing to do so could mean that a researcher loses the ability to interact appropriately with one of their communities, and that the community no longer treats the researcher as an equal citizen. An awareness of the tension of multiple identities can help one find a suitable path depending on one’s own interests and goals.

Translating Ideas from one Domain to the Other — Translation of ideas from one domain to the other remains challenging. It is a skill that derives from experience and from embracing the epistemological concerns of the domains in which the researcher is immersed. Moreover, we note that it requires a certain degree of humility, of being willing to acknowledge the limits of one’s own understanding.

Systemic Barriers — Researchers leveraging design by immersion may encounter systemic barriers related to its transdisciplinary nature. For example, most PhD programs are structured around a single home department. Similarly, funding initiatives often target particular domain groups (e.g., the sciences, social sciences, the humanities, etc.), presenting challenges for transdisciplinary collaborations across non-classical cognate disciplines (e.g., computer science and literary studies). However, it is worth noting that many companies are resource lean, so transdisciplinary work experience and dual citizenship may be desirable. Systemic barriers, like immersion, are sensitive to one’s context.

7 Conclusion

The visualization community is grappling with increasing multidisciplinarity and the breakdown of the traditional dichotomy between visualization researchers and domain experts. In this paper, we introduced and discussed design by immersion, a progression of themes already present in the visualization literature. Design by immersion is an alternative design approach for problem-driven visualization research, and expands the suite of tools available to the community. We highlighted how immersion supports design activities and provides researchers with opportunities to: (1) enrich domain understanding through personal domain experiences, (2) explore new domain-inspired spaces, and (3) build interdisciplinary relationships. To empower other researchers to take advantage of immersion, we pointed to alternative strategies for achieving immersive goals, related the process to existing design approaches in the literature, and revealed some challenges. We also provided a high-level road map of how visualization researchers can immerse themselves in target domains. The visualization community has been calling for increased application research for some time, and a critical part of achieving this is breaking down the walls between visualization and other domains. Design by immersion helps address these challenges by empowering researchers to explore new transdisciplinary horizons for problem-driven, applied visualization.

Acknowledgements.
This research was supported in part by the Natural Sciences and Engineering Research Council of Canada (NSERC), Alberta Innovates Technology Futures (AITF), and SMART Technologies ULC. K. Wm. Hall thanks NSERC for its support through the Vanier Canada Graduate Scholarships Program.

References