Jeffrey P. Bigham

research

∙ 08/17/2023

Never-ending Learning of User Interfaces

Machine learning models have been trained to predict semantic informatio...

0 Jason Wu, et al. ∙

research

∙ 06/08/2023

Latent Phrase Matching for Dysarthric Speech

Many consumer speech recognition systems are not tuned for people with s...

0 Colin Lea, et al. ∙

research

∙ 05/23/2023

USB: A Unified Summarization Benchmark Across Tasks and Domains

An abundance of datasets exist for training and evaluating models on the...

0 Kundan Krishna, et al. ∙

research

∙ 02/17/2023

From User Perceptions to Technical Improvement: Enabling People Who Stutter to Better Use Speech Recognition

Consumer speech recognition systems do not work as well for many people ...

0 Colin Lea, et al. ∙

research

∙ 01/30/2023

WebUI: A Dataset for Enhancing Visual UI Understanding with Web Semantics

Modeling user interfaces (UIs) from visual information allows systems to...

0 Jason Wu, et al. ∙

research

∙ 01/20/2023

Screen Correspondence: Mapping Interchangeable Elements between UIs

Understanding user interface (UI) functionality is a useful yet challeng...

0 Jason Wu, et al. ∙

research

∙ 09/28/2022

Downstream Datasets Make Surprisingly Good Pretraining Corpora

For most natural language processing tasks, the dominant practice is to ...

0 Kundan Krishna, et al. ∙

research

∙ 07/15/2022

Reflow: Automatically Improving Touch Interactions in Mobile Applications through Pixel-based Refinements

Touch is the primary way that users interact with smartphones. However, ...

0 Jason Wu, et al. ∙

research

∙ 05/25/2022

Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuning

Instruction tuning is an emergent paradigm in NLP wherein natural langua...

0 Prakhar Gupta, et al. ∙

research

∙ 05/19/2022

Target-Guided Dialogue Response Generation Using Commonsense and Data Augmentation

Target-guided response generation enables dialogue systems to smoothly t...

5 Prakhar Gupta, et al. ∙

research

∙ 02/15/2022

Nonverbal Sound Detection for Disordered Speech

Voice assistants have become an essential tool for people with various d...

0 Colin Lea, et al. ∙

research

∙ 12/17/2021

It's Time to Do Something: Mitigating the Negative Impacts of Computing Through a Change to the Peer Review Process

The computing research community needs to work much harder to address th...

0 Brent Hecht, et al. ∙

research

∙ 09/17/2021

Screen Parsing: Towards Reverse Engineering of UI Models from Screenshots

Automated understanding of user interfaces (UIs) from their pixels can i...

0 Jason Wu, et al. ∙

research

∙ 06/10/2021

Synthesizing Adversarial Negative Responses for Robust Response Ranking and Evaluation

Open-domain neural dialogue models have achieved high performance in res...

10 Prakhar Gupta, et al. ∙

research

∙ 05/04/2021

When Can Accessibility Help?: An Exploration of Accessibility Feature Recommendation on Mobile Devices

Numerous accessibility features have been developed and included in cons...

0 Jason Wu, et al. ∙

research

∙ 03/26/2021

Say It All: Feedback for Improving Non-Visual Presentation Accessibility

Presenters commonly use slides as visual aids for informative talks. Whe...

0 Yi-Hao Peng, et al. ∙

research

∙ 02/24/2021

SEP-28k: A Dataset for Stuttering Event Detection From Podcasts With People Who Stutter

The ability to automatically detect stuttering events in speech could he...

0 Colin Lea, et al. ∙

research

∙ 01/13/2021

Screen Recognition: Creating Accessibility Metadata for Mobile Applications from Pixels

Many accessibility features available on mobile platforms require applic...

0 Xiaoyi Zhang, et al. ∙

research

∙ 10/12/2020

Making Mobile Augmented Reality Applications Accessible

Augmented Reality (AR) technology creates new immersive experiences in e...

0 Jaylin Herskovitz, et al. ∙

research

∙ 10/07/2020

Rescribe: Authoring and Automatically Editing Audio Descriptions

Audio descriptions make videos accessible to those who cannot see them b...

0 Amy Pavel, et al. ∙

research

∙ 08/20/2020

Controlling Dialogue Generation with Semantic Exemplars

Dialogue systems pretrained with large language models generate locally ...

0 Prakhar Gupta, et al. ∙

research

∙ 07/14/2020

Extracting Structured Data from Physician-Patient Conversations By Predicting Noteworthy Utterances

Despite diverse efforts to mine various modalities of medical data, the ...

0 Kundan Krishna, et al. ∙

research

∙ 05/04/2020

Generating SOAP Notes from Doctor-Patient Conversations

Following each patient visit, physicians must draft detailed clinical su...

29 Kundan Krishna, et al. ∙

research

∙ 09/12/2019

InstructableCrowd: Creating IF-THEN Rules for Smartphones via Conversations with the Crowd

Natural language interfaces have become a common part of modern digital ...

0 Ting-Hao Kenneth Huang, et al. ∙

research

∙ 08/20/2019

StateLens: A Reverse Engineering Solution for Making Existing Dynamic Touchscreens Accessible

Blind people frequently encounter inaccessible dynamic touchscreens in t...

0 Anhong Guo, et al. ∙

research

∙ 07/24/2019

Investigating Evaluation of Open-Domain Dialogue Systems With Human Generated Multiple References

The aim of this paper is to mitigate the shortcomings of automatic evalu...

0 Prakhar Gupta, et al. ∙

research

∙ 06/07/2019

Predicting risk of dyslexia with an online gamified test

Dyslexia is a specific learning disorder related to school failure. Dete...

0 Luz Rello, et al. ∙

research

∙ 02/22/2018

VizWiz Grand Challenge: Answering Visual Questions from Blind People

The study of algorithms to automatically answer visual questions current...

0 Danna Gurari, et al. ∙

research

∙ 01/08/2018

Evorus: A Crowd-powered Conversational Assistant Built to Automate Itself Over Time

Crowd-powered conversational assistants have been shown to be more robus...

0 Ting-Hao Kenneth Huang, et al. ∙

research

∙ 08/10/2017

"Is there anything else I can help you with?": Challenges in Deploying an On-Demand Crowd-Powered Conversational Agent

Intelligent conversational assistants, such as Apple's Siri, Microsoft's...

0 Ting-Hao Kenneth Huang, et al. ∙

research

∙ 04/12/2017

Real-time On-Demand Crowd-powered Entity Extraction

Output-agreement mechanisms such as ESP Game have been widely used in hu...

0 Ting-Hao Kenneth Huang, et al. ∙

Jeffrey P. Bigham

Featured Co-authors