b'James M. Rehg'

research

∙ 06/10/2023

Explaining a machine learning decision to physicians via counterfactuals

Machine learning models perform well on several healthcare tasks and can...

0 Supriya Nagesh, et al. ∙

research

∙ 05/06/2023

Listen to Look into the Future: Audio-Visual Egocentric Gaze Anticipation

Egocentric gaze anticipation serves as a key building block for the emer...

1 Bolin Lai, et al. ∙

research

∙ 04/13/2023

ShapeClipper: Scalable 3D Shape Learning from Single-View Images via Geometric and CLIP-based Consistency

We present ShapeClipper, a novel method that reconstructs 3D object shap...

5 Zixuan Huang, et al. ∙

research

∙ 03/28/2023

Egocentric Auditory Attention Localization in Conversations

In a noisy conversation environment such as a dinner party, people often...

11 Fiona Ryan, et al. ∙

research

∙ 12/16/2022

Werewolf Among Us: A Multimodal Dataset for Modeling Persuasion Behaviors in Social Deduction Games

Persuasion modeling is a key building block for conversational agents. E...

3 Bolin Lai, et al. ∙

research

∙ 12/14/2022

PulseImpute: A Novel Benchmark Task for Pulsative Physiological Signal Imputation

The promise of Mobile Health (mHealth) is the ability to use wearable se...

0 Maxwell A. Xu, et al. ∙

research

∙ 11/28/2022

Learning Dense Object Descriptors from Multiple Views for Low-shot Category Generalization

A hallmark of the deep learning era for computer vision is the successfu...

7 Stefan Stojanov, et al. ∙

research

∙ 10/10/2022

Transformer-based Localization from Embodied Dialog with Large-scale Pre-training

We address the challenging task of Localization via Embodied Dialog (LED...

0 Meera Hahn, et al. ∙

research

∙ 08/08/2022

In the Eye of Transformer: Global-Local Correlation for Egocentric Gaze Estimation

In this paper, we present the first transformer-based model to address t...

6 Bolin Lai, et al. ∙

research

∙ 04/21/2022

Planes vs. Chairs: Category-guided 3D shape learning without any 3D cues

We present a novel 3D shape reconstruction method which learns to predic...

10 Zixuan Huang, et al. ∙

research

∙ 03/21/2022

Generative Adversarial Network for Future Hand Segmentation from Egocentric Video

We introduce the novel problem of anticipating a time series of future h...

0 Wenqi Jia, et al. ∙

research

∙ 11/01/2021

Kernel Deformed Exponential Families for Sparse Continuous Attention

Attention mechanisms take an expectation of a data representation with r...

4 Alexander Moreno, et al. ∙

research

∙ 11/01/2021

Transformers for prompt-level EMA non-response prediction

Ecological Momentary Assessments (EMAs) are an important psychological d...

5 Supriya Nagesh, et al. ∙

research

∙ 10/26/2021

Efficient Learning and Decoding of the Continuous-Time Hidden Markov Model for Disease Progression Modeling

The Continuous-Time Hidden Markov Model (CT-HMM) is an attractive approa...

14 Yu-Ying Liu, et al. ∙

research

∙ 05/20/2021

Egocentric Activity Recognition and Localization on a 3D Map

Given a video captured from a first person perspective and recorded in a...

0 Miao Liu, et al. ∙

research

∙ 01/28/2021

Discriminative Appearance Modeling with Multi-track Pooling for Real-time Multi-object Tracking

In multi-object tracking, the tracker maintains in its memory the appear...

0 Chanho Kim, et al. ∙

research

∙ 01/18/2021

Using Shape to Categorize: Low-Shot Learning with an Explicit Shape Bias

It is widely accepted that reasoning about object shape is important for...

9 Stefan Stojanov, et al. ∙

research

∙ 01/18/2021

Does Continual Learning = Catastrophic Forgetting?

Continual learning is known for suffering from catastrophic forgetting, ...

16 Anh Thai, et al. ∙

research

∙ 11/26/2020

4D Human Body Capture from Egocentric Video via 3D Scene Grounding

To understand human daily social interaction from egocentric perspective...

0 Miao Liu, et al. ∙

research

∙ 11/16/2020

Where Are You? Localization from Embodied Dialog

We present Where Are You? (WAY), a dataset of 6k dialogs in which two h...

14 Meera Hahn, et al. ∙

research

∙ 06/14/2020

3D Reconstruction of Novel Object Shapes from Single Images

The key challenge in single image 3D shape reconstruction is to ensure t...

47 Anh Thai, et al. ∙

research

∙ 05/31/2020

In the Eye of the Beholder: Gaze and Actions in First Person Video

We address the task of jointly determining what a person is doing and wh...

0 Yin Li, et al. ∙

research

∙ 04/17/2020

Approximate Inverse Reinforcement Learning from Vision-based Imitation Learning

In this work, we present a method for obtaining an implicit objective fu...

0 Keuntaek Lee, et al. ∙

research

∙ 04/09/2020

Orthogonal Over-Parameterized Training

The inductive bias of a neural network is largely determined by the arch...

7 Weiyang Liu, et al. ∙

research

∙ 03/05/2020

Detecting Attended Visual Targets in Video

We address the problem of detecting attention targets in video. Specific...

0 Eunji Chong, et al. ∙

research

∙ 03/02/2020

A Functional EM Algorithm for Panel Count Data with Missing Counts

Panel count data is recurrent events data where counts of events are obs...

0 Alexander Moreno, et al. ∙

research

∙ 10/28/2019

Neural Similarity Learning

Inner product-based convolution has been the founding stone of convoluti...

0 Weiyang Liu, et al. ∙

research

∙ 06/12/2019

Compressive Hyperspherical Energy Minimization

Recent work on minimum hyperspherical energy (MHE) has demonstrated its ...

0 Rongmei Lin, et al. ∙

research

∙ 05/13/2019

Locally Weighted Regression Pseudo-Rehearsal for Online Learning of Vehicle Dynamics

We consider the problem of online adaptation of a neural network designe...

0 Grady Williams, et al. ∙

research

∙ 04/22/2019

Tripping through time: Efficient Localization of Activities in Videos

Localizing moments in untrimmed videos via language queries is a new and...

0 Meera Hahn, et al. ∙

research

∙ 04/10/2019

Learning to Generate Synthetic Data via Compositing

We present a task-aware approach to synthetic data generation. Our frame...

0 Shashank Tripathi, et al. ∙

research

∙ 04/09/2019

Unsupervised 3D Pose Estimation with Geometric Self-Supervision

We present an unsupervised learning approach to recover 3D human pose fr...

0 Ching-Hang Chen, et al. ∙

research

∙ 04/05/2019

Paying More Attention to Motion: Attention Distillation for Learning Video Representations

We address the challenging problem of learning motion representations us...

0 Miao Liu, et al. ∙

research

∙ 02/02/2019

Detecting Gaze Towards Eyes in Natural Social Interactions and its Use in Child Assessment

Eye contact is a crucial element of non-verbal communication that signif...

0 Eunji Chong, et al. ∙

research

∙ 01/02/2019

Action2Vec: A Crossmodal Embedding Approach to Action Learning

We describe a novel cross-modal embedding space for actions, named Actio...

0 Meera Hahn, et al. ∙

research

∙ 12/17/2018

Taking a Deeper Look at the Inverse Compositional Algorithm

In this paper, we provide a modern synthesis of the classic inverse comp...

8 Zhaoyang Lv, et al. ∙

research

∙ 12/05/2018

Vision-Based High Speed Driving with a Deep Dynamic Observer

In this paper we present a framework for combining deep learning-based r...

0 Paul Drews, et al. ∙

research

∙ 09/22/2018

Learning to Localize and Align Fine-Grained Actions to Sparse Instructions

Automatic generation of textual video descriptions that are time-aligned...

6 Meera Hahn, et al. ∙

research

∙ 06/02/2018

AutoRally An open platform for aggressive autonomous driving

This article presents AutoRally, a 1:5 scale robotics testbed for autono...

0 Brian Goldfain, et al. ∙

research

∙ 04/22/2018

Decoupled Networks

Inner product-based convolution has been a central component of convolut...

0 Weiyang Liu, et al. ∙

research

∙ 04/12/2018

Learning Rigidity in Dynamic Scenes with a Moving Camera for 3D Motion Field Estimation

Estimation of 3D motion in a dynamic scene from a temporal pair of image...

0 Zhaoyang Lv, et al. ∙

research

∙ 10/21/2017

Towards Black-box Iterative Machine Teaching

In this paper, we make an important step towards the black-box machine t...

0 Weiyang Liu, et al. ∙

research

∙ 10/02/2017

Fine-Grained Head Pose Estimation Without Keypoints

Estimating the head pose of a person is a crucial problem that has a lar...

0 Nataniel Ruiz, et al. ∙

research

∙ 08/15/2017

Dockerface: an easy to install and use Faster R-CNN face detector in a Docker container

Face detection is a very important task and a necessary pre-processing s...

0 Nataniel Ruiz, et al. ∙

research

∙ 08/02/2017

Noninvasive Corneal Image-Based Gaze Measurement System

Gaze tracking is an important technology as the system can give informat...

0 Eunji Chong, et al. ∙

research

∙ 05/30/2017

Iterative Machine Teaching

In this paper, we consider the problem of machine teaching, the inverse ...

0 Weiyang Liu, et al. ∙

research

∙ 06/28/2016

Automatic Variational ABC

Approximate Bayesian Computation (ABC) is a framework for performing lik...

0 Alexander Moreno, et al. ∙

research

∙ 11/13/2015

Unsupervised Learning of Edges

Data-driven approaches for edge detection have proven effective and achi...

0 Yin Li, et al. ∙

research

∙ 06/11/2014

The Secrets of Salient Object Segmentation

In this paper we provide an extensive evaluation of fixation prediction ...

0 Yin Li, et al. ∙

James M. Rehg

Featured Co-authors