2026

Adaptive Intent-Aware Robot Handovers

Investigates how robots can perform more natural and reliable handovers by predicting human intent, motion, and preferred transfer locations. Studies adaptive strategies where the robot reasons about reachability, approach trajectory, grasp affordances, and comfort. Long-term goal is bidirectional handovers — both receiving from and delivering to humans — in a way that feels anticipatory, safe, and socially fluent.

Collaborators: Sandeep John Philip

Anticipatory Human-guided Robot Action (AHEAD)

Targets remote teleoperation scenarios where robot lag behind operator intent makes manipulation slow and cognitively demanding. Reduces reaction time by predicting the operator's likely target using eye gaze, hand trajectories, and object context — enabling the robot to proactively move toward the predicted target while keeping the human in control. Makes teleoperation faster, smoother, and less cognitively demanding.

Collaborators: Seok Joon Kim

AR-Enabled Human-Robot Coassembly

Develops AR-enabled coassembly systems where robots assist humans during tasks involving tools, parts, and shared workspaces. An egocentric AR interface lets the system observe the task from the operator's perspective, track assembly progress, and infer upcoming needs — enabling timely robot assistance (holding parts, fetching tools) without disrupting human workflow. Combines egocentric perception, multimodal sensing, task-state understanding, and safe robot motion.

Collaborators: Dante Santaniello

AR/VR Interfaces for Intuitive Robot Control

Develops AR/VR teleoperation interfaces for intuitive robot control via spatially grounded interaction using Meta Quest and handheld gripper interfaces. Operators visualize robot motion, perceive the remote workspace, and provide both high-level and continuous control inputs. Explores how AR, shared autonomy, visual feedback, and predictive robot assistance can reduce operator workload and improve remote manipulation performance.

Collaborators: Seok Joon Kim

Context-Aware LLM AR Guidance From Context-Agnostic to Context-Aware: Multimodal Context Injection for LLM-Based AR Task Guidance

Investigates how real-time multimodal context improves LLM-based AR task guidance assistants. Develops a context injection framework that progressively incorporates task descriptions, procedural steps, real-time task progress, and hand action data into an LLM's prompt. Validated on the HoloAssist dataset; real-time hand action data provided the largest performance gains in accuracy, relevance, and consistency.

Collaborators: Mahya Qorbani

Immersive Gamified VR Training for Automotive Assembly

A gamified VR training system for automotive assembly workers combining high-fidelity simulation with interactive game mechanics. Features synchronized multimodal feedback (visual, auditory, haptic) via headset and controllers to study each sensory channel's role in skill acquisition and transfer. Optimized for wireless headsets (Meta Quest 3) with cloud-based analytics dashboards for progress tracking and longitudinal skill assessment. Demonstrated in the context of Kia's Door Module Assembly using a "Ghost Master" scaffold grounded in Cognitive Apprenticeship theory.

Collaborators: Steven Yoo, Pantea Habibi

IoT Integrated AR for Human Machine Interaction

Proposes an AR interface integrated with IoT to address usability challenges in industrial HMIs — including data overload and spatial misalignment. Built on a Kepware-ThingWorx-Vuforia pipeline and tested in a cyber-physical factory for cellphone assembly. Evaluated against Siemens HMIs using HoloLens 2 with 20 participants; AR significantly improved efficiency, task completion time, error rates, usability, and reduced mental load.

Collaborators: Akhil Aji

Narrative-Driven Immersive GNN Explainability

Develops a Neuro-Symbolic Immersive Interface integrating LLM-generated narratives into a real-time VR analytics loop to make Graph Neural Network (GNN) decisions interpretable for domain experts. Translates GNN latent representations into natural-language explanations rendered alongside structural graph visualizations. Controlled user studies examine how this multimodal approach affects belief formation, trust calibration, and cognitive load vs. visual-only explanations.

Collaborators: Pantea Habibi

PORE-XR: Porous Objects Research & Exploration in XR

An immersive XR visualization platform for large-scale X-ray Computed Tomography (XCT) data supporting non-destructive evaluation of internal material structures (porosity, cracks, defects). Transforms volumetric scans into a walk-around immersive workspace with natural two-handed gesture manipulation and real-time feature isolation. Built in Unity for cross-platform deployment; demonstrated on Meta Quest, Varjo XR-3, and Apple Vision Pro. Open-source, with dynamic cutting planes, region-of-interest cutouts, annotation, and 3D measurement overlays.

Collaborators: Pantea Habibi

Sensory-Augmented XR Teleoperation

An XR-based teleoperation system developed with the GT Safe Robotics Lab, investigating how haptic, visual, and audio feedback affect operator performance in collaborative manipulation tasks. Seeks to identify the minimum sensory feedback needed to improve teleoperator performance. Uses Meta Quest hand tracking, bHaptics TactGlove vibrotactile haptics, and Unitree G1 humanoid robots with stereoscopic cameras for contact-rich manipulation.

Collaborators: Austin Graves

XR VIEU: eXtended Reality for Visual Impairment Exploration and Understanding

A modular, real-time, gaze-contingent XR framework simulating central vision loss on the Varjo XR-4. Models seven distinct visual phenomena (e.g. spatial distortion, perceptual fill-in) associated with conditions like AMD. Each module is independently configurable per eye. Used for empathy training, inclusive design, and rehabilitation research. Collaboration with Emory University and CVI Atlanta.

Collaborators: Parisa Ghasemi

2025

AR Mediated Seamless Human Robot Intent Communication

An AR system using a Unity-ROS pipeline that enhances intent communication between humans and collaborative robots during complex assembly tasks. Integrates multimodal input/output for dynamic interaction. User studies showed AR significantly improved communication clarity, reduced errors, increased task efficiency, minimized completion times, and boosted user confidence and trust in robot actions.

Collaborators: Akhil Aji

HoloLens 2 AR-Guided Precision Inspection

AR-guided psychomotor tasks using HoloLens 2 for precision inspection with 3D-printed parts and industrial gauges. Two-session study covering gauge selection, calibration, measurement of part features, and accept/reject decisions based on tolerances.

Collaborators: Steven Yoo

2024

AR-Based Adaptive Training Using Gaze and Expertise Modeling

Explores AR-based adaptive, personalized on-the-job training using eye tracking, computer vision, pupillometry, and egocentric video. Examines novice vs. expert differences in gaze behavior, visual attention, and pupil-size changes during AR-guided procedural tasks.

Collaborators: Steven Yoo

2023

AR & VR Training for Cold Spray and Robotic Painting

AR and VR training systems for cold spray additive manufacturing and robotic painting using Unity-based interactive guidance, multimodal data (gaze & hand tracking), and immersive simulations for psychomotor skill learning.

Collaborators: Steven Yoo