✨ Augmented Reality & NUI UX Design Intern Seattle, WA Featured on GeekWire

Ubi-Interactive Augmented Reality Design

Turning any physical surface—walls, conference tables, glass, or whiteboards—into an interactive multi-touch computing display using 3D depth camera sensors and computer-vision tracking.

Ubi Interactive Augmented Reality Display - Turning Any Wall into a Touchscreen

Project Metadata

Company
Ubi-Interactive Inc.
Timeline
2015 – 2016
Role
UX Designer (Intern)
Domain
Augmented Reality (AR), Natural User Interfaces (NUI)
Location
Seattle, WA
Hardware Ecosystem
Depth Sensor (Kinect), Projector, Ubi-Pen Stylus
Press Coverage
GeekWire Technology Spotlight ↗

About The Project

Ubi-Interactive is an Augmented Reality software startup that turns any physical surface into an interactive touchscreen display. By pairing off-the-shelf projectors with 3D depth camera sensors (such as Microsoft Kinect), Ubi democratized large-format touchscreens for education, enterprise meetings, and collaborative workspaces without requiring expensive dedicated hardware.

User Needs & Problem Space

While early versions provided basic touch interaction (tap and drag), user research revealed key gaps in real-world workflows:

  • Educators in Classrooms: Needed natural stylus writing (Ubi-Pen) alongside finger touch, plus the ability to project physical textbooks and student work live via document cameras.
  • Enterprise Teams: Required shareable digital whiteboards that seamlessly connected remote offices over Skype and Google Drive.
  • Diverse Physical Spaces: Demanded an adaptive setup engine that supported different room shapes, ceiling mounts, table projections, and glass partitions without tedious manual calibration.

Design Approach & Key Solutions

As UX Designer, I redesigned the Seamless Interface Software, focusing on clean ergonomics and fast, intuitive interaction:

  • Floating System Annotation: A universal floating toolbar enabling notes, drawing, and highlights on top of any Windows application.
  • Touchless InAir Gestures: Leveraging 3D depth tracking so users can point, click, and swipe in mid-air from a distance.
  • Scenario-Based Calibration: A streamlined 6-scenario setup flow that guides non-technical users to calibrate their display in under two minutes.