Design Lab

Origami Hand Detection

An interactive origami experiment: use hand gestures to control a Pikachu folding animation and explore six folding steps.

Allow camera access to use hand gestures.

Art & Explore — The Met

An interactive museum gallery featuring the Top 10 master artists and 61 iconic artworks from The New York Metropolitan Museum of Art, complete with custom paper-cut artist docents, full-screen theatre, and MediaPipe hand gesture navigation.

Move hand to control cursor · Touch thumb + index finger to click.

Vincent van Gogh Claude Monet Rembrandt Johannes Vermeer Katsushika Hokusai

Architecture 3D Motion

Interactive 3D architectural deconstruction of Jørn Utzon’s Sydney Opera House. Scroll wheel up to deconstruct the structure into an 8-layer exploded view with dynamic load-path vectors; click each part for technical engineering analysis; scroll down to seamlessly reassemble the building into its complete form and Bennelong Point harbour environment.

Scroll mouse wheel up to explode · Scroll down to assemble · Click parts to inspect.

Sydney Opera House 3D Deconstruction

Ubi-Interactive Augmented Reality

A Natural User Interface (NUI) software platform turning any wall, tabletop, or whiteboard into a multi-touch computing display using 3D depth-sensing cameras (such as Microsoft Kinect) and computer-vision tracking. Designed floating annotation tools, document camera workflows for classrooms, and touchless InAir gestures.

Turn any surface into a touchscreen · Touchless InAir gestures · Multi-touch pen & finger tracking.

InAir Gesture Mode Animated Demo

Airbnb Installment Booking

Originating and designing Airbnb’s flexible split-payment feature ("Pay Less Up Front") on the Guest Growth Team. Streamlined a 54-step legacy checkout into an intuitive 6-step mobile flow across Airbnb DLS, Explore 2.0, and Airbnb Plus—officially shipped globally across Mobile and Web.

Shipped globally as "Pay Less Up Front" · Explore 2.0 & Airbnb Plus · 54-step flow simplified.

Airbnb Installment Booking — Pay Less Up Front

Work

Selected product design, human-centered AI, and interactive case studies.

AI+UX Research

Peer-reviewed publications and interactive research across machine learning, reinforcement learning, and human-computer interaction.

Machine Learning IJHCS · Elsevier
Qi Dou, Xianjun Sam Zheng, Tongfang Sun, Pheng-Ann Heng

Webthetics: Quantifying Webpage Aesthetics with Deep Learning

A deep convolutional neural network that automatically computes and quantifies visual webpage aesthetics from human rating data, transferring knowledge from image style recognition into the network to objectively evaluate layout balance, visual complexity, and interface design factors.

Published in International Journal of Human-Computer Studies (Vol. 124)
Reinforcement Learning AAAI AIIDE
Baoxiang Wang, Tongfang Sun, Xianjun Sam Zheng

Beyond Winning and Losing: Modeling Human Motivations and Behaviors with Vector-Valued Inverse Reinforcement Learning

Extending inverse reinforcement learning (IRL) to vector-valued rewards with Pareto optimality to model multifaceted human motivations and uncover latent value structures in complex, high-dimensional virtual environments.

Published in Proceedings of the 15th AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment (AIIDE)
Computer Vision Tangible UI Lab

Touchless Spatial Interaction with MediaPipe HandLandmarker

Designing zero-latency cursor stabilization and palm-normalized two-finger pinch thresholds for reliable web clicking and 6-step origami folding without hardware controllers.

Cultural AI Spatial Curation

Persona-Driven Museum Docents & Visual Storytelling

Transforming static museum catalog metadata into approachable first-person narratives and interactive pigment exploration for 61 public-domain masterpieces at The Met.

About

Hello! I’m Tong Fang Sun, currently a Product Designer at Google, focused on the intersection of minimalism, human-centered AI, and expressive interactive web experiences.

I believe great design strips away unnecessary complexity until only intuitive, joyful interaction remains — whether crafting a clean product workflow, folding a 6-step origami Pikachu with hand gestures, or strolling through The Metropolitan Museum of Art after hours.

UX / Product Design AI + UX Research MediaPipe & Creative Coding Interactive Prototyping (Framer / Web) Design Systems