Jom (Pornthep) Preechayasomboon

จอม (พรเทพ) ปรีชญสมบูรณ์

Hi there. I'm a Research Scientist at Meta Reality Labs Research!

I'm a PhD graduate from Rombolabs, University of Washington.
I'm interested in the intersection of virtual reality, soft robotics, haptics!

I also like to make hardware and write software to make things work together!

📧 prnthp@uw.edu

🐙 GitHub
🔗 LinkedIn
📘 Facebook
🧱 Bricklayer - Experiment Structures for User Studies in Unity
📈 How to make nice vector MATLAB figures for publications

📄 Resume (PDF)
🧰 Projects
📚 Publications
🔧 Tools
👋 About


The following are some highlights from my research

Untitled EMG Project is an ongoing project where we are trying to learn hand kinematics from a forearm-worn EMG array. For data collection, I built a custom 8-channel EMG armband from scratch based on the ADS1299. The electrodes are 3D printed from electrically conductive TPU. The nRF-based wireless communication, based off of technology developed for our haptics projects, enable low latency (1 ms) streaming to a USB dongle. We stream 1000 Hz data directly to a Meta Quest 2 so we can collect hand tracking data and EMG signals simultaneously, all locally on the headset. This is great for deployment for user studies without the hassle of hardware setup, just plug-n-play.

EMG Band Prototype

I also developed a data collection VR app that uses physics-based hands with hand tracking to simulate tasks such as pick-and-place (for unstructured data), AR/VR-type gestures and common EMG gestures. The data is also uploaded to AWS S3 storage automatically. Real-time plots and debug interface were drawn using imgui + implot.

I also made this sick data visualizer for the collected EMG and kinematic data.

And lastly, a rather unrelated, proof-of-concept of EMG + Physics Hands 🤝

We are currently in the process of crunching our numbers from the collected data.


Bricklayer

Bricklayer (Experiment Structures) is a framework for a finite state machine that exploits Unity’s Scene hierarchy for reordering the states and utilizes Unity’s Inspector for configuration. The framework has been used mainly for creating human behavioral experiments (psychophysics) and data collection applications (Haplets, the EMG project, and Chasm, amongst others). Bricklayer Demo

Also works with AEPsych, from the good folks at Meta. (Adaptive nonparametric psychophysics server for speeding up your experiments) AEPsych driven samples for Bricklayer

Links


Haplets Keyshot

Haplets are wireless, finger-worn LRAs. They were created to answer the question: “What is the minimum viable haptics that we can add to the fingers to augment hand tracking in AR?”. Our paper covers the hardware design, validation and a user study with Haplets used in conjunction with a pen. Our results suggest that users are more accurate when drawing with Haplets.

Haplets with a pen

Cool facts about Haplets

Links


Chasm Header Image Chasm was my project during my 6-month internship at Meta Reality Labs. Chasm is a haptic actuator that is designed to render shear forces and vibrations simultaneously in a form factor no larger than a AAA battery. We prototyped Chasm in a bunch of form factors including a headband, marker, and VR controllers. With the headband, Chasm can be used to nudge user’s temples to provide navigation cues. With the marker, Chasm can render high fidelity haptics that simulate textures, forces and even elasticity.

The full presentation given at CHI2020 can be watched here:

Cool facts about Chasm

Links


Negshell Negshell is a casting technique that exploits the fragility of thin-walled SLA resin parts to create complex internal structures for soft robots. Website, Full Paper (MDPI)

ConTact Sensor ConTact Sensor is a simple soft robotic sensor that can simultaneously sense force and area. Soft Robotics Toolkit, Conference Paper (IEEE RoboSoft)

Bishop’s Hand was a project that aimed to measure limb ownership by having users play the knife game on themselves. The video shown is what we should have done.

Prosthetic Hand My Undergraduate Project was a prosthetic hand with a fingertip sensor that could detect the onset of slip. We CNC machined almost every part of the hand ourselves on a Mazak Integrex. One of the coolest experiences I’ve ever had. The slip detection sensor deserved a publication of its own!