Perceptual Engineering Lab

Building technologies that integrate with the brain

ABOUT



Misha Sra

Assistant Professor at UCSB (since 2019)

Director of the Perceptual Engineering Lab (PercLab) in the Computer Science Department.

I am affiliated with the Center for Responsible Machine Learning, Mind & Machine Inteligence and the Cognitive Science Program at UCSB. I received my PhD from the MIT Media Lab advised by Prof. Pattie Maes in the Fluid Interfaces group.

The PercLab works on designing and engineering new AR/VR, hardware and AI technologies that augment human physiological and perceptual capabilities. The techologies we design fall into two main categories: 1) systems that transform internal body signals into conscious perception, and 2) systems that transform external world signals into augmented perception. Inspired by the 1960 vision of a Cyborg proposed by Manfred and Kline, our goal is to create future "artifact-organism systems" that extend the body and the mind. These systems will augment human capabilities automatically and unconsciously, leaving us free, as Manfred and Kline wrote - to explore, to create, to think, and to feel.


RESEARCH



Living Bits

Opportunities and Challenges for Integrating Living Microorganisms in Human-Computer Interaction. AH 2020. Best Paper Award (top 4%).

Consciousness

Designing Interactions Beyond Conscious Control: A New Model for Wearable Interfaces. IMWUT 2020.

Walking in VR

Walking and Teleportation in Wide-area Virtual Reality Experiences. ISMAR 2020.

World Editor

Augmented Reality World Editor. VRST 2020. Audience Choice Award.

MoveU

Electrical stimulation wearable device for providing haptic feedback and reducing motion sickness in VR. CHI 2019.

Time Travel MIT

An outdoor VR time travel experience that takes you to the MIT of 1916 as well as an envisioned future 100 years from now.

BreathVR

VR games that use breathing actions to augment controller input. CHI 2018. Best Paper Honorable Mention (top 5%)

Zanzibar

A flexible, portable mat that can sense and track objects, and support multi-touch and hover gestures. CHI 2018. Best Paper Award (top 1%)

VMotion

Methods for managing user perception and attention based on the cognitive illusion of Inattentional Blindness. DIS 2018.

Your Place And Mine

Room-scale mapping techniques to support natural interaction in shared VR spaces for remotely located users. DIS 2018.

GVS

A collaborative interface that allows remote control of a person's walking trajectory through galvanic vestibular stimulation (GVS). VRST 2017.

Auris

A pipeline for the automatic generation of VR worlds from music. It uses a deep neural network for mood-based image generation. VRST 2017.

Oasis

Automatic generation of VR worlds from 3D reconstruction of real world places. VRST 2016. TVCG 2017. Best Paper Award (top 0.02%)

Full-body Tracking VR

A mocap hack using ViVe controllers before Vive trackers became available. IAP 2017.

Building VR Worlds

Creating immersive and interactive VR worlds using the real world as a template. New Context 2015.

SnowballVR

Asymmetric multiplayer VR with roles based on the size of a user's space. UIST 2016.

Amphibian

Multisensory scuba diving experience in VR. CHI 2016. UIST 2016.

Metaspace II

Room-scale social VR with object and full-body tracking built using Kinects before Vive became available. IEEE VR 2016.

Metaspace I

Room-scale social VR with full-body tracking. It was built before the Vive was announced. UIST 2015.

Lights Out

A sensor-based bedtime alarm and a wallpaper display to promote awareness with sleep data visualization. MobiHealth 2015.

Deep Learning

Handwritten Tamil character recognition with a Convolutional Neural Network (CNN). NEML 2014.

Hands Free

In-air gesture recognition system.

OnTheGo

Gestural input for mobile and wearable devices.

Activ8

Three physical microgames for Google Glass for taking short breaks from sitting in 2014.

Morph

A continuously morphing 4D geometrical VR world was my first VR project (DK1) back in 2013.

Spellbound

An outdoor fast paced team-based Android game. This was my Master's Thesis at the Media Lab completed in Aug 2013. PUC 2015.

Spotz

A location based personality creator and visualizer. Persuasive 2013.

Point & Share

Digital pen that transmits writings on paper to the whiteboard. UIST 2012.

Health Score

An interactive tabletop application that displays a Health Score of a location, neighborhood or a selected area on a map.

PUBLICATIONS

2020
Jake Guida and Misha Sra. Augmented Reality World Editor. VRST 2020. [AUDIENCE CHOICE AWARD].
Ehsan Sayyad, Misha Sra and Tobias Hollerer. Walking and Teleportation in Wide-Area Virtual Reality Experiences. ISMAR 2020.
Abhinandan Jain, Adam Haar Horowitz, Felix Schoeller, Sang-won Leigh, Pattie Maes, and Misha Sra. Designing Interactions Beyond Conscious Control: A New Model for Wearable Interfaces. IMWUT 2020.
Pat Pataranutaporn, Anjela Vujic, David S. Kong, Pattie Maes and Misha Sra. Living Bits : Opportunities and Challenges for Integrating Living Microorganisms in Human-Computer Interaction Augmented Humans 2020. [BEST PAPER AWARD (top 4%)].

2019
Misha Sra, Abhinandan Jain and Pattie Maes. Adding proprioceptive feedback to virtual reality experiences using galvanic vestibular stimulation. CHI 2019.

2018
Misha Sra, Xuhai Xu, Aske Mottelson and Pattie Maes. VMotion: Designing a Seamless Walking Experience in VR. DIS 2018.
Misha Sra, Aske Mottelson, and Pattie Maes. Your Place And Mine: Designing a Shared VR Experience for Remotely Located Users. DIS 2018.
Misha Sra, Xuhai Xu, and Pattie Maes. BreathVR: Leveraging breathing as a directly controlled interface for virtual reality games. CHI 2018.[BEST PAPER HONORABLE MENTION (top 5%)].
Nicolas Villar, Daniel Cletheroe, Greg Saul, Christian Holz, Tim Regan, Oscar Salandin, Misha Sra, Hui-Shyong Yeo, William Field, and Haiyan Zhang. Project Zanzibar: A portable and flexible tangible interaction platform. CHI 2018. [BEST PAPER AWARD (top 1%)].

2017
Misha Sra, Sergio Garrido-Jurado, and Pattie Maes. Oasis: Procedurally generated social virtual spaces from 3d scanned real spaces. IEEE Transactions on Visualization and Computer Graphics, 2017.
Misha Sra, Prashanth Vijayaraghavan, Pattie Maes, and Deb Roy. Auris: Creating affective virtual spaces from music. In ACM VRST 2017, pages 26:1–26:11.
Misha Sra, Xuhai Xu, and Pattie Maes. Galvr: A novel collaboration interface using GVS. In ACM VRST 2017, pages 61:1–61:2.
Misha Sra, Prashanth Vijayaraghavan, Ognjen Rudovic, Pattie Maes, and Deb Roy. Deepspace: Mood-based image texture generation for virtual reality from music. In IEEE CVPRW 2017, pages 2289–2298.
Misha Sra. Steering locomotion by vestibular perturbation in room-scale VR. In IEEE VR 2017, pages 405–406.
Manisha Mohan, Misha Sra, and Chris Schmandt. Technological interventions to detect, communicate and deter sexual assault. In ACM ISWC 2017, pages 126–129.

2016
Misha Sra, Sergio Garrido-Jurado, Chris Schmandt, and Pattie Maes. Procedurally generated virtual reality from 3D reconstructed physical space. In ACM VRST 2016, pages 191–200. [BEST PAPER AWARD (top 1%)].
Dhruv Jain, Misha Sra, Jingru Guo, Rodrigo Marques, Raymond Wu, Justin Chiu, and Chris Schmandt. Immersive terrestrial scuba diving using virtual reality. In ACM CHI 2016, pages 1563–1569.
Misha Sra. Asymmetric design approach and collision avoidance techniques for room-scale multiplayer virtual reality. In ACM UIST 2016, pages 29–32.
Misha Sra. Resolving spatial variation and allowing spectator participation in multiplayer VR. In ACM UIST 2016, pages 221–222.
Dhruv Jain, Misha Sra, Jingru Guo, Rodrigo Marques, Raymond Wu, Justin Chiu, and Chris Schmandt. Immersive scuba diving simulator using virtual reality. In ACM UIST 2016, pages 729–739.
Misha Sra and Chris Schmandt. Bringing real objects, spaces, actions, and interactions into social VR. In IEEE 3DCVE 2016, pages 16–17.

2015
Misha Sra and Chris Schmandt. Expanding social mobile games beyond the device screen. Personal and Ubiquitous Computing, 19(3-4):495–508, 2015.
Weixuan Chen, Misha Sra, and Rosalind Picard. Improving sleep-wake schedule using sleep behavior visualization and a bedtime alarm. In ICST EAI Wireless Mobile Communication and Healthcare 2015, pages 241–244.
Misha Sra and Chris Schmandt. Metaspace: Full-body tracking for immersive multiperson virtual reality. In ACM UIST 2015, pages 47–48.

2014 and older
Misha Sra and Chris Schmandt. Spotz: A location-based approach to self-awareness. In Springer Persuasive Tech. 2013, pages 216–221.
Misha Sra, Austin Lee, Sheng-Ying Pao, Gonglue Jiang, and Hiroshii Ishii. Point and share: from paper to whiteboard. In ACM UIST 2012, pages 23–24.

TEACHING



CS291A - Spring 2021, Future User Interfaces

CS185 - Winter 2021 (on Gauchospace)

MEMBERS & AFFILIATES



Misha Sra

Assistant Professor of Computer Science

Sherry Chen

PhD student, CS

Machine Learning, VR

Yimeng Liu

PhD student, CS

Machine Learning, VR

Giuliana Barrios

Visiting Master's student, CS

Machine Learning, Health

Atieh Taheri

PhD student, ECE

Accessibility, Machine Learning

Andrew Huard

PhD student, ECE

VR, Hardware

Jungah Son

PhD student, MAT

VR, Sketching

Mengyu Chen

PhD student, MAT

AR, Machine Learning

CONTACT


The Perceptual Engineering Lab is housed in the Computer Science Department at UC, Santa Barbara. Our lab is located in Building 935, next to Phelps Hall.



© Perceptual Engineering Lab