Something went wrong.

We've been notified of this error.

Need help? Check out our Help Centre.

Interaction Design

A selection of Interaction Design projects, lead Interaction Design and User Experience; in collaboration with Sociologists, Ethnographers, Computer Scientists, Software Developers and other Designers.

I really like to work on ideation/sketching, interaction workflows, design systems and collaboration between design and development, using human-centred design thinking. I believe that our points of interaction with technology should be beautiful and easy-to-use and should connect emotionally with the user.

 

 

Social Devices - Companion features for MS Teams

 

Microsoft Teams, companion device features

Lead UX/UI designer & researcher.

Video meetings are surprisingly difficult. Although we can see and hear one another on almost any device, content and control are isolated on devices or physically limited to the room. Social nuances and engagement can be hard for remote participants. 

This work explores how to enable devices to act as companions. We look to ways in which our devices can be dynamically aggregated and disaggregated to create user experiences that adapt to the changing social and activity demands we encounter throughout the day.

In Microsoft Teams you can now use your computer and phone together in meetings, without conflict, for more flexible communication, sharing, and control. You can use Companion Experiences to solve lots of everyday video meeting problems.

Add any combination of my devices to a video meeting.

Support spontaneous tasks from any of our devices

Distribute tasks across my multiple devices

Use the device best suited for a task

Add content from any of my devices



 

Interaction Design Workshops - nothing like a good brain-bounce

Building UI prototypes - interaction flow diagrams and clickthrough prototypes

 

Skype Unleashed - early concepts for connecting multiple devices to a video call.

Early prototypes - testing multiple device scenarios.

 

Interaction flow screen designs - Using Sketch to design each stage of the user interface.

Microsoft Teams - Companion landing screen UI, for using a secondary device in a video call

Microsoft Teams - Companion UI for sharing live video from a secondary device into a video call

 

 

Hand Tracking for AR & VR

 

Efficient and Precise Interactive Hand Tracking

3D hand tracking research from Microsoft, presented at SIGGRAPH 2016. Experiments in tactile interaction in VR. We designed and built virtual controls and interaction experiences, in collaboration with machine learning & computer vision experts. This research would later be integrated into Hololens 2. 

The system can track detailed hand motion using a standard depth camera. It lets you see what your hands are doing, fixing a common disconnect that happens when people are interacting with virtual reality but can’t see their own hands.

In collaboration with colleagues at Microsoft Research Cambridge

 

Virtual Controls - Designing tactile controls for physical interaction, allowing a user to turn a dial or grab a lever.

VR hand tracking piano interaction prototype

 

Sketch for UI designs - Augmented Reality finger extensions, utilising hand tracking and AR technology.

Mirrored Real Time Tracking - The system can track hands smoothly, quickly and accurately - in real time.

 

Basic physical interactions like dials, buttons and sliders - Testing the precision and accuracy of the hand tracker. 

Building different applications and experiences - we built and tested a bunch of experiences designed to utilise the unique capabilities of the hand tracking algorithm.

 

 

Assessing Multiple Sclerosis 

 

ASSESS MS -

Research, UX/UI design, product design

Monitoring multiple sclerosis is incredibly difficult; the neuro-degenerative condition develops slowly over time at an inconsistent pace, giving even the most skilled neurologists a major clinical challenge. Assess MS brings together doctors’ expertise—and humanity—with exacting computational data to provide a more robust approach to tracking the disease. Depth cameras from the Kinect gaming system and artificial intelligence give qualitative status reports, which provide essential data to supplement doctors’ informed decisions about treatment.

In collaboration with Novartis and colleagues at Microsoft Research Cambridge

 

Animated instructional videos - these videos are played for the patients to demonstrate the physical movement required for each test.

 

Interaction Designs - UI Flow diagram & testing the prototype

 

UI Screen Designs - MS can often affect a patients' eyesight. The patient UI needed to be easy to read, using high contrast text and graphics.