
Human–Computer Interaction
Understanding people.
Designing interaction.
I study how we perceive, move, and interact—and how this can shape more human-centred technology.
I’m a Leverhulme Early Career Fellow in the School of Computing and Communications at Lancaster University, working with Hans Gellersen. My research connects models of human behaviour with the design of interactive systems, particularly gaze interaction, extended reality (XR), and human-centred AI.
I completed my PhD in Engineering at the University of Cambridge, supervised by Per Ola Kristensson. Before that, I studied Human–Computer Interaction at UCL and Computer Science and Technology at Zhejiang University of Technology.
Research interests
- Human perception and movement. Modelling eye–head–hand coordination and individual differences in interactive systems.
- Interaction in extended reality. Designing multimodal techniques for text entry, selection, navigation, and everyday work in XR.
- Embodied, human-centred AI. Connecting sensorimotor behaviour with intelligent systems that adapt to people.
News & updates
Our paper NeckErgonomics received a Best Paper Award – Honourable Mention at ACM SUI 2026 in Bari, Italy. Award details ↗
I’m co-organising the GEMINI workshop at ISMAR 2026 in Bari, bringing together researchers working on gaze and interaction in XR.
I’ve started my Leverhulme Early Career Fellowship at Lancaster University: Body-in-the-World Intelligence: Grounding AI in Human Sensorimotor Intelligence. Award announcement ↗
Our paper Looking Around by Looking Around, on omnidirectional gaze-based VR viewport control, has been accepted to IEEE TVCG / ISMAR 2026.

LALA study setup · Source ↗
More from 2026 · 7 updates
I presented Prediction of Eye Dominance in VR at ETRA 2026 in Marrakesh. We also had a full paper at the conference: Aligner, Nodder, and Winker, exploring hands-free selection and dragging.

Figure from the ETRA paper · Source ↗ I took part in a Dagstuhl seminar in Germany—a chance to exchange ideas and discuss research with colleagues.
I presented The Eye–Head Mover Spectrum at CHI 2026. A student project I co-supervised, Interaction of Cursor Warping and View Manipulation in Multi-Display Extended Reality, was also presented at CHI. LinkedIn post & animation ↗
I attended Free Rein · 2026 Global Youth AI Forum, co-hosted by The Chinese University of Hong Kong, Shenzhen and Shenzhen Loop Area Institute, and presented my research.
I visited HKUST (Guangzhou), hosted by Qiushi Zhou and Ben. Thank you both for the warm welcome!
I organised the GEMINI workshop at IEEE VR 2026. It was a pleasure to welcome two fantastic keynote speakers: Shengdong Zhao, on heads-up computing, and Ana Serrano, on task-driven gaze in multisensory XR.
I joined the LMU Winter School at Söllerhaus—skiing, talks, and conversations about LLMs and their role in HCI.

Winter school image, HCILab · Source ↗
Earlier updates · 2024–2025
Our TOCHI paper, Sensorimotor Regularities as Alignment between Humans and Large Language Models, explores how LLMs represent embodied concepts and how sensorimotor priors can improve human–AI alignment. With Jingyi Li and Per Ola Kristensson. LinkedIn announcement (reposted) ↗
A year of new beginnings: I passed my PhD viva, returned to Darwin College, Cambridge to graduate, and joined Lancaster University to work with Hans Gellersen. Highlights included CHI and a research-group visit to Aarhus University. Year in review ↗

From my 2025 year in review · Source ↗ I presented LookUP: Command Search Using Dwell-free Eye Typing in Mixed Reality at ISMAR 2024 in Seattle, sharing our work on hands-free command access for mixed reality. LinkedIn post ↗

Presenting LookUP at ISMAR 2024 · Source ↗
Selected publications
All publications →Teaching & mentoring
I’ve taught HCI and interaction design through professional courses, small-group tutorials, and hands-on engineering classes.
Teaching
- 2023–2025
- Lead Tutor · HCI for AI Systems DesignCambridge Advance Online
- 2023
- Lead Demonstrator · Engineering LEGOUniversity of Cambridge
- 2021–2023
- Supervisor · Further Human–Computer InteractionUniversity of Cambridge · Part IB
- 2021–2022
- Demonstrator · Engineering LEGOUniversity of Cambridge
- 2020–2021
- Supervisor · Interaction DesignUniversity of Cambridge · Part IA
At Cambridge, supervisions are independently designed and led small-group tutorials.
Student mentoring
PhD students · Lancaster University
- Hock Siang Lee 2025–2026
- Baosheng James Hou 2025
- Guanlin Li 2025–2026
- Franziska Prummer 2025
Master’s students
- Yuzhen Chen2025
Lancaster University · Subsequently PhD at Lancaster
- Yi Chen Hock2023
University of Cambridge · Drawing using context-sensitive hand gestures in VR · Subsequently Meta
Education & experience
Education
- 2020–2024
- PhD in EngineeringUniversity of Cambridge · Intelligent Interactive Systems GroupSupervisor: Per Ola Kristensson
- 2018–2019
- MSc in Human–Computer InteractionUniversity College London
- 2014–2018
- BSc in Computer Science and TechnologyZhejiang University of Technology
Research experience
- Current
- Leverhulme Early Career FellowLancaster University
- 2025
- Senior Research AssociateLancaster University · GEMINI projectAdvisor: Hans Gellersen
Selected professional experience
- 2023
- PhD Insights Programme · McKinsey & Co.London, UK
- 2021
- Venture Capital Advisor · Hillhouse CapitalShenzhen, China
- 2019–2020
- Product Manager · NetEaseHangzhou, China
Academic service
Workshop organisation
- 2026
- GEMINI: Gaze and Eye Movement in Interaction in XRPrimary organiser · IEEE VR and IEEE ISMAR
- 2026
- Eye Tracking and Brain–Computer Interfaces in AR/VRWorkshop at UbiComp
Programme committees & associate chair roles
In 2026: ACM CHI Posters, ACM SUI, and ACM NordiCHI (Associate Chair); ACM VRST and IEEE ISMAR (International Programme Committee); and IEEE VR Doctoral Consortium (Programme Committee).
Reviewing
ACM TOCHI Distinguished Reviewer Board (2026); IEEE TVCG (2026); ETRA (2025–2026); CHI (2023–2025); UIST (2025); CHI Late-Breaking Work (2022–2025); ISMAR and IEEE VR (2022–2026); VRST (2024).
Student volunteer: IEEE VR (2024), ISMAR (2021), and CHI (2020–2021).
Talks & media
Presentations
- 2026
- ACM CHI · ACM ETRA · IEEE VR
- 2025
- ACM CHI
- 2024
- IEEE VR · ISMAR · Cambridge Festival · CHIA Conference
- 2022
- ISMAR
- 2021
- CUED Division C Conference
Selected media coverage
Our study of working in VR for one week was covered in 2022 by:
Get in touch
For questions about my research or potential collaborations, email j.hu23@lancaster.ac.uk.



