Creating XR Educational Experiences for the Future: from Arts to Sciences

Lap-Fai YU; Sai-Kit YEUNG; Chi Fu LAI; Ka Sin Cindy LAM

doi:10.1145/3757371.3763256

Creating XR Educational Experiences for the Future: from Arts to Sciences

Lap-Fai YU
, Sai-Kit YEUNG
, Chi Fu LAI
, Ka Sin Cindy LAM

Research output: Book Chapters | Papers in Conference Proceedings › Conference paper (refereed) › Research › peer-review

Abstract

Recent advances in extended reality (XR) technologies have unlocked the tremendous potential of XR for delivering interactive and immersive education experiences. Such XR experiences generally involve animating virtual characters in real-world scene, driven by scene semantics. For example, via a mixed reality headset, one can experience a virtual campus tour with virtual characters animating around buildings and trees. Using a virtual reality headset, one can go through an immersive underwater education experience in the form of a 360 video with objects of interest, such as sea creatures, highlighted and annotated with biological information. What's more, via a combination of CAVE and MR headsets, one could be instantly transported to a 1930s Shanghai nightclub to interact with characters from a classic Chinese modernist novel, gaining a deeper understanding of the literary narrative through immersive storytelling. This course aims at giving an overview of the pipeline and key techniques for authoring such compelling XR educational experiences centered around real-world scene data.

Original language	English
Title of host publication	Proceedings: SIGGRAPH Asia 2025 Courses, SA Courses 2025
Editors	Stephen N. SPENCER
Publisher	Association for Computing Machinery, Inc
Number of pages	3
ISBN (Electronic)	9798400721311
DOIs	https://doi.org/10.1145/3757371.3763256
Publication status	Published - Dec 2025
Externally published	Yes
Event	SA Courses '25: SIGGRAPH Asia 2025 Courses - Hong Kong, Hong Kong, China Duration: 15 Dec 2025 → 18 Dec 2025

Course

Course	SA Courses '25: SIGGRAPH Asia 2025 Courses
Country/Territory	Hong Kong, China
City	Hong Kong
Period	15/12/25 → 18/12/25

Bibliographical note

Publisher Copyright:
© 2025 Copyright held by the owner/author(s).

Funding

This course is supported by the following grants: National Science Foundation (award numbers: 2430673, 2418236 and 1942531); Fund for Innovative Teaching-in-Education, University Grant Council, HKSAR, under the award "Embracing Extended Reality into Marine Education (MarineXR); Marine Conservation Enhancement Fund, under the award "MCEF20107 A new seafloor surveying technique: Using underwater drone and location-aware object recognition for marine conservation"; HKUST TLIP Fund, under the award "Ocean Odyssey: The VR Game Expedition "; as well as donation from the Sin Wai Kin Foundation (Ref. no. 2022/1001).

Keywords

Character animation
mixed reality
scene understanding

Access to Document

10.1145/3757371.3763256

Cite this

@inproceedings{50be9b4a2a05498186778edb03dc1abf,

title = "Creating XR Educational Experiences for the Future: from Arts to Sciences",

abstract = "Recent advances in extended reality (XR) technologies have unlocked the tremendous potential of XR for delivering interactive and immersive education experiences. Such XR experiences generally involve animating virtual characters in real-world scene, driven by scene semantics. For example, via a mixed reality headset, one can experience a virtual campus tour with virtual characters animating around buildings and trees. Using a virtual reality headset, one can go through an immersive underwater education experience in the form of a 360 video with objects of interest, such as sea creatures, highlighted and annotated with biological information. What's more, via a combination of CAVE and MR headsets, one could be instantly transported to a 1930s Shanghai nightclub to interact with characters from a classic Chinese modernist novel, gaining a deeper understanding of the literary narrative through immersive storytelling. This course aims at giving an overview of the pipeline and key techniques for authoring such compelling XR educational experiences centered around real-world scene data.",

keywords = "Character animation, mixed reality, scene understanding",

author = "Lap-Fai YU and Sai-Kit YEUNG and LAI, \{Chi Fu\} and LAM, \{Ka Sin Cindy\}",

note = "Publisher Copyright: {\textcopyright} 2025 Copyright held by the owner/author(s).; SA Courses '25: SIGGRAPH Asia 2025 Courses ; Conference date: 15-12-2025 Through 18-12-2025",

year = "2025",

month = dec,

doi = "10.1145/3757371.3763256",

language = "English",

editor = "SPENCER, \{Stephen N.\}",

booktitle = "Proceedings: SIGGRAPH Asia 2025 Courses, SA Courses 2025",

publisher = "Association for Computing Machinery, Inc",

address = "United States",

}

Creating XR Educational Experiences for the Future: from Arts to Sciences. / YU, Lap-Fai; YEUNG, Sai-Kit; LAI, Chi Fu et al.
Proceedings: SIGGRAPH Asia 2025 Courses, SA Courses 2025. ed. / Stephen N. SPENCER. Association for Computing Machinery, Inc, 2025. 2.

Research output: Book Chapters | Papers in Conference Proceedings › Conference paper (refereed) › Research › peer-review

TY - GEN

T1 - Creating XR Educational Experiences for the Future: from Arts to Sciences

AU - YU, Lap-Fai

AU - YEUNG, Sai-Kit

AU - LAI, Chi Fu

AU - LAM, Ka Sin Cindy

PY - 2025/12

Y1 - 2025/12

N2 - Recent advances in extended reality (XR) technologies have unlocked the tremendous potential of XR for delivering interactive and immersive education experiences. Such XR experiences generally involve animating virtual characters in real-world scene, driven by scene semantics. For example, via a mixed reality headset, one can experience a virtual campus tour with virtual characters animating around buildings and trees. Using a virtual reality headset, one can go through an immersive underwater education experience in the form of a 360 video with objects of interest, such as sea creatures, highlighted and annotated with biological information. What's more, via a combination of CAVE and MR headsets, one could be instantly transported to a 1930s Shanghai nightclub to interact with characters from a classic Chinese modernist novel, gaining a deeper understanding of the literary narrative through immersive storytelling. This course aims at giving an overview of the pipeline and key techniques for authoring such compelling XR educational experiences centered around real-world scene data.

AB - Recent advances in extended reality (XR) technologies have unlocked the tremendous potential of XR for delivering interactive and immersive education experiences. Such XR experiences generally involve animating virtual characters in real-world scene, driven by scene semantics. For example, via a mixed reality headset, one can experience a virtual campus tour with virtual characters animating around buildings and trees. Using a virtual reality headset, one can go through an immersive underwater education experience in the form of a 360 video with objects of interest, such as sea creatures, highlighted and annotated with biological information. What's more, via a combination of CAVE and MR headsets, one could be instantly transported to a 1930s Shanghai nightclub to interact with characters from a classic Chinese modernist novel, gaining a deeper understanding of the literary narrative through immersive storytelling. This course aims at giving an overview of the pipeline and key techniques for authoring such compelling XR educational experiences centered around real-world scene data.

KW - Character animation

KW - mixed reality

KW - scene understanding

UR - https://www.scopus.com/pages/publications/105025100334

U2 - 10.1145/3757371.3763256

DO - 10.1145/3757371.3763256

M3 - Conference paper (refereed)

AN - SCOPUS:105025100334

BT - Proceedings: SIGGRAPH Asia 2025 Courses, SA Courses 2025

A2 - SPENCER, Stephen N.

PB - Association for Computing Machinery, Inc

T2 - SA Courses '25: SIGGRAPH Asia 2025 Courses

Y2 - 15 December 2025 through 18 December 2025

ER -

Creating XR Educational Experiences for the Future: from Arts to Sciences

Abstract

Course

Bibliographical note

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this