Interactive Media · 2022
Xiaoyaoyou
逍遥游
Zhuang Zhou’s Dream · A Multi-Sensor Mechanical Installation
A multi-sensor mechanical installation combining the landscape of A Thousand Li of Rivers and Mountains with the mythic Kun to explore reality, illusion, and embodied spectatorship.
Archived project · Interactive installation
逍遥游Xiaoyaoyou · Zhuang Zhou’s Dream
作品 / Experience
《逍遥游》是一件多传感交互机械装置。作品将《千里江山图》的青绿山水与“鲲”的神话意象并置，借由可移动的山峰、云气、机械鲲与投影阴影，讨论庄周梦蝶式的真实与虚幻。
观众以毛笔、触摸和身体距离介入装置。山水不再是静止画卷，而成为会回应人的机械场景；真实构件和投射影像在同一幅长卷中互相穿越。
Artwork / Experience
Xiaoyaoyou is a multi-sensor mechanical installation that brings the blue-green landscape of A Thousand Li of Rivers and Mountains together with the mythic Kun. Moving peaks, clouds, mechanical fish, and projected shadows explore the ambiguity between reality and illusion associated with Zhuang Zhou’s butterfly dream.
The audience enters through brush, touch, and bodily distance. Landscape is no longer a static scroll but a responsive mechanical scene in which physical components and projected images pass through one another.
Concept
庄周·梦Zhuang Zhou’s Dream
昔者庄周梦为胡蝶，栩栩然胡蝶也。
《庄子·齐物论》 · Zhuangzi, Discussion on Making All Things Equal
现实与虚幻
作品把长卷视为现实与梦境之间的界面：山峰在轨道上平移，云气沿画面游走，鲲从实体机械转化为墙面的光影。观众看到的每一次变化，都同时包含物理运动与视觉幻象。
Reality and illusion
The scroll becomes an interface between waking space and dream. Mountain peaks translate along tracks, clouds travel across the composition, and the Kun shifts from a mechanical body into light and shadow on the wall. Every change combines physical motion with visual illusion.
Research question
触景生境How can a scroll become a responsive environment?
从观看到介入
当传统长卷被转化为可触发、可移动的空间，观众如何在物理机械与数字投影之间建立连续的观看经验？作品以低门槛的身体动作取代屏幕按钮，使触碰、靠近和移动成为叙事的接口。
From looking to entering
When a traditional scroll becomes a triggerable and mobile environment, how might a viewer form a continuous experience across physical mechanisms and digital projection? The work replaces on-screen buttons with simple bodily actions, making touch, proximity, and movement the interface of the narrative.
硬件构思Hardware conception
山、云与鲲
九座山峰沿画面平移，一组云气结构在长卷中移动，三只机械鲲分别旋转。毛笔上的接触传感器控制山峰；两组超声波传感器感知观众距离并控制鲲与云的运动。
定向光源把机械结构的影子投向卷面，使看得见的实体与无法触碰的投影共同参与构图。
Mountains, cloud, and Kun
Nine mountain peaks translate across the composition, one cloud structure travels along the scroll, and three mechanical Kun rotate. A contact sensor attached to the brush controls the mountains, while two ultrasonic sensors read viewer distance to control the fish and cloud.
Directional lights cast the mechanisms’ shadows onto the scroll, allowing tangible bodies and untouchable projections to share the same composition.
软件构思Software conception
交互流程
Unity 界面负责组织交互状态，Raspberry Pi 接收传感器信号并与运动控制端通信。测试阶段分别记录了毛笔接触、超声波距离与机械反馈之间的对应关系，再将独立动作合并为完整场景。
Interaction workflow
A Unity interface organized the interaction states, while a Raspberry Pi received sensor input and communicated with the motion-control system. Brush contact, ultrasonic distance, and mechanical feedback were tested separately before the actions were assembled into the complete scene.