By using 3D scanning to digitize household items and scenes, a digital replica of the home was created based on the Unity engine. Each scene and item, marked by significant traces of life, includes descriptions of family members’ memories associated with them. Through an immersive interactive installation, a surreal familial memory space was created, allowing viewers to interact with the author’s family memories by touching the projected images. This multi-sensory presentation offers the audience an immersive experience of the author’s family memories. The project aims to back up family memories to the cloud, providing a new possibility for preserving family memories in the future.
In this project, the SLAM LiDAR A2M8 was used as a sensor, and the collected data was converted into screen coordinate data using InteractiveEngine software. This data was then transmitted to Unity via the TUIO protocol. Due to issues such as poor lighting and narrow passageways in environments like my grandmother’s house, the point cloud scanning was conducted using Luma.AI’s NeRF-based scanning method. After exporting the point cloud files, the data was cleaned using the Point Cloud Visualizer plugin in Blender. In Unity, the VFX Graph was used to visualize the point cloud and create particle effects. Colliders were placed and hidden in each scene, and C# scripts was written to convert screen space points into three-dimensional points using raycasting. Touch effects were then generated at these points, influencing the point cloud.
