Citation

Malinverni, Eva Savina and R., Rajesh Sharma and Sungheetha, Akey (2026) Haptic-Enhanced Virtual Museum Experience System: Multi-Modal Interaction Framework for Cultural Heritage Preservation. In: 8th International Conference on Futuristic Trends in Networks and Computing Technologies, FTNCT 08, 18 December 2025 - 20 December 2025, Ghaziabad.

Text 4.pdf - Published Version Restricted to Repository staff only Download (429kB)

Abstract

This paper presents a haptic-enhanced virtual museum framework integrating Neural Radiance Field (NeRF) reconstruction with Proximal Policy Optimisation (PPO)-based adaptive interaction. The proposed system encodes cultural artefacts from sparse photographic collections (N=180 images per artefact) through a volumetric NeRF network FΘ:(x, d)→(σ, c) achieving peak signal-to-noise ratio of 34.7 dB and structural similarity index of 0.967. Haptic force feedback is modelled as Fhaptic(t) = −kpdpen(t) − kdd˙ pen(t) + Ff riction(t), coupling stiffness and damping parameters to reconstructed surface geometry with kp=850 N/m and kd=12 Ns/m. An RL policy network with 256-dimensional state encoding and 128-dimensional shared encoder processes behavioural features through a PPO algorithm with clip range ϵ=0.2, discount factor γ=0.95, and generalised advantage estimation parameter λ=0.97. Training over 12,000 simulated episodes yields reward convergence from 47 to 124 points, a 164% improvement. User engagement duration increases from 85 seconds to 112 seconds per artefact (31.7% gain), while quiz-assessed learning accuracy rises from 0.73 to 0.94 (28.4% improvement). Comparative evaluation shows the proposed PPO method surpasses static rule-based (reward 38) and tabular Q-learning (reward 61) baselines by 226% and 103%, respectively, at 36 GPU-hours. The framework operates entirely within a theoretical computing environment, processing all metrics through mathematical simulation.

Item Type:	Conference or Workshop Item (Paper)
Uncontrolled Keywords:	Multi-Modal Systems, Immersive Technology, Artifact Preservation
Subjects:	Q Science > QA Mathematics > QA71-90 Instruments and machines > QA75.5-76.95 Electronic computers. Computer science
Divisions:	Faculty of Information Science and Technology (FIST)
Depositing User:	Ms Rosnani Abd Wahab
Date Deposited:	04 Sep 2026 02:50
Last Modified:	04 Sep 2026 02:50
URII:	http://shdl.mmu.edu.my/id/eprint/16689

Downloads

Edit (login required)