Friston, S, Griffith, E, Swapp, D, Lrondi, C, Jjunju, F, Ward, R, Marshall, A and Steed, A (2021) Quality of Service Impact on Edge Physics Simulations for VR. IEEE Transactions on Visualization and Computer Graphics, 27 (5). pp. 2691-2701. ISSN 1077-2626
|
Text
Quality of Service Impact on Edge Physics Simulations for VR.pdf - Accepted Version Download (4MB) | Preview |
Abstract
Mobile HMDs must sacrifice compute performance to achieve ergonomic and power requirements for extended use. Consequently, applications must either reduce rendering and simulation complexity - along with the richness of the experience - or offload complexity to a server. Within the context of edge-computing, a popular way to do this is through render streaming. Render streaming has been demonstrated for desktops and consoles. It has also been explored for HMDs. However, the latency requirements of head tracking make this application much more challenging. While mobile GPUs are not yet as capable as their desktop counterparts, we note that they are becoming more powerful and efficient. With the hard requirements of VR, it is worth continuing to investigate what schemes could optimally balance load, latency and quality. We propose an alternative we call edge-physics: streaming at the scene-graph level from a simulation running on edge-resources, analogous to cluster rendering. Scene streaming is not only straightforward, but compute and bandwidth efficient. The most demanding loops run locally. Jobs that hit the power-wall of mobile CPUs are off-loaded, while improving GPUs are leveraged, maximising compute utilisation. In this paper we create a prototypical implementation and evaluate its potential in terms of fidelity, bandwidth and performance. We show that an effective system which maintains high consistencies on typical edge-links can be easily built, but that some traditional concepts are not applicable, and a better understanding of the perception of motion is required to evaluate such a system comprehensively.
Item Type: | Article |
---|---|
Additional Information: | © 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works |
Uncontrolled Keywords: | 0801 Artificial Intelligence and Image Processing; 0802 Computation Theory and Mathematics; Software Engineering; Streaming media; Physics; Bandwidth; Quality of service; Servers; Visualization; Rendering (computer graphics); virtual reality; streaming; edge-computing; 0801 Artificial Intelligence and Image Processing; 0802 Computation Theory and Mathematics; Software Engineering |
Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science |
Divisions: | Computer Science and Mathematics |
Publisher: | Institute of Electrical and Electronics Engineers (IEEE) |
SWORD Depositor: | A Symplectic |
Date Deposited: | 18 Oct 2024 11:05 |
Last Modified: | 18 Oct 2024 11:05 |
DOI or ID number: | 10.1109/TVCG.2021.3067757 |
URI: | https://researchonline.ljmu.ac.uk/id/eprint/24555 |
View Item |