Training-Free Adaptive 360-degree Video Streaming via Semantic Potential Fields
Listen
Radio episode about this paper
Transcript
Introduction to the show: ident: Computer Science. The day in computer science: software, systems and theory on arXiv.
Tom: We're looking at the paper: "Training-Free Adaptive 360-degree Video Streaming via Semantic Potential Fields".
Jane: Here's the gist of the paper. Adaptive 360° video streaming for teleoperation faces two coupled challenges: viewport prediction under uncertain gaze patterns and bitrate adaptation over fluctuating wireless channels While Deep Reinforcement Learning (DRL) methods achieve high Quality of Experience (QoE), their lack of interpretability and dependence on offline training limit deployment in safety-critical systems.
Tom: We propose OrbitStream, a training-free framework that formulates viewport prediction as a Gravitational Viewport Prediction (GVP) problem, where semantic objects generate potential fields that attract operator gaze, and employs a Saturation-Based Proportional-Derivative (PD) Controller for buffer regulation.
Jane: On object-rich teleoperation traces, OrbitStream achieves 94.7% zero-shot viewport prediction accuracy without user-specific profiling, approaching trajectory-extrapolation baselines (∼98.5%).
Tom: Pruning redundant reasoning tokens The primary contributions of the proposed framework are threefold.
Paper summary: Tom: So we're looking at this paper titled "Training-Free Adaptive three hundred sixty-degree Video Streaming via Semantic Potential Fields <ref:2603.20999#pg1,Video Streaming via Semantic Potential Fields>." The main thing they're claiming is that they solved the two big problems of adaptive streaming for teleoperation: predicting where the operator is looking when things are uncertain, and adjusting the video bitrate over changing wireless channels.
Jane: That sounds complicated to put into simple terms. So, what exactly is this paper proposing as a solution to those two coupled challenges?
Tom: Well, they propose a training-free framework called OrbitStream. It formulates viewport prediction as something called Gravitational Viewport Prediction or GVP. Think of it like this: the semantic objects in the scene generate potential fields that attract the operator's gaze.
Lu: That's an interesting way to frame it because it treats visual attention like a test particle on a sphere, and each object creates a potential well based on its mass and position—that's what they call U theta phi >
Meng: Okay, so instead of training some massive deep reinforcement learning model offline, you use these physics-inspired fields to figure out where the operator is looking? That sounds ambitious for deployment.
Jane: It really does sound like a departure from those DRL methods that people usually use for this stuff because DRL models are hard to understand and need tons of training data before they can run safely.
Tom: Exactly, and the paper claims that on these object-rich teleoperation traces, OrbitStream gets ninety-four point seven percent accuracy in predicting the viewport without needing any user-specific profiling.
Lalam: It also approaches those trajectory extrapolation baselines of about ninety-eight point five percent accuracy >
Tom: And they didn't need to train anything specific to a user; it works out of the box for new environments, which is a big deal for deployment.
Meng: But what about the bitrate adaptation part? If we don't use DRL, how does this system handle fluctuating wireless channels and keep the buffer stable? That's where things usually break at scale.
Jane: That’s a crucial point because the paper says they employ a Saturation-Based Proportional-Derivative controller for buffer regulation. It targets a reference buffer of four point zero seconds, or Bref equals four point zero seconds >
Lu: The stability part relies on Lyapunov analysis, which shows that under certain conditions with the saturation nonlinearity, the buffer will stay bounded near that reference value >
Tom: And they also showed that this approach concentrates the bitrate on safety-critical objects because of how GVP drives that allocation, which is different from other methods like BOLA-E.
Meng: Okay, so it's not just about getting a high Quality of Experience score—the paper actually shows ORBITSTREAM ranks second out of twelve algorithms in their empirical evaluation with a mean Quality of Experience score of two point seven one >
Paper summary: Jane: That’s good context because it shows that even though it might not be the absolute best, it’s still performing well compared to established methods like BOLA-E, which got a score of two point eight zero >
Tom: The paper also mentions its decision latency is one point zero one milliseconds on average across their simulations >
Meng: one point zero one milliseconds sounds pretty fast, but I'm wondering what the authors admit about the limitations? Where does this thing fail when things get messy in real-world scenarios?
Jane: They do acknowledge a few things. One limitation they mention is that it still relies on the accuracy of an upstream object detector, and if those detectors make errors because objects are occluded or out of distribution, the whole system degrades >
Lu: And another thing is that their static semantic mass hierarchy doesn't automatically adapt to different operator behaviors where someone might prioritize certain scene elements differently >
Tom: So it’s not a perfect system out there. The paper shows that this physics-based control can operate within soft real-time margins, but it stops working when the input perception isn't perfect or when the operator's priorities shift drastically >
Meng: It makes sense that. If you deploy this in a real teleoperation setup, you still need a robust way to handle those detection errors because the core of this method is built on those object fields >
Jane: So, what does this mean for us? It means we have an interpretable, physics-based control system that doesn't need endless training data to work in a new place, which is huge for getting new applications running quickly >
Tom: It gives engineers a traceable decision logic based on closed-form equations rather than a black box learned policy, which is what makes it useful for safety-critical systems where you need auditability >
Lu: I think the real implication here is showing that physics-inspired modeling can replace some of the heavy learning components in control loops without sacrificing stability or quality >
Meng: For production, I'm still thinking about running this at scale. If we have millions of streams, how much computational overhead does this GVP calculation add compared to just using a simple throughput measurement?
Jane: That’s a practical question for scaling. The paper doesn't give us the raw cost details, but it does show that the decision latency is manageable within a thirty millisecond frame budget at thirty frames per second >
Tom: Exactly. So, to wrap up on this paper, "Training-Free Adaptive three hundred sixty-degree Video Streaming via Semantic Potential Fields," it’s a training-free approach using physics to predict gaze and control bitrate, achieving ninety-four point seven percent zero-shot accuracy and ranking second among twelve algorithms with a two point seven one Quality of Experience score > <ref:2603.20999#pg1,Video Streaming via Semantic Potential Fields>
Jane: It’s an interesting piece of work because it shows that we can get high performance by focusing on modeling the physical dynamics of attention rather than just learning complex patterns from data, which is a different path for AI applications in this space >
Conclusion: Tom: So we've seen how this paper, "Training-Free Adaptive three hundred sixty-degree Video Streaming via Semantic Potential Fields," tackles two big streaming headaches: guessing where the operator is looking and adjusting the video quality over changing wireless signals.
Jane: It sounds like they’re trying to solve those problems without needing a massive amount of training data for a deep learning model.
Lu: Exactly, it's proposing this training-free framework that uses physics—specifically gravity and potential fields—to figure out the gaze prediction and the bitrate control.
Meng: So, instead of feeding millions of hours of video to some reinforcement learning algorithm, they use mathematical rules based on how objects in the scene attract the operator’s attention.
Tom: Right, and they claim this works really well—they got ninety-four point seven percent accuracy on predicting where the operator is looking without any user-specific training or profiling.
Jane: That's a huge number because it means you can deploy this system out of the box for many different people just by using the scene itself.
Lalam: And they also showed that this method ranks second among twelve different algorithms in their testing, achieving a quality of experience score of two point seven one.
Meng: two point seven one against BOLA-E’s two point eight zero, which is pretty close to being the best performer out there.
Tom: But here’s the catch—the paper flags that this system still relies on how good the initial object detection is; if those detectors make mistakes on occluded objects, the whole prediction degrades.
Jane: And they also mention that since their "mass" for each object is fixed, it doesn't automatically adapt if an operator suddenly starts prioritizing one area over another in a new scene.
Lu: That’s true; the authors admit that their static model of object weights doesn't account for those dynamic, personalized operator behaviors yet.
Tom: So the implication is that we have interpretable control logic based on physics, which means engineers can actually audit how the system makes decisions without having to understand a black box policy.
Jane: It shows that modeling attention as particle dynamics can give us a path forward for making these systems more transparent and reliable in safety-critical applications.
Lu: The future work they mentioned is learning those semantic mass weights online from operator corrections, which would let the system adapt to individual preferences over time.
Aizierjiang Aiersilan, Zhangfei Yang
George Washington University
cs.NI, cs.CV, cs.MM, cs.RO, eess.IV
Submitted: 2026-03-22
Updated: 2026-05-01
Comments: We are pleased to announce that this paper has been accepted by the 35th International Conference on Computer Communications and Networks (ICCCN 2026). We appreciate the valuable feedback from the reviewers and look forward to sharing our findings with the community
Journal ref: The 35th International Conference on Computer Communications and Networks (ICCCN 2026), Honolulu, Hawaii, USA, 2026
Code: https://github.com/zhangfeiy/Streaming360Video
License: http://creativecommons.org/licenses/by/4.0/
Importance score: 82/100
The gist: Adaptive 360° video streaming for teleoperation faces two coupled challenges: viewport prediction under uncertain gaze patterns and bitrate adaptation over fluctuating wireless channels While Deep…
Key concepts
- Gravitational Viewport Prediction (GVP)
- This treats the operator's gaze as a test particle moving on a sphere. Semantic objects in the scene act like masses, creating gravitational potential wells that attract the operator's attention toward them. The probability of looking at an area depends on this calculated potential field, allowing for prediction without prior learning.
- Saturation-Based PD Controller
- This is the mechanism used to regulate the video bitrate. It uses a proportional-derivative controller with a saturation nonlinearity to keep the buffer size stable around a target value. This control law ensures that the bitrate adjustment is bounded and prevents excessive fluctuations in data flow, maintaining system stability.
- Training-Free Framework
- Unlike Deep Reinforcement Learning (DRL), which requires extensive offline training, OrbitStream relies on closed-form equations and fixed logic. The decision-making process does not involve learning parameters from trial and error during deployment. This makes the system inherently more interpretable and suitable for safety-critical applications.
- Semantic Potential Fields
- These are mathematical fields generated by objects in the video scene, where each object has a mass and position. These fields define an attention potential function U(θ, ϕ). The operator's viewing probability is then determined by how this total potential field influences the likelihood of looking at a specific point on the viewing sphere.
Terminology
Summary
Adaptive 360° video streaming for teleoperation faces two coupled challenges: viewport prediction under uncertain gaze patterns and bitrate adaptation over fluctuating wireless channels While Deep Reinforcement Learning (DRL) methods achieve high Quality of Experience (QoE), their lack of interpretability and dependence on offline training limit deployment in safety-critical systems. p. 0 Training-Free Adaptive 360° Video Streaming via
Semantic Potential Fields
Aizierjiang Aiersilan∗ Zhangfei Yang
The George Washington University
Abstract—Adaptive 360° video streaming for teleoperation
faces two coupled challenges: viewport prediction under uncertain gaze patterns and bitrate adaptation over fluctuating
wireless channels. While Deep Reinforcement Learning (DRL)
methods achieve high Quality of Experience (QoE), their lack
of interpretability and dependence on offline training limit
deployment in safety-critical systems. While Deep Reinforcement Learning (DRL)
methods achieve high Quality of Experience (QoE), their lack
of interpretability and dependence on offline training limit
deployment in safety-critical systems. We propose OrbitStream,
a training-free framework that formulates viewport prediction
as a Gravitational Viewport Prediction (GVP) problem, where
semantic objects generate potential fields that attract operator
gaze, and employs a Saturation-Based Proportional-Derivative
(PD) Controller for buffer regulation. We propose OrbitStream,
a training-free framework that formulates viewport prediction
as a Gravitational Viewport Prediction (GVP) problem, where
semantic objects generate potential fields that attract operator
gaze, and employs a Saturation-Based Proportional-Derivative
(PD) Controller for buffer regulation. On object-rich teleoperation traces, OrbitStream achieves 94. On object-rich teleoperation traces, OrbitStream achieves 94. 7% zero-shot viewport
prediction accuracy without user-specific profiling, approaching
trajectory-extrapolation baselines (∼98.Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Pruning redundant reasoning tokens
The primary contributions of the proposed framework are threefold. These contributions include:
-
Physics-Inspired Attention Modeling, which formulates GVP as particle dynamics governed by semantic potential fields.
-
Lyapunov-Informed Buffer Control, utilizing an adaptive PD controller with bounded saturation nonlinearity for buffer trajectory stability.
-
Empirical Evaluation, demonstrating that ORBITSTREAM ranks second among 12 algorithms (QoE 2.71 vs. BOLA-E’s 2. p. 0
80) while offering three capabilities that BOLA-E lacks. p. 1Where the paper says it
Across 3,600 Monte Carlo simulations, it ranks second among 12 algorithms (QoE 2. BOLA-E’s 2.
Where the paper says it
BOLA-E’s 2. 80), while offering three capabilities that BOLA-E lacks: (a) semantic viewport prediction that prioritizes tiles around safety-critical objects, (b) zero training overhead for deployment in new environments, and (c) interpretable decision logic traceable to closed-form equations.
How the training signal is built
The framework is described as ORBITSTREAM uses Gravitational
Viewport Prediction (GVP), where detected semantic objects
generate potential fields that attract operator gaze, and a
Saturation-Based PD Controller for buffer regulation. Here,
“training-free” refers to the decision and control logic:
whereas DRL requires offline policy learning, OrbitStream’s
viewport prediction and rate adaptation rely on closed-form
equations with no learned parameters. The upstream object
detector (YOLOv5 [13]) is a pre-trained perception module
and, like any trained neural network, is susceptible to outof-distribution inputs; objects absent from its training set
may go undetected. However, the downstream control layer
degrades gracefully under detection errors, as quantified in
Section VII-C.training-free
because the decision and control logic rely on closed-form equations with no learned parameters, unlike DRL which requires offline policy learning. Specifically, the viewport prediction and rate adaptation rely on these closed-form equations rather than learned parameters. p. 0Where the paper says it
Where the paper says it
Where the gains come from
The core of the viewport prediction is Gravitational Viewport Prediction (GVP), which treats visual attention as a test particle on the unit sphere S2 under forces generated by semantic objects. Each object Ol with mass Ml at (θl, ϕl) creates a potential well, and the total attention potential is defined by U(θ, ϕ). p. 1 The GVP model treats visual
attention as a test particle on the unit sphere S
2 under forces
generated by semantic objects, drawing on biological visual
foraging models [32]. Each object Oℓ with mass Mℓ at (θℓ, ϕℓ)
creates a potential well; the total attention potential is:
U(θ, ϕ) = −G
X
L
ℓ=1
Mℓ
d(θ, ϕ, θℓ, ϕℓ) + δ
(3)
where G=1. Viewing Probability and Gaze Dynamics. Tile viewing probability follows a Boltzmann distribution [34]:
Pk = exp(−βUk)/
P
j
exp(−βUj ), with inverse temperature
β=1/Tatt (Tatt=2.Where the paper says it
Where the paper says it
Control and Stability Mechanisms
The bitrate regulation is managed by a Saturation-Based Proportional-Derivative (PD) Controller. The control law targets buffer Bref = 4. p. 2 PD CONTROLLER WITH TANH SATURATION
Control Law. The rate controller targets buffer Bref = 4. 6Kcr,
Kd = KpTcr/8). The signal is mapped to a bounded rate via
hyperbolic tangent saturation:
R
∗
(t) = Cˆ(t) · (1 + tanh(u(t))) · ρ (8)
with safety margin ρ=0. Lyapunov analysis [37] with candidate V (e) =
1
2
e
2 yields V˙ = e(t)
C(t)/R(t) − 1
. Under buffer deficit
(e<0), the saturation map yields R(t) < Cˆ(t) · ρ ≤ C(t)
(since ρ=0.Where the paper says it
Where the paper says it
Where the paper says it
Performance and Comparison
Across 3,600 Monte Carlo simulations, ORBITSTREAM achieved a mean QoE of 2.71 (second among 12 algorithms). p. 0 7% zero-shot viewport
prediction accuracy without user-specific profiling, approaching
trajectory-extrapolation baselines (∼98. Across 3,600 Monte
Carlo simulations, it ranks second among 12 algorithms (QoE
2. Across 3,600 Monte Carlo simulations, ORBITSTREAM achieves a mean QoE of 2. 71 (second
among 12 algorithms), buffer stability with σB=0. Potentialfield evaluation scales as O(L · N · M) for L objects and
N×M tiles; for typical scenes (L≈8, 32 tiles), this amounts to
roughly 256 evaluations per step. Distance and potential arrays
are vectorized via BLAS/LAPACK backends, and haversine
computations are batched over the tile grid, yielding an average
decision latency of 1. 71), it operates solely on buffer occupancy and has no
notion of scene content. In teleoperation, this distinction is
consequential: BOLA-E allocates equal quality across all tiles
regardless of whether a pedestrian or empty sky occupies a
given region, whereas ORBITSTREAM concentrates bitrate on
safety-critical objects via GVP-driven allocation.Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Conclusion and Limitations
ORBITSTREAM demonstrates that interpretable, physics-based control can operate within soft real-time margins while maintaining competitive quality and stability for teleoperation systems where transparency and auditability are essential. However, limitations include the reliance on upstream object detection accuracy, which causes degradation when objects are occluded or out-of-distribution. p. 0 The upstream object
detector (YOLOv5 [13]) is a pre-trained perception module
and, like any trained neural network, is susceptible to outof-distribution inputs; objects absent from its training set
may go undetected. However, the downstream control layer
degrades gracefully under detection errors, as quantified in
Section VII-C. Second, the framework depends on upstream object detection
accuracy; detection failures due to occlusion, poor lighting, or
out-of-distribution objects propagate into the control loop and
degrade viewport prediction, as quantified in Section VII-C. Third, the static semantic mass hierarchy does not adapt to
operator-specific behaviors that may prioritize different scene
elements. 00
Note: Values averaged per run, then aggregated across 300 runs. of magnitude higher than the simplest baselines, it remains
well within the 33 ms frame budget at 30 fps and below typical
wireless round-trip times (20–50 ms).Where the paper says it
Where the paper says it
Where the paper says it
References
[1] T. S. Rappaport, S. p. 5 REFERENCES
[1] T. Rappaport, S.Where the paper says it
[2] S Dang, O Amin B Shihada and M-S Alouini
[3] S Neumeier P Wintersberger A-K Frison A Becher C Facchi and A Riener
[4] J Marescaux J Leroy M Gagner F Rubino D Mutter M Vix S Butner and M K Smith
[5] P F Hokayem and M W Spong
[6] M R Endsley
[7] M Seufert S Egger M Slanina T Zinner T Hoßfeld and P Tran-Gia
[8] F Qian L Ji B Han and V Gopalakrishnan
[9] X Corbillon G Simon A Devlic and J Chakareski
[10] D V Nguyen H T Tran A T Pham and T C Thang
[11] W Feng S Wang and Y Dai
[12] C-L Fan J Lee W-C Lo C-Y Huang K-T Chen and C-H Hsu
[13] G Jocher A Chaurasia A Stoken J Borovec Y Kwon K Michael J Fang Z Yifu C Wong D Montes et al
[14] T-Y Huang R Johari N McKeown M Trunnell and M Watson
[15] K Spiteri R Urgaonkar and R K Sitaraman
[16] L Xie Z Xu Y Ban X Zhang and Z Guo
[17] S Petrangeli V Swaminathan M Hosseini and F De Turck
[18] X Yin A Jindal V Sekar and B Sinopoli
[19] X Yin V Sekar and B Sinopoli
[20] H Mao R Netravali and M Alizadeh
[21] F Y Yan H Ayers C Zhu S Fouladi J Hong K Zhang P Levis and K Winstein
[22] R K Mok X Luo E W Chan and R K Chang
[23] F Qian B Han Q Xiao and V Gopalakrishnan
[24] Y Guan C Zheng X Zhang Z Guo and J Jiang
[25] Y Zhu G Zhai and X Min
[26] C Kattadige K Thilakarathna
[27] J Park M Wu K-Y Lee B Chen K Nahrstedt M Zink and R Sitaraman
[28] Y Tian Y Zhong Y Han and F Chen
[29] C Ozcinar A De Abreu and A Smolic
[30] J Redmon S Divvala R Girshick and A Farhadi
[31] G J Sullivan J-R Ohm W-J Han and T Wiegand
[32] S Potier O Duriez G B Cunningham V Bonhomme C O’rourke E Fernandez-Juricic and F Bonadonna
[33] R W Sinnott
[34] D C Montgomery G C Runger
[35] K H Ang G Chong and Y Li
[36] J G Ziegler N B Nichols
[37] H K Khalil J W Grizzle
[38] Y Xu Y Dong J Wu Z Sun Z Shi J Yu and S Gao
[39] C Wu Z Tan Z Wang and S Yang
Table III
TABLE III PERFORMANCE SUMMARY ACROSS 12 ALGORITHMS (300 MONTE CARLO RUNS PER ALGORITHM, RAW QOE)
Algorithm QoE (Raw) Eqv. Bitrate Mean Buffer Decision Time (Mean ± Std) (Mbps) (s) (ms)
BOLA-E 2.80 ± 0.25 37.49 5.42 0.006
OrbitStream 2.71 ± 0.31 31.52 5.85 1.010
FastMPC 1.84 ± 0.49 26.61 5.73 0.019
MPC-HM 1.67 ± 0.48 22.92 9.13 0.030
Robust-MPC 1.65 ± 0.60 17.11 7.31 0.033
Fugu 1.42 ± 0.47 20.94 7.51 0.011
Pano 1.28 ± 0.42 8.48 9.67 0.033
MPC 1.20 ± 0.49 13.40 9.10 0.013
Buffer-Based 1.01 ± 0.22 4.69 9.78 5
Pensieve 0.97 ± 0.52 13.72 9
Rate-Based 0.92 ± 0.54 7.58 1
FLARE 0.83 ± 0.45 11
Table II
TABLE II BUFFER STABILITY AND SWITCHING DYNAMICS (300 MONTE CARLO RUNS PER ALGORITHM)
Algorithm Mean Buf. (s) Std Dev (s) Min Buf. p. 4 Algorithm Mean Buf. (s) Std Dev (s) Min Buf.Where the paper says it
Buffer-Based 9.78 0.82 5.45 2
Rate-Based 9.72 0.99 4
Pano 11
FLARE 1
Conclusion
ORBITSTREAM achieves a mean QoE of 2.71 (second among 12 algorithms), buffer stability with σB=0. p. 4 Across 3,600 Monte Carlo simulations, ORBITSTREAM achieves a mean QoE of 2. 71 (second
among 12 algorithms), buffer stability with σB=0. On object-rich teleoperation traces, OrbitStream achieves 94. 7% zero-shot viewport
prediction accuracy without user-specific profiling, approaching
trajectory-extrapolation baselines (∼98. 84), with
1. 01 ms decision latency and minimal rebuffering. 01 ms decision
latency. These results demonstrate that interpretable, physicsbased control can operate within soft real-time margins while
maintaining competitive quality and stability for teleoperation
systems where transparency and auditability are essential. Second, the framework depends on upstream object detection
accuracy; detection failures due to occlusion, poor lighting, or
out-of-distribution objects propagate into the control loop and
degrade viewport prediction, as quantified in Section VII-C. Third, the static semantic mass hierarchy does not adapt to
operator-specific behaviors that may prioritize different scene
elements. Third, the static semantic mass hierarchy does not adapt to
operator-specific behaviors that may prioritize different scene
elements. Future work will address these gaps by (1) learning semantic
mass weights online from operator corrections, (2) stresstesting the pipeline under severe detector degradation, and
(3) formulating the stability guarantees in a sampled-dataWhere the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.
Improvements for AI systems
-
Semantic Viewport Prediction via Gravitational Viewport Prediction (GVP) allows systems to anticipate operator gaze by formulating it as
particle dynamics governed by semantic potential fields,
which enables anticipation without crowd-sourced viewing statistics or DRL training. -
Buffer Regulation using a Saturation-Based Proportional-Derivative (PD) Controller with tanh saturation for rate allocation ensures buffer trajectory stability, as the control law is mapped to a bounded rate via
R∗(t) = Cˆ(t) · (1 + tanh(u))ρ.
-
Training-free deployment capability means the decision and control logic relies on
closed-form equations with no learned parameters,
allowing systems to generalize to new environments without policy retraining, while the upstream perception module is only susceptible tooutof-distribution inputs.
-
Bitrate Allocation sharpens concentration around important content by using a concentration parameter alpha greater than 1, as described by the allocation formula Rk = R∗ · Pαk / Pj Pαj.
-
The system can achieve high Quality of Experience (QoE) through a linear model that penalizes stalls, bitrate switching, and viewport misprediction using calibrated weights such as µ=10 for stalls and ν=5 for viewport misprediction penalties.
Abstract
Adaptive 360° video streaming for teleoperation faces two coupled challenges: viewport prediction under uncertain gaze patterns and bitrate adaptation over fluctuating wireless channels. While Deep Reinforcement Learning (DRL) methods achieve high Quality of Experience (QoE), their lack of interpretability and dependence on offline training limit deployment in safety-critical systems. We propose OrbitStream, a training-free framework that formulates viewport prediction as a Gravitational Viewport Prediction (GVP) problem, where semantic objects generate potential fields that attract operator gaze, and employs a Saturation-Based Proportional-Derivative (PD) Controller for buffer regulation. On object-rich teleoperation traces, OrbitStream achieves 94.7% zero-shot viewport prediction accuracy without user-specific profiling, approaching trajectory-extrapolation baselines (98.5%). Across 3,600 Monte Carlo simulations, it ranks second among 12 algorithms (QoE 2.71 vs. BOLA-E's 2.80), outperforming FastMPC (1.84), with 1.01 ms decision latency and minimal rebuffering.
Sources
Related papers
- Predicting Networks Before They Happen: Experimentation on a Real-Time V2X Digital Twin
- MultiMoQ: Multi-Access Media-Over-QUIC for Robust Immersive Video Streaming
- HiFiNet: Hierarchical Fault Identification in Wireless Sensor Networks via Edge-Based Classification and Graph Aggregation
- Flux: Optimal Scheduling of Optical Circuit Switches for LLM Training
- Tutorial on Closed-Loop and Application-Aware Digital Twins for Future Wireless Networks
- Claude Code Complete User Handbook