MD2G-Cast: Relay-Coordinated Multicast for Scalable Volumetric Streaming over MoQ

Volumetric streaming remains difficult to scale because receivers with overlapping fields of view are often served independently, causing repeated transmission of shared content. We present MD2G-Cast, a relay-coordinated multicast framework over Media over QUIC with an application-aware control layer for scalable multi-user volumetric delivery. MD2G-Cast jointly uses viewing overlap, receiver capability, and bandwidth conditions to form reusable multicast groups, share common Base content, and selectively admit Enhanced delivery. We formulate grouping and Enhanced admission as a sequential control problem, realize it with Proximal Policy Optimization (PPO), and train a compact relay model with teacher guidance for Enhanced admission. We implement MD2G-Cast with real MoQ processes and evaluate it with real access and 6DoF viewing traces for up to 100 users. At 20 and 100 users, MD2G-Cast keeps the receiver-side $P_{99}$ delivery interval below 40 ms across all seven access profiles, while Rolling reaches the 500 ms reporting cap in most cases. Across the evaluated user scales, MD2G-Cast achieves the highest or tied-highest mean system utility under homogeneous access and the highest mean utility under heterogeneous access, while reducing aggregate link load by about 27% relative to Clustering at 100 users. A matched relay-control ablation separates the control structure from its optimizer, showing that random feasible actions reduce utility while deterministic control remains competitive with PPO. Together, the results support relay coordination and selective Enhanced admission, rather than a particular policy optimizer, as the central design contribution.

REPAIR: Robust Editing via Progressive Adaptive Intervention and Reintegration

Post-training for large language models (LLMs) is constrained by the high cost of acquiring new knowledge or correcting errors and by the unintended side effects that frequently arise from retraining. To address these issues, we introduce REPAIR (Robust Editing via Progressive Adaptive Intervention and Reintegration), a lifelong editing framework designed to support precise and low-cost model updates while preserving non-target knowledge. REPAIR mitigates the instability and conflicts of large-scale sequential edits through a closed-loop feedback mechanism coupled with dynamic memory management. Furthermore, by incorporating frequent knowledge fusion and enforcing strong locality guards, REPAIR effectively addresses the shortcomings of traditional distribution-agnostic approaches that often overlook unintended ripple effects. Our experiments demonstrate that REPAIR boosts editing accuracy by 10%-30% across multiple model families and significantly reduces knowledge forgetting. This work introduces a robust framework for developing reliable, scalable, and continually evolving LLMs.

PacTrain: Pruning and Adaptive Sparse Gradient Compression for Efficient Collective Communication in Distributed Deep Learning

Large-scale deep neural networks (DNN) exhibit excellent performance for various tasks. As DNNs and datasets grow, distributed training becomes extremely time-consuming and demands larger clusters. A main bottleneck is the resulting gradient aggregation overhead. While gradient compression and sparse collective communication techniques are commonly employed to alleviate network load, many gradient compression schemes do not achieve acceleration of the training process while also preserving accuracy. This paper introduces PacTrain, a novel framework that accelerates distributed training by combining pruning with sparse gradient compression. Active pruning of the neural network makes the model weights and gradients sparse. By ensuring the global knowledge of the gradient sparsity among all distributed training workers, we can perform lightweight compression communication without harming accuracy. We show that the PacTrain compression scheme achieves a near-optimal compression strategy while remaining compatible with the all-reduce primitive. Experimental evaluations show that PacTrain improves training throughput by 1.25 to 8.72 times compared to state-of-the-art compression-enabled systems for representative vision and language models training tasks under bandwidth-constrained conditions.