Deep Reinforcement Learning Orchestration of Game-Theoretic User Association and Resource Allocation in HetNets

Managing dynamic User Association and Resource Allocation (UARA) in modern Heterogeneous Cellular Networks (HetNets) remains a critical open challenge. Existing mathematical optimization and Reinforcement Learning approaches face limitations in handling low-latency decision-making under dynamic traffic conditions. This paper introduces a novel orchestration scheme for game-theoretic UARA in HetNets. The proposed bilevel framework distributes UARA decisions to User Equipment through a multi-objective non-cooperative game. Overlaying the distributed game, a centralized Deep Reinforcement Learning controller orchestrates network performance by dynamically configuring the game's utility parameters, enabling transitions between power awareness, coverage enhancement, and balanced operation. Evaluated on urban HetNet topologies with 3GPP TR 38.901-compliant channel modeling, the proposed framework closely approximates the optimal policy for the considered operational objectives, while delivering higher network throughput than conventional association methods. Furthermore, it incurs low computational overhead and maintains stable performance across the evaluated traffic densities without retraining.

SCROOGE: A Physics-Aware Framework for Efficient Orchestration of RIS-Assisted Networks

Reconfigurable Intelligent Surfaces (RISs) are emerging as a key enabler of Programmable Wireless Environments for 6G, but their practical integration into operational networks still lacks orchestration mechanisms that can jointly support resource allocation, energy efficiency, and admission control with low online complexity. This paper presents SCROOGE, a physics-aware orchestration framework for multi-user RIS-assisted networks that operates on information generated offline during RIS codebook compilation, namely optimal codebook entries and per-element influence scores. Rather than relying on online optimization or idealized fading-based abstractions, SCROOGE exploits physics-derived descriptors to support low-latency operating-phase decisions that remain compatible with network-level control requirements. Specifically, SCROOGE introduces: i) an influence-aware, tier-consistent resource-allocation mechanism that combines user priority and element importance in the construction of a common RIS configuration; ii) an energy-efficiency mechanism that deactivates globally low-influence elements; and iii) an admission-control mechanism that accepts or rejects candidate users based on tier-aware compatibility with the currently deployed RIS state.