Abstract:Severe signal blockage and fast-varying channels in vehicular environments pose critical challenges to reliable semantic communication. To address these, this paper proposes a novel Row-Movable Active Reconfigurable Intelligent Surface (RM-A-RIS) assisted vehicular semantic communication system. This architecture uniquely combines active signal amplification with element mobility to compensate for multiplicative fading and reconstruct channel geometry, thereby enhancing spatial diversity. We formulate a joint optimization problem to maximize Semantic Spectral Efficiency (SSE) by coordinating RIS element positions, active reflection coefficients, and semantic symbol length. An efficient Alternating Optimization (AO) algorithm is developed to tackle the coupled non-convexity. Simulation results demonstrate that the proposed scheme substantially outperforms existing benchmarks, achieving up to 132.9%, 9.2%, and 35.2% improvements in Sum-Semantic Spectral Efficiency (Sum-SSE) compared to the passive RIS, fixed-position active RIS, and QPSO baselines, respectively.
Abstract:This paper proposes a target-mounted intelligent reflecting surface (IRS)-assisted integrated sensing and communication framework for real-time unmanned aerial vehicle (UAV) tracking, addressing challenges such as link blockage and weak radar cross section in the low-altitude economy. By integrating the IRS onto the UAV, the system creates a mobile cooperative target that provides controllable line-of-sight echoes for self-tracking while acting as a mobile relay for ground communication enhancement. We establish a comprehensive three dimensions state evolution model for the maneuvering UAV. Based on this model, an extended Kalman filter is immediately implemented to achieve real time tracking of the moving UAV. To characterize the fundamental theoretical limits of this recursive estimation process, we derive the analytical posterior Cramer Rao bound and a closed form expression for the elliptical tradeoff performance bound to quantify the relationship between sensing precision and communication throughput. To ensure millisecond level responsiveness, we develop a low complexity joint beamforming design. By utilizing the analytical mapping between tracking and communication requirements, the proposed scheme yields closed form solutions for beamforming vectors, effectively bypassing the time consuming numerical iterations of conventional methods. Numerical simulations demonstrate that the proposed framework significantly outperforms traditional fixed-deployment benchmarks across complex maneuvering trajectories, achieving centimeter-level accuracy while substantially reducing transmit power and processing latency.
Abstract:Federated learning (FL) over wireless networks suffers from significant training latency and degraded convergence due to unreliable wireless transmission, especially under blocked propagation environments. Although reconfigurable intelligent surfaces (RISs) can improve communication reliability, existing wireless FL studies rarely characterize the trade-off between learning convergence and communication delay under modulation-dependent transmission errors. In this paper, we consider a wireless FL system operating under RIS-assisted blocked-link propagation scenarios, and focus on adaptive modulation and sub-channel allocation for convergence-latency aware communication design. By characterizing the effect of symbol errors on uploaded local gradients, we derive a convergence-related upper bound that reveals the impact of symbol error rate (SER) on FL loss decay. Based on this result, we formulate a joint convergence-latency optimization problem, which is cast as a mixed-integer nonlinear programming (MINLP) problem, and solve it using a low-complexity hybrid alternating optimization framework. Extensive experiments on MNIST, CIFAR-10, and Speech Commands show that the proposed scheme consistently achieves faster convergence and higher test accuracy than existing adaptive communication schemes, especially in complex tasks and challenging wireless scenarios.
Abstract:Integrated sensing and communication (ISAC) is a key technology for future wireless networks, calling for hardware-efficient architectures to jointly support communication and sensing. In this paper, a transmissive reconfigurable intelligent surface (TRIS) transceiver is leveraged to enable an ISAC system. Under the considered system model, we investigate transmit beamforming design for the TRIS transceiver to maximize the sum-rate/beampattern gain, subject to the predefined sensing beampattern gain/communication rate thresholds and the per-unit power constraints of the TRIS transceiver. Since the objective functions and constraints are non-convex, the above two optimization problems are highly challenging. To resolve the difficult optimization problems, we combine the fractional programming (FP) method and the majorization-minimization (MM) framework to develop second-order cone programming (SOCP)-based solutions. Since the per-element power constraints introduce a large number of constraints, this increases the complexity of solving the optimization problems. By splitting the coupling constraints and applying the alternating direction method of multipliers (ADMM) framework, we propose two analytic-based algorithms for efficiently updating the beamformer configurations in the sum-rate and beampattern gain maximization problems, respectively. Simulation results demonstrate the convergence and effectiveness of the proposed algorithms, and show that the low-complexity algorithms achieve performance close to the SOCP-based benchmarks with substantially reduced computational complexity.
Abstract:In this paper, a novel transmissive reconfigurable intelligent surface (TRIS) transceiver is employed to enable an integrated sensing and communication (ISAC) system supporting both communication and sensing. Under both perfect and imperfect channel state information (CSI), we study the transmit beamforming design for the TRIS transceiver to maximize the system energy efficiency (EE), subject to per-user minimum-rate guarantees, a minimum beampattern gain toward the sensing target, and per-antenna power constraints. The corresponding EE maximization problems are challenging to solve due to the fractional objective and non-convex constraints. In particular, under imperfect CSI, the resulting semi-infinite constraints further complicate the problem. For the perfect CSI case, we first apply the fractional programming (FP) methodology to obtain more tractable reformulations of the rate functions, and then propose an iterative algorithm based on the majorization-minimization (MM) framework. For the imperfect CSI case, we utilize the S-Procedure to transform the semi-infinite inequality constraints into linear matrix inequalities (LMIs), and further develop an efficient MM-based algorithm with the aid of slack variables. Numerical results demonstrate the convergence and effectiveness of the proposed algorithms and validate the EE gains of the TRIS transceiver-enabled ISAC system.
Abstract:Knowledge-Based Visual Question Answering (KB-VQA) aims to evaluate whether Visual Language Models (VLMs) can retrieve, ground, and reason over external structured knowledge beyond visual evidence. In practice, answer accuracy is widely adopted as the primary evaluation metric, implicitly treating correctness as a proxy for knowledge-grounded reasoning. However, for existing KB-VQA benchmarks, this proxy relies on critical assumptions that are often overlooked and rendered unreliable by benchmark issues: annotated answer must be derivable from the associated knowledge base, question must be well-posed with sufficient constraints, and visual setting must meaningfully require grounded disambiguation. In this work, we show that these assumptions are systematically violated in existing KB-VQA benchmarks. Our audit reveals substantial instances with missing or contradicted answers and underspecified questions that render accuracy a misleading metric. Furthermore, we find that existing datasets rely on visually trivial, single-entity scenes that bypass the need for sophisticated visual-to-knowledge mapping. We demonstrate that even with controlled architectures, these flaws lead to distorted model rankings and overestimations of reasoning capabilities. To address this, we introduce (1) a principled audit-and-repair protocol that restores answer derivability and question clarity, and (2) a controlled multi-entity augmentation protocol that introduces visual ambiguity to challenge initial retrieval and grounded reasoning. Re-evaluation under corrected and augmented settings yields markedly different performance trends. Our findings call for rethinking evaluation protocols and designing more interaction-aware KB-VQA benchmarks that prioritize verifiable reasoning over simple matching.
Abstract:Currently, streaming video understanding is still a daunting task for existing \emph{multimodal large language models} (MLLMs). Its difficulties not only lie in handling the ever-increasing video frames, but also in the unpredictability of future video content and input instructions. In this paper, we study this task from the perspective of constructing a dynamic but fixed-budget memory bank, and propose a novel and training-free approach termed \emph{\textbf{CausalMem}}. CausalMem is dedicated to constructing a dynamic visual memory update mechanism, thereby maximizing the amount of information in streaming video within a limited memory space, much like the human brain. In practice, CausalMem estimates the redundancy of visual tokens and updates the memory bank via an online semantic basis, which models the principal semantics of the observed video stream. To validate CausalMem, we apply it to two representative MLLMs, namely LLaVA-OneVision and Qwen2.5-VL respectively, and conduct extensive experiments on both streaming and offline video understanding benchmarks. The experimental results not only show the great advantages than existing methods under both streaming and offline settings, \emph{e.g.}, $+3.2\%$ and $+3.0\%$ average accuracy gains respectively, but also witness the superior semantic preservation for streaming videos, \emph{e.g.}, using 12$k$ token budgets to memorize hour-long streaming videos, which achieves more than \textbf{20$\times$} visual token compression ratio and only occupies about \textbf{82 MB} storage. \textbf{Our code} is given in \href{https://github.com/hktk07/CausalMem}{CausalMem}.
Abstract:Knowledge-Based Visual Question Answering (KB-VQA) requires grounding visual queries to external knowledge beyond directly observable content in images. While recent multi modal large language models (MLLMs) show strong perceptual abilities, they struggle on KB-VQA tasks requiring groundings from both fine-grained entity and evidence levels. Most existing multi-modal retrieval augmented generation (MM-RAG) methods tightly couple entity discrimination and section-level evidence ranking into a single re-ranking stage, leading to high cost and limited generalization. In this work, we revisit existing MM-RAG solutions from a workflow perspective and argue both entity-level and fact-level groundings are key bottlenecks. We observe that although MLLMs often fail under open-ended entity naming, they can better identify the correct entity when selecting from a small set of candidate names. Based on this insight, we propose a simple and training-free identify-before-answer IBA framework that decouples entity identification from section-level re-ranking. Our approach prompts an MLLM to select high-confidence entities using only candidate names, followed by an off-the-shelf textual re-ranker for evidence selection. Experiments on Encyclopedic-VQA and InfoSeek show that our method consistently outperforms fine-tuned multi-modal re-ranking baselines while reducing training and inference complexity. Additional analyses reveal that the improvements arise not only from better entity identification, but also from selecting more informative evidence once correct entity is fixed. Our implementation is made public to ease reproducibility.
Abstract:Accurate Estimated Time of Arrival (ETA) prediction on checkout page is crucial in instant logistics for enhancing user satisfaction, optimizing dispatching, and controlling operational costs. In international on-demand delivery platforms, where ETA data originates from diverse countries or regions with different patterns, multi-domain modeling is of great importance and has been widely adopted. However, existing methods still face three critical challenges in real-world deployment. First, current multi-domain models struggle to generalize to completely unseen domains, failing to achieve zero-shot prediction during the initial cold-start phase. Second, cross-domain feature spaces are often assumed to be consistent, whereas new domains commonly suffer from structural missingness of offline (statistical) features due to the lack of historical data. Third, such feature missingness often compels industrial systems to model mature and cold-start domains separately, hindering knowledge transfer and increasing maintenance overhead. To address these challenges, we propose \textbf{UME}, a \textbf{U}nified \textbf{M}eta-generalization framework for \textbf{E}TA. Specifically, UME integrates a unified dual-branch architecture with a novel meta-learning mechanism that employs a hypernetwork-based meta learner. By leveraging domain-level knowledge and instance-level context, the meta learner empowers three meta modules to dynamically modulate feature gating, expert attention, and final prediction, capturing cross-domain correlations and facilitating intra-domain adaptation. A knowledge distillation strategy is further introduce to enhance performance. UME has now been deployed in Meituan-keeta delivery platform (the largest international food delivery platform in China). Extensive offline experiments and online A/B tests demonstrate that UME significantly outperforms existing baselines.
Abstract:This paper investigates a multi-Unmanned Aerial Vehicle (UAV) joint base station-assisted Internet of Vehicles (IoV) task offloading system in dense urban environments. To minimize system delay and energy consumption under strict coupling constraints, the complex non-convex optimization problem is decoupled into a hierarchical execution framework. First, a sequential distributed optimization algorithm based on Second-Order Cone Programming (SOCP) is proposed to optimize the 3D flight trajectory of each UAV, ensuring adaptive network coverage. Second, a novel hybrid resource scheduling paradigm synergizing Deep Reinforcement Learning (DRL) and Large Language Models (LLMs) is developed. Within this framework, the DRL agent dictates the initial resource allocation, while the LLM acts as a semantic macro-scheduler to rectify long-tail allocation imbalances for failed and surplus tasks. Crucially, a reward decoupling mechanism is introduced to isolate DRL training from external LLM interventions, thereby ensuring policy convergence. Finally, the task offloading ratios are precisely determined via Linear Programming (LP) within an alternating optimization loop. Simulation results demonstrate that the proposed method significantly outperforms traditional multi-agent reinforcement learning baselines in terms of task success rate and system efficiency.