Networked Control System Under Controller-Actuator Channel Jamming

Wireless channels in the networked control systems are vulnerable to intentional interference, such as jamming attacks. This paper investigates jamming attacks on the wireless controller actuator channel of a control system that can tolerate occasional control inputs from the controller. We start with a worst case scenario for the jammer where the controller knows its channel state. We develop an adaptive jamming strategy in which the jammer, observing the success or failure of each controller transmission, forms beliefs about its own and the controller actuator channel states. Using this belief, it optimizes its actions under a limited jamming budget. To counter this, we develop an event-triggered defense scheme for the controller in two settings: with and without the knowledge of its channel state. Simulation results show that optimal adaptive jamming attacks can significantly degrade control performance, even with a limited budget, while the defense scheme, even without channel state knowledge, can effectively reduce this impact.

As Language Models Scale, Low-order Linear Depth Dynamics Emerge

Large language models are often viewed as high-dimensional nonlinear systems and treated as black boxes. Here, we show that transformer depth dynamics admit accurate low-order linear surrogates within context. Across tasks including toxicity, irony, hate speech and sentiment, a 32-dimensional linear surrogate reproduces the layerwise sensitivity profile of GPT-2-large with near-perfect agreement, capturing how the final output shifts under additive injections at each layer. We then uncover a surprising scaling principle: for a fixed-order linear surrogate, agreement with the full model improves monotonically with model size across the GPT-2 family. This linear surrogate also enables principled multi-layer interventions that require less energy than standard heuristic schedules when applied to the full model. Together, our results reveal that as language models scale, low-order linear depth dynamics emerge within contexts, offering a systems-theoretic foundation for analyzing and controlling them.

Total Variation Sparse Bayesian Learning for Block Sparsity via Majorization-Minimization

Block sparsity is a widely exploited structure in sparse recovery, offering significant gains when signal blocks are known. Yet, practical signals often exhibit unknown block boundaries and isolated non-zero entries, which challenge traditional approaches. A promising method to handle such complex sparsity patterns is the difference-of-logs total variation (DoL-TV) regularized sparse Bayesian learning (SBL). However, due to the complex form of DoL-TV term, the resulting optimization problem is hard to solve. This paper develops a new optimization framework for the DoL-TV SBL cost function. By introducing an exponential reparameterization of the SBL hyperparameters, we reveal a novel structure that admits a majorization-minimization formulation and naturally extends to unknown noise variance estimation. Sparse recovery results on both synthetic data and extended source direction-of-arrival estimation demonstrate improved accuracy and runtime performance compared to benchmark methods.

An Energy-efficient Ordered Transmission-based Sequential Estimation

Estimation problems in wireless sensor networks typically involve gathering and processing data from distributed sensors to infer the state of an environment at the fusion center. However, not all measurements contribute significantly to improving estimation accuracy. The ordered transmission protocol, a promising approach for enhancing energy efficiency in wireless networks, allows for the selection of measurements from different sensors to ensure the desired estimation quality. In this work, we use the idea of ordered transmission to reduce the number of transmissions required for sequential estimation within a network, thereby achieving energy-efficient estimation. We derive a new stopping rule that minimizes the number of transmissions while maintaining estimation accuracy similar to general sequential estimation with unordered transmissions. Moreover, we derive the expected number of transmissions required for both general sequential estimation with unordered transmissions and proposed sequential estimation with ordered transmissions and make a comparison between the two systems. Simulation results indicate that our proposed scheme can efficiently reduce transmissions while still ensuring the quality of estimation.

One-bit Compressed Sensing using Generative Models

This paper addresses the classical problem of one-bit compressed sensing using a deep learning-based reconstruction algorithm that leverages a trained generative model to enhance the signal reconstruction performance. The generator, a pre-trained neural network, learns to map from a low-dimensional latent space to a higher-dimensional set of sparse vectors. This generator is then used to reconstruct sparse vectors from their one-bit measurements by searching over its range. The presented algorithm provides an excellent reconstruction performance because the generative model can learn additional structural information about the signal beyond sparsity. Furthermore, we provide theoretical guarantees on the reconstruction accuracy and sample complexity of the algorithm. Through numerical experiments using three publicly available image datasets, MNIST, Fashion-MNIST, and Omniglot, we demonstrate the superior performance of the algorithm compared to other existing algorithms and show that our algorithm can recover both the amplitude and the direction of the signal from one-bit measurements.

Efficient Off-Grid Bayesian Parameter Estimation for Kronecker-Structured Signals

This work studies the problem of jointly estimating unknown parameters from Kronecker-structured multidimensional signals, which arises in applications like intelligent reflecting surface (IRS)-aided channel estimation. Exploiting the Kronecker structure, we decompose the estimation problem into smaller, independent subproblems across each dimension. Each subproblem is posed as a sparse recovery problem using basis expansion and solved using a novel off-grid sparse Bayesian learning (SBL)-based algorithm. Additionally, we derive probabilistic error bounds for the decomposition, quantify its denoising effect, and provide convergence analysis for off-grid SBL. Our simulations show that applying the algorithm to IRS-aided channel estimation improves accuracy and runtime compared to state-of-the-art methods through the low-complexity and denoising benefits of the decomposition step and the high-resolution estimation capabilities of off-grid SBL.

On the Restricted Isometry Property of Kronecker-structured Matrices

In this work, we study the restricted isometry property (RIP) of Kronecker-structured matrices, formed by the Kronecker product of two factor matrices. Previously, only upper and lower bounds on the restricted isometry constant (RIC) in terms of the RICs of the factor matrices were known. We derive a probabilistic measurement bound for the $s$th-order RIC. We show that the Kronecker product of two sub-Gaussian matrices satisfies RIP with high probability if the minimum number of rows among two matrices is $\mathcal{O}(s \ln \max\{N_1, N_2\})$. Here, $s$ is the sparsity level, and $N_1$ and $N_2$ are the number of columns in the matrices. We also present improved measurement bounds for the recovery of Kronecker-structured sparse vectors using Kronecker-structured measurement matrices. Finally, our analysis is further extended to the Kronecker product of more than two matrices.

Convergence of Expectation-Maximization Algorithm with Mixed-Integer Optimization

The convergence of expectation-maximization (EM)-based algorithms typically requires continuity of the likelihood function with respect to all the unknown parameters (optimization variables). The requirement is not met when parameters comprise both discrete and continuous variables, making the convergence analysis nontrivial. This paper introduces a set of conditions that ensure the convergence of a specific class of EM algorithms that estimate a mixture of discrete and continuous parameters. Our results offer a new analysis technique for iterative algorithms that solve mixed-integer non-linear optimization problems. As a concrete example, we prove the convergence of the EM-based sparse Bayesian learning algorithm in [1] that estimates the state of a linear dynamical system with jointly sparse inputs and bursty missing observations. Our results establish that the algorithm in [1] converges to the set of stationary points of the maximum likelihood cost with respect to the continuous optimization variables.

Joint State and Input Estimation for Linear Dynamical Systems with Sparse Control

Sparsity constraints on the control inputs of a linear dynamical system naturally arise in several practical applications such as networked control, computer vision, seismic signal processing, and cyber-physical systems. In this work, we consider the problem of jointly estimating the states and sparse inputs of such systems from low-dimensional (compressive) measurements. Due to the low-dimensional measurements, conventional Kalman filtering and smoothing algorithms fail to accurately estimate the states and inputs. We present a Bayesian approach that exploits the input sparsity to significantly improve estimation accuracy. Sparsity in the input estimates is promoted by using different prior distributions on the input. We investigate two main approaches: regularizer-based MAP, and {Bayesian learning-based estimation}. We also extend the approaches to handle control inputs with common support and analyze the time and memory complexities of the presented algorithms. Finally, using numerical simulations, we show that our algorithms outperform the state-of-the-art methods in terms of accuracy and time/memory complexities, especially in the low-dimensional measurement regime.

Anomaly Detection via Learning-Based Sequential Controlled Sensing

In this paper, we address the problem of detecting anomalies among a given set of binary processes via learning-based controlled sensing. Each process is parameterized by a binary random variable indicating whether the process is anomalous. To identify the anomalies, the decision-making agent is allowed to observe a subset of the processes at each time instant. Also, probing each process has an associated cost. Our objective is to design a sequential selection policy that dynamically determines which processes to observe at each time with the goal to minimize the delay in making the decision and the total sensing cost. We cast this problem as a sequential hypothesis testing problem within the framework of Markov decision processes. This formulation utilizes both a Bayesian log-likelihood ratio-based reward and an entropy-based reward. The problem is then solved using two approaches: 1) a deep reinforcement learning-based approach where we design both deep Q-learning and policy gradient actor-critic algorithms; and 2) a deep active inference-based approach. Using numerical experiments, we demonstrate the efficacy of our algorithms and show that our algorithms adapt to any unknown statistical dependence pattern of the processes.