CrossGLG: LLM Guides One-shot Skeleton-based 3D Action Recognition in a Cross-level Manner

Most existing one-shot skeleton-based action recognition focuses on raw low-level information (e.g., joint location), and may suffer from local information loss and low generalization ability. To alleviate these, we propose to leverage text description generated from large language models (LLM) that contain high-level human knowledge, to guide feature learning, in a global-local-global way. Particularly, during training, we design $2$ prompts to gain global and local text descriptions of each action from an LLM. We first utilize the global text description to guide the skeleton encoder focus on informative joints (i.e.,global-to-local). Then we build non-local interaction between local text and joint features, to form the final global representation (i.e., local-to-global). To mitigate the asymmetry issue between the training and inference phases, we further design a dual-branch architecture that allows the model to perform novel class inference without any text input, also making the additional inference cost neglectable compared with the base skeleton encoder. Extensive experiments on three different benchmarks show that CrossGLG consistently outperforms the existing SOTA methods with large margins, and the inference cost (model size) is only $2.8$\% than the previous SOTA. CrossGLG can also serve as a plug-and-play module that can substantially enhance the performance of different SOTA skeleton encoders with a neglectable cost during inference. The source code will be released soon.

Millimeter-wave Radio SLAM: End-to-End Processing Methods and Experimental Validation

In this article, we address the timely topic of cellular bistatic simultaneous localization and mapping (SLAM) with specific focus on complete processing solutions from raw I/Q samples to user equipment (UE) and landmark location information in millimeter-wave (mmWave) networks. Firstly, we propose a new multipath channel parameter estimation solution which operates directly with beam reference signal received power (BRSRP) measurements, alleviating the need to know the true antenna beampatterns or the underlying beamforming weights. Additionally, the method has built-in robustness against unavoidable antenna sidelobes. Secondly, we propose new snapshot SLAM algorithms that have increased robustness and identifiability compared to prior-art, in practical built environments with complex clutter and multi-bounce propagation scenarios. The performance of the proposed methods is assessed at the 60 GHz mmWave band, via both realistic ray-tracing evaluations as well as true experimental measurements, in an indoor environment. Wide set of offered results clearly demonstrate the improved performance, compared to the relevant prior-art, in terms of the channel parameter estimation as well as the end-to-end SLAM performance. Finally, the article provides the measured 60 GHz data openly available for the research community, facilitating results reproducibility as well as further algorithm development.

Low Complexity Algorithms for Mission Completion Time Minimization in UAV-Based ISAC Systems

The inherent support of sixth-generation (6G) systems enabling integrated sensing and communications (ISAC) paradigm greatly enhances the application area of intelligent transportation systems (ITS). One of the mission-critical applications enabled by these systems is disaster management, where ISAC functionality may not only provide localization but also provide users with supplementary information such as escape routes, time to rescue, etc. In this paper, by considering a large area with several locations of interest, we formulate and solve the optimization problem of delivering task parameters of the ISAC system by optimizing the UAV speed and the order of visits to the locations of interest such that the mission time is minimized. The formulated problem is a mixed integer non-linear program which is quite challenging to solve. To reduce the complexity of the solution algorithms, we propose two circular trajectory designs. The first algorithm finds the optimal UAV velocity and radius of the circular trajectories. The second algorithm finds the optimal connecting points for joining the individual circular trajectories. Our numerical results reveal that, with practical simulation parameters, the first algorithm provides a time saving of at least $20\%$, while the second algorithm cuts down the total completion time by at least $7$ times.

Fault-Tolerant Collaborative Inference through the Edge-PRUNE Framework

Collaborative inference has received significant research interest in machine learning as a vehicle for distributing computation load, reducing latency, as well as addressing privacy preservation in communications. Recent collaborative inference frameworks have adopted dynamic inference methodologies such as early-exit and run-time partitioning of neural networks. However, as machine learning frameworks scale in the number of inference inputs, e.g., in surveillance applications, fault tolerance related to device failure needs to be considered. This paper presents the Edge-PRUNE distributed computing framework, built on a formally defined model of computation, which provides a flexible infrastructure for fault tolerant collaborative inference. The experimental section of this work shows results on achievable inference time savings by collaborative inference, presents fault tolerant system topologies and analyzes their cost in terms of execution time overhead.

Wi-Fi Based Passive Human Motion Sensing for In-Home Healthcare Applications

This paper introduces a Wi-Fi signal based passive wireless sensing system that has the capability to detect diverse indoor human movements, from whole body motions to limb movements and including breathing movements of the chest. The real time signal processing used for human body motion sensing and software defined radio demo system are described and verified in practical experiments scenarios, which include detection of through-wall human body movement, hand gesture or tremor, and even respiration. The experiment results offer potential for promising healthcare applications using Wi-Fi passive sensing in the home to monitor daily activities, to gather health data and detect emergency situations.

Improved Sensing and Positioning via 5G and mmWave radar for Airport Surveillance

This paper explores an integrated approach for improved sensing and positioning with applications in air traffic management (ATM) and in the Advanced Surface Movement Guidance and Control System (A-SMGCS). The integrated approach includes the synergy of 3D Vector Antenna with the novel time-of-arrival and angle-of-arrival estimate methods for accurate positioning, combining the sensing on the sub-6GHz and mmWave spectrum for the enhanced non-cooperative surveillance. For the positioning scope, both uplink and downlink 5G reference signals are investigated and their performance is evaluated. For the non-cooperative sensing scope, a novel 5G-signal-based imaging function is proposed and verified with realistic airport radio-propagation modelling and the AI-based targets tracking-and-motion recognition are investigated. The 5G-based imaging and mmWave radar based detection can be potentially fused to enhance surveillance in the airport. The work is being done within the European-funded project NewSense and it delves into the 5G, Vector Antennas, and mmWave capabilities for future ATM solutions.

Using Wi-Fi Signal as Sensing Medium: Passive Radar, Channel State Information and Followups

The idea of exploiting the Wi-Fi bursts as the medium for sensing purposes, particularly for the human targets in the indoor environment, was cultivated in both radar and computer science communities and it has became a noticeable research genre with cross-disciplinary impact in security, healthcare, human-machine interaction etc.This article comparatively introduces passive radar based and channel state information (CSI) based approaches. For each means, the primary design principles, signal processing and representative applications scenarios are shown. At last, some opportunities and challenges of Wi-Fi sensing are pointed out for the sake of stepping closer to the practitioners and end-users.

Converging Radar and Communications in the Superposition Transmission

This paper proposes a superposition transmission scheme for the future Radio Frequency (RF) convergence applications. The scheme is discussed under the assumption of a mono-static broadcasting channel topology. Under communications quality-of-service (QoS) constraints, the joint performance region of communications sum rate and radar estimation error variance is studied. Two radar signal waveforms, namely linear FM and parabolic FM, are used to investigate how signal shapes may influence the estimation accuracy. Both waveforms are generated with rectangular envelope. In the end, a numerical analysis is applied, which concludes that a moderate communications QoS promises a good communications fairness while with the limited radar performance degradation.

Unsupervised Doppler Radar-Based Activity Recognition for e-healthcare

Passive radio frequency (RF) sensing and monitoring of human daily activities in elderly care homes has recently become an emerging topic due to the demand with ageing population. Micro-Doppler radars are an appealing solution considering their non-intrusiveness, deep penetration, and high-distance range. This study presents an unsupervised framework for human activity monitoring using Doppler streams. Two unsupervised feature extraction strategies based on convolutional filtering and texture analysis of Doppler images are considered. For the former, encoded features using Convolutional Variational Autoencoder (CVAE) are compared with Convolutional Autoencoder (CAE) features. For the latter, Grey-Level Co-occurrence Matrix (GLCM) is used. These methods are further compared with unsupervised linear feature extraction based on Principal Component Analysis (PCA) and Singular Value Decomposition (SVD). Using these features, unsupervised samples clustering is performed using K-Means and K-Medoids. Actual labels are solely used for evaluation and visualisation. The results showcase 82.5% and 84% average testing accuracies for CVAE features and 77.5% and 72.5% average testing accuracy using texture features based on GLCM using K-Means and K-Medoids respectively. The results show superiority of CVAE and GLCM features compared to PCA, SVD, and CAE with more than 20% average accuracy. Furthermore, for high-dimensional data visualisation, three manifold learning techniques are considered including t-Distributed Stochastic Neighbour Embedding (t-SNE), Multidimensional Scaling (MDS), and Locally Linear Embedding (LLE). The visualisation methods are compared for projection of raw data as well as the encoded features using CVAE. All three methods show an improved visualisation ability when applied on the transformed CVAE data.