StableFDG: Style and Attention Based Learning for Federated Domain Generalization

Traditional federated learning (FL) algorithms operate under the assumption that the data distributions at training (source domains) and testing (target domain) are the same. The fact that domain shifts often occur in practice necessitates equipping FL methods with a domain generalization (DG) capability. However, existing DG algorithms face fundamental challenges in FL setups due to the lack of samples/domains in each client's local dataset. In this paper, we propose StableFDG, a style and attention based learning strategy for accomplishing federated domain generalization, introducing two key contributions. The first is style-based learning, which enables each client to explore novel styles beyond the original source domains in its local dataset, improving domain diversity based on the proposed style sharing, shifting, and exploration strategies. Our second contribution is an attention-based feature highlighter, which captures the similarities between the features of data samples in the same class, and emphasizes the important/common characteristics to better learn the domain-invariant characteristics of each class in data-poor FL scenarios. Experimental results show that StableFDG outperforms existing baselines on various DG benchmark datasets, demonstrating its efficacy.

Higher-order Neural Additive Models: An Interpretable Machine Learning Model with Feature Interactions

Black-box models, such as deep neural networks, exhibit superior predictive performances, but understanding their behavior is notoriously difficult. Many explainable artificial intelligence methods have been proposed to reveal the decision-making processes of black box models. However, their applications in high-stakes domains remain limited. Recently proposed neural additive models (NAM) have achieved state-of-the-art interpretable machine learning. NAM can provide straightforward interpretations with slight performance sacrifices compared with multi-layer perceptron. However, NAM can only model 1$^{\text{st}}$-order feature interactions; thus, it cannot capture the co-relationships between input features. To overcome this problem, we propose a novel interpretable machine learning method called higher-order neural additive models (HONAM) and a feature interaction method for high interpretability. HONAM can model arbitrary orders of feature interactions. Therefore, it can provide the high predictive performance and interpretability that high-stakes domains need. In addition, we propose a novel hidden unit to effectively learn sharp-shape functions. We conducted experiments using various real-world datasets to examine the effectiveness of HONAM. Furthermore, we demonstrate that HONAM can achieve fair AI with a slight performance sacrifice. The source code for HONAM is publicly available.

Explicit Feature Interaction-aware Graph Neural Networks

Graph neural networks are powerful methods to handle graph-structured data. However, existing graph neural networks only learn higher-order feature interactions implicitly. Thus, they cannot capture information that occurred in low-order feature interactions. To overcome this problem, we propose Explicit Feature Interaction-aware Graph Neural Network (EFI-GNN), which explicitly learns arbitrary-order feature interactions. EFI-GNN can jointly learn with any other graph neural network. We demonstrate that the joint learning method always enhances performance on the various node classification tasks. Furthermore, since EFI-GNN is inherently a linear model, we can interpret the prediction result of EFI-GNN. With the computation rule, we can obtain an any-order feature's effect on the decision. By that, we visualize the effects of the first-order and second-order features as a form of a heatmap.

Comparing Feedback Linearization and Adaptive Backstepping Control for Airborne Orientation of Agile Ground Robots using Wheel Reaction Torque

In this paper, two nonlinear methods for stabilizing the orientation of a Four-Wheel Independent Drive and Steering (4WIDS) robot while in the air are analyzed, implemented in simulation, and compared. AGRO (the Agile Ground Robot) is a 4WIDS inspection robot that can be deployed into unsafe environments by being thrown, and can use the reaction torque from its four wheels to command its orientation while in the air. Prior work has demonstrated on a hardware prototype that simple PD control with hand-tuned gains is sufficient, but hardly optimal, to stabilize the orientation in under 500ms. The goal of this work is to decrease the stabilization time and reject disturbances using nonlinear control methods. A model-based Feedback Linearization (FL) was added to compensate for the nonlinear Coriolis terms. However, with external disturbances, model uncertainty and sensor noise, the FL controller does not guarantee stability. As an alternative, a second controller was developed using backstepping methods with an adaptive compensator for external disturbances, model uncertainty, and sensor offset. The controller was designed using Lyapunov analysis. A simulation was written using the full nonlinear dynamics of AGRO in an isotropic steering configuration in which control authority over its pitch and roll are equalized. The PD+FL control method was compared to the backstepping control method using the same initial conditions in simulation. Both the backstepping controller and the PD+FL controller stabilized the system within 250 milliseconds. The adaptive backstepping controller was also able to achieve this performance with the adaptation law enabled and compensating for offset noisy sinusoidal disturbances.