Automated Testbed for Repeatable Evaluation of Ultra-Wideband Localization Performance

Testing Ultra-Wideband (UWB) systems is challenging, as multiple devices need to coordinate over lossy links and the systems' behavior is influenced by timing, synchronization, and environmental factors. Traditional testing is often insufficient to capture these complex interactions, highlighting the need for an overarching testbed infrastructure that can manage devices, control the environment, and make measurements and test scenarios repeatable. In this work, we present a highly automated testbed architecture built on Robot Operating System Version 2, integrating device management with environmental control and measurement systems. It includes an optical reference system, a controllable Autonomous Guided Vehicle to position devices within the environment, and time synchronization via Network Time Protocol (NTP). The testbed achieves a Root Mean Squared Error of 4.8 mm for positioning repeatability and 0.493$°$ for the orientation, and our NTP-based synchronization approach achieves a timing accuracy of below 1 ms. All testbed functionality can be controlled remotely through simple Python scripts to allow automated orchestration tasks such as conducting complex measurement scenarios. We demonstrate this with a measurement campaign on UWB localization, showing how it enables repeatable, observable, and fully controlled wireless experiments.

Robot Tasks with Fuzzy Time Requirements from Natural Language Instructions

Natural language allows robot programming to be accessible to everyone. However, the inherent fuzziness in natural language poses challenges for inflexible, traditional robot systems. We focus on instructions with fuzzy time requirements (e.g., "start in a few minutes"). Building on previous robotics research, we introduce fuzzy skills. These define an execution by the robot with so-called satisfaction functions representing vague execution time requirements. Such functions express a user's satisfaction over potential starting times for skill execution. When the robot handles multiple fuzzy skills, the satisfaction function provides a temporal tolerance window for execution, thus, enabling optimal scheduling based on satisfaction. We generalized such functions based on individual user expectations with a user study. The participants rated their satisfaction with an instruction's execution at various times. Our investigations reveal that trapezoidal functions best approximate the users' satisfaction. Additionally, the results suggest that users are more lenient if the execution is specified further into the future.