Shared Control Based on Extended Lipschitz Analysis With Application to Human-Superlimb Collaboration

This paper presents a quantitative method to construct voluntary manual control and sensor-based reactive control in human-robot collaboration based on Lipschitz conditions. To collaborate with a human, the robot observes the human's motions and predicts a desired action. This predictor is constructed from data of human demonstrations observed through the robot's sensors. Analysis of demonstration data based on Lipschitz quotients evaluates a) whether the desired action is predictable and b) to what extent the action is predictable. If the quotients are low for all the input-output pairs of demonstration data, a predictor can be constructed with a smooth function. In dealing with human demonstration data, however, the Lipschitz quotients tend to be very high in some situations due to the discrepancy between the information that humans use and the one robots can obtain. This paper a) presents a method for seeking missing information or a new variable that can lower the Lipschitz quotients by adding the new variable to the input space, and b) constructs a human-robot shared control system based on the Lipschitz analysis. Those predictable situations are assigned to the robot's reactive control, while human voluntary control is assigned to those situations where the Lipschitz quotients are high even after the new variable is added. The latter situations are deemed unpredictable and are rendered to the human. This human-robot shared control method is applied to assist hemiplegic patients in a bimanual eating task with a Supernumerary Robotic Limb, which works in concert with an unaffected functional hand.

A Data-Driven Approach to Positioning Grab Bars in the Sagittal Plane for Elderly Persons

The placement of grab bars for elderly users is based largely on ADA building codes and does not reflect the large differences in height, mobility, and muscle power between individual persons. The goal of this study is to see if there are any correlations between an elderly user's preferred handlebar pose and various demographic indicators, self-rated mobility for tasks requiring postural change, and biomechanical markers. For simplicity, we consider only the case where the handlebar is positioned directly in front of the user, as this confines the relevant body kinematics to a 2D sagittal plane. Previous eldercare devices have been constructed to position a handlebar in various poses in space. Our work augments these devices and adds to the body of knowledge by assessing how the handlebar should be positioned based on data on actual elderly people instead of simulations.

Language Control in Robotics

For robots performing a assistive tasks for the humans, it is crucial to synchronize their speech with their motions, in order to achieve natural and effective human-robot interaction. When a robot's speech is out of sync with their motions, it can cause confusion, frustration, and misinterpretation of the robot's intended meaning. Humans are accustomed to using both verbal and nonverbal cues to understand and coordinate with each other, and robots that can align their speech with their actions can tap into this natural mode of communication. In this research, we propose a language controller for robots to control the pace, tone, and pauses of their speech along with it's motion in the trajectory. The robot's speed is adjusted using an admittance controller based on the force input from the user, and the robot's speech speed is modulated using phase-vocoders.

An Avatar Robot Overlaid with the 3D Human Model of a Remote Operator

Although telepresence assistive robots have made significant progress, they still lack the sense of realism and physical presence of the remote operator. This results in a lack of trust and adoption of such robots. In this paper, we introduce an Avatar Robot System which is a mixed real/virtual robotic system that physically interacts with a person in proximity of the robot. The robot structure is overlaid with the 3D model of the remote caregiver and visualized through Augmented Reality (AR). In this way, the person receives haptic feedback as the robot touches him/her. We further present an Optimal Non-Iterative Alignment solver that solves for the optimally aligned pose of 3D Human model to the robot (shoulder to the wrist non-iteratively). The proposed alignment solver is stateless, achieves optimal alignment and faster than the baseline solvers (demonstrated in our evaluations). We also propose an evaluation framework that quantifies the alignment quality of the solvers through multifaceted metrics. We show that our solver can consistently produce poses with similar or superior alignments as IK-based baselines without their potential drawbacks.

Learned Lifted Linearization Applied to Unstable Dynamic Systems Enabled by Koopman Direct Encoding

This paper presents a Koopman lifting linearization method that is applicable to nonlinear dynamical systems having both stable and unstable regions. It is known that DMD and other standard data-driven methods face a fundamental difficulty in constructing a Koopman model when applied to unstable systems. Here we solve the problem by incorporating knowledge about a nonlinear state equation with a learning method for finding an effective set of observables. In a lifted space, stable and unstable regions are separated into independent subspaces. Based on this property, we propose to find effective observables through neural net training where training data are separated into stable and unstable trajectories. The resultant learned observables are used for constructing a linear state transition matrix using method known as Direct Encoding, which transforms the nonlinear state equation to a state transition matrix through inner product computations with the observables. The proposed method shows a dramatic improvement over existing DMD and data-driven methods.

A practical optimal control approach for two-speed actuators

This paper addresses the closed-loop control of an actuator with both a continuous input variable (motor torque) and a discrete input variable (mode selection). In many applications, robots have to bear large loads while moving slowly and also have to move quickly through the air with almost no load, leading to conflicting requirements for their actuators. An actuator with multiple gear ratios, like in a powertrain, can address this issue by allowing an effective use of power over a wide range of output speed. However, having discrete modes of operation adds complexity to the high-level control and planning. Here a controller for two-speed actuators that automatically select both the best gear ratio and the motor torque is developed. The approach is to: first derive a low-dimensional model, then use dynamic programming to find the best actions for all possible situations, and last use regression analysis to extract simplified global feedback laws. This approach produces simple practical nearly-optimal feedback laws. A controller that globally minimizes a quadratic cost function is derived for a two-speed actuator prototype, global stability is proven and performance is demonstrated experimentally.

A Fast Gear-Shifting Actuator for Robotic Tasks with Contacts

Vehicle power-trains use a variable transmission (multiple gear-ratios) to minimize motor size and maximize efficiency while meeting a wide-range of operating points. Robots could similarly benefit from variable transmission to save weight and improve energy efficiency; leading to potentially groundbreaking improvements for mobile and wearable robotic systems. However, variable transmissions in a robotic context leads to new challenges regarding the gear-shifting methodology: 1) order-of-magnitude variations of reduction ratios are desired, and 2) contact situations during manipulation/locomotion tasks lead to impulsive behavior at the moment when gear-shifting is required. This paper present an actuator with a gear-shifting methodology that can seamlessly change between two very different reduction ratios during dynamic contact situations. Experimental results demonstrate the ability to execute a gear-shift from a 1:23 reduction to a 1:474 reduction in less than 30ms during contact with a rigid object.

Monitoring the Mental State of Cooperativeness for Guiding an Elderly Person in Sit-to-Stand Assistance

In providing physical assistance to elderly people, ensuring cooperative behavior from the elderly persons is a critical requirement. In sit-to-stand assistance, for example, an older adult must lean forward, so that the body mass can shift towards the feet before a caregiver starts lifting the body. An experienced caregiver guides the older adult through verbal communications and physical interactions, so that the older adult may be cooperative throughout the process. This guidance is of paramount importance and is a major challenge in introducing a robotic aid to the eldercare environment. The wide-scope goal of the current work is to develop an intelligent eldercare robot that can a) monitor the mental state of an older adult, and b) guide the older adult through an assisting procedure so that he/she can be cooperative in being assisted. The current work presents a basic modeling framework for describing a human's physical behaviors reflecting an internal mental state, and an algorithm for estimating the mental state through interactive observations. The sit-to-stand assistance problem is considered for the initial study. A simple Kalman Filter is constructed for estimating the level of cooperativeness in response to applied cues, with a thresholding scheme being used to make judgments on the cooperativeness state.

Mapping Human Muscle Force to Supernumerary Robotics Device for Overhead Task Assistance

Supernumerary Robotics Device (SRD) is an ideal solution to provide robotic assistance in overhead manual manipulation. Since two arms are occupied for the overhead task, it is desired to have additional arms to assist us in achieving other subtasks such as supporting the far end of a long plate and pushing it upward to fit in the ceiling. In this study, a method that maps human muscle force to SRD for overhead task assistance is proposed. Our methodology is to utilize redundant DoFs such as the idle muscles in the leg to control the supporting force of the SRD. A sEMG device is worn on the operator's shank where muscle signals are measured, parsed, and transmitted to SRD for control. In the control aspect, we adopted stiffness control in the task space based on torque control at the joint level. We are motivated by the fact that humans can achieve daily manipulation merely through simple inherent compliance property in joint driven by muscles. We explore to estimate the force of some particular muscles in humans and control the SRD to imitate the behaviors of muscle and output supporting forces to accomplish the subtasks such as overhead supporting. The sEMG signals detected from human muscles are extracted, filtered, rectified, and parsed to estimate the muscle force. We use this force information as the intent of the operator for proper overhead supporting force. As one of the well-known compliance control methods, stiffness control is easy to achieve using a few of straightforward parameters such as stiffness and equilibrium point. Through tuning the stiffness and equilibrium point, the supporting force of SRD in task space can be easily controlled. The muscle force estimated by sEMG is mapped to the desired force in the task space of the SRD. The desired force is transferred into stiffness or equilibrium point to output the corresponding supporting force.

Dynamic Modeling of Bucket-Soil Interactions Using Koopman-DFL Lifting Linearization for Model Predictive Contouring Control of Autonomous Excavators

A lifting-linearization method based on the Koopman operator and Dual Faceted Linearization is applied to the control of a robotic excavator. In excavation, a bucket interacts with the surrounding soil in a highly nonlinear and complex manner. Here, we propose to represent the nonlinear bucket-soil dynamics with a set of linear state equations in a higher-dimensional space. The space of independent state variables is augmented by adding variables associated with nonlinear elements involved in the bucket-soil dynamics. These include nonlinear resistive forces and moment acting on the bucket from the soil, and the effective inertia of the bucket that varies as the soil is captured into the bucket. Variables associated with these nonlinear resistive and inertia elements are treated as additional state variables, and their time evolution is represented as another set of linear differential equations. The lifted linear dynamic model is then applied to Model Predictive Contouring Control, where a cost functional is minimized as a convex optimization problem thanks to the linear dynamics in the lifted space. The lifted linear model is tuned based on a data-driven method by using a soil dynamics simulator. Simulation experiments verify the effectiveness of the proposed lifting linearization compared to its counterpart.