Alert button
Picture for William Jones

William Jones

Alert button

NightVision: Generating Nighttime Satellite Imagery from Infra-Red Observations

Dec 08, 2020
Paula Harder, William Jones, Redouane Lguensat, Shahine Bouabid, James Fulton, Dánell Quesada-Chacón, Aris Marcolongo, Sofija Stefanović, Yuhan Rao, Peter Manshausen, Duncan Watson-Parris

Figure 1 for NightVision: Generating Nighttime Satellite Imagery from Infra-Red Observations

The recent explosion in applications of machine learning to satellite imagery often rely on visible images and therefore suffer from a lack of data during the night. The gap can be filled by employing available infra-red observations to generate visible images. This work presents how deep learning can be applied successfully to create those images by using U-Net based architectures. The proposed methods show promising results, achieving a structural similarity index (SSIM) up to 86\% on an independent test set and providing visually convincing output images, generated from infra-red observations.

Viaarxiv icon

Deep Learned Path Planning via Randomized Reward-Linked-Goals and Potential Space Applications

Sep 13, 2019
Tamir Blum, William Jones, Kazuya Yoshida

Figure 1 for Deep Learned Path Planning via Randomized Reward-Linked-Goals and Potential Space Applications
Figure 2 for Deep Learned Path Planning via Randomized Reward-Linked-Goals and Potential Space Applications
Figure 3 for Deep Learned Path Planning via Randomized Reward-Linked-Goals and Potential Space Applications
Figure 4 for Deep Learned Path Planning via Randomized Reward-Linked-Goals and Potential Space Applications

Space exploration missions have seen use of increasingly sophisticated robotic systems with ever more autonomy. Deep learning promises to take this even a step further, and has applications for high-level tasks, like path planning, as well as low-level tasks, like motion control, which are critical components for mission efficiency and success. Using deep reinforcement end-to-end learning with randomized reward function parameters during training, we teach a simulated 8 degree-of-freedom quadruped ant-like robot to travel anywhere within a perimeter, conducting path plan and motion control on a single neural network, without any system model or prior knowledge of the terrain or environment. Our approach also allows for user specified waypoints, which could translate well to either fully autonomous or semi-autonomous/teleoperated space applications that encounter delay times. We trained the agent using randomly generated waypoints linked to the reward function and passed waypoint coordinates as inputs to the neural network. Such applications show promise on a variety of space exploration robots, including high speed rovers for fast locomotion and legged cave robots for rough terrain.

* 8 pages, 3 tables, 5 figures 
Viaarxiv icon