2020/04/09 by Travis Manderson, Stefan Wapnick, Manderson, Travis +5 · 2 citations
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robotics (cs.RO)
paper · pdf · doi:10.48550/arxiv.2004.04697
openalex publication_date 2020/04/09 · openalex created_date 2022/07/24 · openalex updated_date 2026/07/28
We present a method for learning to drive on smooth terrain while\nsimultaneously avoiding collisions in challenging off-road and unstructured\noutdoor environments using only visual inputs. Our approach applies a hybrid\nmodel-based and model-free reinforcement learning method that is entirely\nself-supervised in labeling terrain roughness and collisions using on-board\nsensors. Notably, we provide both first-person and overhead aerial image inputs\nto our model. We find that the fusion of these complementary inputs improves\nplanning foresight and makes the model robust to visual obstructions. Our\nresults show the ability to generalize to environments with plentiful\nvegetation, various types of rock, and sandy trails. During evaluation, our\npolicy attained 90% smooth terrain traversal and reduced the proportion of\nrough terrain driven over by 6.1 times compared to a model using only\nfirst-person imagery.\n