YOLOv3: Traffic signs & lights detection and recognition for autonomous driving

Abstract

Advanced Driver Assistance Systems (ADAS) relates to various in-vehicle systems intended to improve road traffic safety by assisting drivers with improved road awareness, inherent dangers and other drivers nearby. Traffic sign detection and recognition is an integral part of ADAS since these provide information about traffic rules, road conditions, route directions and assistance for safe driving. In addition, traffic sign detection and recognition are essential research topics for safe and efficient driving when considering intelligent transportation systems. An approach to traffic sign/light detection and recognition using YOLOv3 and YOLOv3_tiny is presented in this paper in two different environments. The first is on a simulated and real autonomous driving robot for RoboCup Portuguese Open Autonomous Driving Competition. The robot must detect both traffic signs and lights in real-time and behave accordingly. The second environment is on public roads. A computer vision system inside the car points to the road, detecting and classifying traffic signs/lights (T S/L) in different weather and lighting conditions. YOLOv3 and YOLOv3_tiny were tested on both environments with an extensive hyperparameters search. The final result showcases videos of the two algorithms on the two environments.