Exploring Cost-effective Computer Vision Solutions for Smart Transportation Systems

The rapid development of the internet of things (IoT), sensing technologies, Artificial Intelligence (AI), machine learning, and deep learning techniques have yielded new perspectives on how novel technologies can be applied to smart cities. The New York City IoT Strategy Report 1 highlighted that the city has been home to a major expansion in IoT and AI use in the last decade, with impacts on many areas, including its transportation system.

As a subfield of AI, computer vision is showing promising potential in understanding the realistic dynamics of cities. While cities are complex by nature, especially cities like NYC, the applications of computer vision show progress in tackling a variety of complex physical and non-physical visual tasks. For example, the use of computer vision can align with the city’s Vison Zero goals for traffic safety. In addition, computer vision can turn existing infrastructure into smart sensors in a myriad of ways, and new applications are being continuously developed. Agencies including NYC Department of Transportation (NYC DOT), NYC Department of Design and Construction (NYC DDC), and NYC Mayor’s Office of the Chief Technology Officer (CTO) have identified a “wishlist” of area of interests in using computer vision technologies for the city.

The wishlist includes using computer vision tools to validate the accuracy of collected mobility data (e.g., turning movement counts, vehicle classifications, vehicle and pedestrian speed, etc.), parking utilization, work zone assessment, incident detection, mobility aid detection, vehicle-pedestrian conflicts, as well as assessing how the computer vision algorithm can be trained for NYC conditions where there may be difficult sightlines and blockages and restrictions on camera placement. This wishlist provides the foundation of understanding agency needs and what the technology can offer.