The project is being headed up by Sanral’s Technical Innovation Hub (TIH) and will draw from extensive research into industry best practise and collaborations with various stakeholders in the road safety arena, both nationally and abroad, the agency said.
“Machine learning can be used to detect and segment objects within a camera frame – each frame of a video is analysed as a still image,” said Ruan Van Breda, mechatronic engineer in the TIH.
“These objects can then be classified based on pre-trained image classifiers. Within the road environment, this allows one to detect and classify different type of vehicles, pedestrians, different types of animals, cyclists, etc.”
Van Breda said that currently there is already ample data available for the above-mentioned classification types.
However, Van Breda said that these genres can be further expanded through the creation of custom data sets and training classifiers, to be able to distinguish, for example, between slow-moving traffic and a road traffic crash.
This can also be used to create new classification classes based on unique experiences, or the requirements of the road authority e.g. fire or protest detection, foreign objects such as rocks, tyre detection, he said.
This information can then be used to activate the appropriate response through the Road Incident Management System (RIMS), remedy the situation and inform road users – in real time.
“One can also look at how these different objects interact with one another, e.g. to detect unusual vehicle behaviour, like a vehicle stopping on the freeway.
“One is furthermore able to infer information about the interaction between multiple elements such as cars and pedestrians. If a vehicle is detected moving to the side of the road and coming to a standstill and pedestrians are detected moving towards the vehicle and enter the vehicle, this can be classified as an informal pick-up.
“As more and more data is collected, these trends can either aid road authorities with infrastructure planning such as drop-off/pick-up points or aid law enforcement to stop illegal pick-ups if it is considered a safety risk,” he said.
While the use of this technology comes with significant risks, Sanral said that all efforts are being made to understand how to effectively use the technology while maintaining strict compliance with legislation as it relates to the privacy of road users.
Some of the ways to mitigate these potential privacy risks, are to use strict security and access controls, it said. It added that data can also be anonymous at the point of capture.
Sanral said that the intention is not to observe individuals, but rather to identify trends and incidents to inform appropriate response and interventions.
“While this technology is still in the exploratory phase in South Africa, it already has tongues wagging in countries like China, where they use machine learning to incorporate facial recognition for law enforcement.
“They are able to identify the driver of a vehicle and instantly issue fines, if that driver does not have a valid driver’s license.
“Fines can also be issued automatically for individuals who jay-walk or gain access to restricted areas. As with any technological advances, there are pros and cons and in a complex society like South Africa, for now, let’s look and learn,” said Van Breda.