Sony’s AI‑Enabled Cameras Pilot Rome’s Smart City Trial

In an ambitious move to modernize urban mobility, Rome has deployed Sony’s AI‑capable image sensors as part of a “Smart Tip” system, aiming to slash traffic congestion, cut pedestrian fatalities, and streamline public bus services.

The pilot tackles three universal urban challenges: high traffic volumes—especially from drivers hunting parking spots—pedestrian safety at crosswalks, and the efficient allocation of bus capacity in a post‑pandemic context.

Three proof‑of‑concept Smart Tip units have been installed atop traffic signals across the city.

The Smart Tip system, featuring two Sony IMX500 AI‑capable camera modules, sits atop a traffic light (Source: Sony Semiconductor Europe)

The Smart Tips rely on dual Sony IMX500 image sensors. Launched last year, these modules combine a 12.3‑megapixel sensor with an on‑chip DSP and dedicated AI memory, enabling real‑time image processing at the network edge. This design eliminates the need to transmit raw footage to the cloud, ensuring both ultra‑fast response times and robust privacy protection. Instead, the sensor outputs concise metadata—such as vehicle presence counts or pedestrian detection flags—directly to the Smart Tip’s cellular modem.

“No image leaves the sensor; it’s a camera used purely as a sensor. We transmit only what’s necessary—vehicle or pedestrian counts, not the actual footage,” explained Antonio Avitabile, Managing Director of Corporate Alliance and Investment at Sony. “This keeps data local, speeds up decision making, and respects user privacy.”

Edge processing also dramatically reduces bandwidth demands, sending lightweight metadata rather than bulk imagery to the cloud, where Sony’s Smart Tip service platform orchestrates device provisioning, AI model training, and OTA updates.

click for full size image

The three applications being trialed by this project (Source: Sony Semiconductor Europe)

Three key applications

Traffic congestion, a major pain point in major metros, is largely driven by drivers circling for parking. The Smart Tip system tracks vacant parking spots in real time, relaying GPS coordinates to the cloud. Via a mobile app, drivers receive live parking guidance, cutting idle driving time, congestion, and associated emissions.

Pedestrian safety remains a critical concern, with thousands of fatalities across Europe annually. The trial quantifies the average distance between pedestrians and vehicles. Smart Tips detect pedestrians crossing the street and trigger visual or audible alerts at the intersection, effectively informing drivers and reducing collision risk.

Traffic outside Rome’s Colosseum (Credit: Boris Stroujko)

Public transport optimization is the third focus. Smart bus stops equipped with the same sensors monitor passenger counts at each stop, informing buses whether to stop or adjust capacity—crucial during the pandemic and for future load balancing. The data also refines route planning and scheduling.

Backend platform

Sony’s Smart Tip service platform runs in the cloud, handling device enrolment, AI model training, and seamless OTA deployment. Because only metadata travels, bandwidth usage stays minimal, ensuring scalability as more units come online. The core hardware remains identical across all three use cases; only the AI model software differs, allowing for easy application expansion.

>> This article was originally published on our sister site, EE Times Europe.