Milestone Systems announced the upcoming launch of a generative AI-powered video analytics plug-in for its XProtect® video management software, developed in collaboration with NVIDIA. This new tool is designed to help operators contextualise alarms and focus on what truly matters by automating video review, filtering out false alarms, and reducing operator alarm fatigue by up to 30%.
A beta version of the plug-in will be unveiled at the Smart City Expo World Congress in Barcelona, taking place from 4 to 6 November, with general availability expected later this year.
Making Sense of More Video, Faster
Today’s video systems generate vast quantities of data, yet reviewing footage remains a time-consuming, largely manual task. Milestone Systems’ new XProtect plug-in addresses this challenge by leveraging generative AI to automatically summarise, contextualise, and validate video content in real time. This enables faster response times, more efficient video management, and a significant reduction in operator alarm fatigue.
Key features of the new plug-in include:
-
Automated Incident Reports: Selected video clips are instantly converted into incident summaries and structured reports, allowing operators to reduce time spent on documentation.
-
Event Validation: The plug-in can be configured to analyse motion events and validate alarms, reducing false positives and improving alert handling. This feature is fully integrated with the XProtect rule engine.
-
Contextual Bookmark Summaries: Bookmarked footage is automatically summarised using natural language output, enabling rapid triage without the need to manually review each clip.
The plug-in integrates seamlessly with the XProtect rule engine and is deployable both on-premises and in the cloud, offering flexibility to support compliance and deployment requirements.
Built on Ethical AI, Powered by Real-World Data
This innovative solution is built on Milestone’s Hafnia Vision Language Model (VLM), trained on 75,000 hours of ethically sourced, real-world video data from Europe and the US, with data preparation powered by NVIDIA Cosmos Curator. The system can run on either cloud infrastructure or regional data centres, leveraging the advanced capabilities of the NVIDIA Cosmos Reason VLM. This makes it one of the most advanced and compliant video AI platforms in the industry.
Thomas Jensen, CEO of Milestone Systems, commented:
“With this new XProtect plug-in, we are making advanced video intelligence accessible to cities, organisations, and operators worldwide who manage traffic systems. This will help them unlock new levels of efficiency, safety, and insight. XProtect users will gain access to cutting-edge generative AI capabilities, and our partners will be able to build additional value on top of these new capabilities. It truly marks a pivotal step in our mission to transform how the world manages and learns from visual data, responsibly and at scale.”
XProtect customers such as the cities of Genoa, Italy, and Dubuque, Iowa, are eager to explore these new capabilities, positioning themselves as leaders in adopting advanced video intelligence solutions to enhance traffic management.
Enabling Ecosystem Innovation with VLM-as-a-Service
The XProtect plug-in is just the beginning. Milestone is also introducing VLM-as-a-Service via APIs, allowing developers, integrators, and partners to create their own generative AI solutions, regardless of the video management platform in use.
Live demonstrations of the XProtect plug-in will be hosted in partnership with Vaidio at the Smart City Expo World Congress from 4 to 6 November in Barcelona, at the Dell booth. These demonstrations will showcase a new AI model benchmarking tool and real-time incident summarisation.