This article explains how to use Milestone's Centralized Search with different Bosch IVA Pro packs.
General information
It is important to note that the Centralized Search Engine does not support forensic searches for Bosch IVA tasks. To perform this type of search, the Bosch Forensic Search Plug-in must be utilized.
Introduction
Bosch Security Systems is a leader in advanced camera-based video analytics, offering unparalleled detection accuracy and speed through on-camera processing. This approach not only accelerates analytics performance but also eliminates the need for additional on-site server hardware, providing significant cost and operational efficiencies.
With each new firmware release, Bosch continues to expand its suite of video analytics capabilities. The most recent advancements allow for the detection of various objects, categorized as follows:
People:
Basic person detection (via Bosch IVA Pro Buildings)
Traffic pedestrian detection (via Bosch IVA Pro Traffic)
Advanced intruders, such as individuals crawling or camouflaged (via Bosch IVA Pro Perimeter)
Vehicles:
General vehicle detection (via Bosch IVA Pro Buildings)
Limited vehicle sub-classes (via Bosch IVA Pro Perimeter)
Detailed vehicle classification with full sub-classes (via Bosch IVA Pro Traffic)
With the release of firmware version 9.40, Bosch cameras now offer the capability to detect more complex objects, as listed below.
New Bosch IVA objects:
Safety equipment, such as vests and hard hats (via Bosch IVA Pro Personal Protective Equipment (PPE))
Detailed human attributes, including gender, clothing style and color, hair characteristics, glasses, hats, backpacks, and bags (via Bosch IVA Pro Appearance)
License plates, including the state and country of origin (via Bosch IVA Pro LPR)
Vehicle make, model, and classification (via Bosch IVA Pro Vehicle Make Model)
Milestone XProtect Centralized Search
Bosch cameras are frequently integrated with Milestone XProtect video management software (VMS) to enhance surveillance capabilities. As of XProtect 2024R2, users can now search across all Bosch-detected objects within the system using Milestone XProtect Centralized Search, with no need for additional plug-ins. This innovative search functionality is immediately available, provided you have compatible Bosch camera models and corresponding IVA Pro licenses.
To ensure proper licensing and compatibility, contact your Bosch representative or explore the Bosch Video Product Selector. In addition, appropriate Milestone XProtect licenses are required for full functionality.
Setting Up XProtect Management Client for Bosch Camera-Detected Objects
Metadata Search
Make sure that XProtect 2024R2 is installed and running.
Navigate to the Metadata Search configuration node and configure the attributes that should be available for the search implementation in the Smart Client.
There are dedicated settings for People related attributes and Vehicle related attributes.
Note that not all of the searchable attributes are available with Bosch camera FW 9.40. Please have a closer look into the 'Known limitations' section.
Metadata driver settings
Milestone is consuming Onvif based metadata for the Centralized Search integration and thus the Bosch Metadata Stream type setting needs to reflect this prerequisite.
The selected streaming mode for a Bosch metadata channel is either
ONVIF or Bosch Binary & ONVIF
Conducting Object Searches with XProtect Smart Client
Object searches are centrally hosted in the Search tab in the Milestone Smart Client and thus the Search tab needs to be selected for conducting any object search.
For person based searches activate the People button in the Search for... section or the Vehicles button for traffic related searches.
While conduction the search the attributes can be selected or adjusted in the search filter section, depending on the search setting. Please be aware that only features and attributes are shown in the search filter, which have been previously configured in the Management Client (as explained above).
Search results will then be displayed in the results section.
Use Case Examples
The ability to search for Bosch IVA Pro objects in Milestone XProtect Centralized Search can address a wide range of operational challenges. Below are a few practical examples:
Workplace Safety Enforcement: Ensure compliance with safety regulations on construction sites by detecting whether personnel are/were wearing safety vests and hard hats.
Automated Rule Enforcement: Streamline the enforcement of workplace safety rules and automate compliance reporting.
Compliance Insights: Gather actionable data on safety compliance for performance improvements.
Cost Reduction: Minimize the financial impact of non-compliance and potential safety violations.
Forensic Attribute Search: Find individuals based on specific physical characteristics (e.g., clothing color or accessories) across multiple cameras.
Vehicle Detection: Search for vehicles based on attributes such as license plate, make, or model.
Crime Investigation: Identify vehicles associated with criminal activity or recover stolen vehicles through advanced search filters.
License Plate Verification: Detect mismatches between a vehicle’s license plate and its registered make or model.
Search Without License Plates: Locate vehicles even when their license plates are missing or unreadable.
Known Limitations
Search does not work for IVA Pro Dangerous Goods Signs: ADR signs on trucks, vans, and cars cannot be searched for in XProtect Centralized Search.
No vehicle colors: It is not possible to search for vehicles of specific color through XProtect Centralized Search, if combined with IVA Pro LPR, Vehicle Make Model, or the combination. In case you are specifically interested in searching for vehicle colors the IVA Pro Traffic License has to be activated.
Only one license can be activated at a time: You can have multiple IVA Pro licenses installed on the camera, but it's only possible to activate one license at a time.
Frequently Asked Questions (FAQs)
In the XProtect Management Client under "Metadata Use" > "Metadata Search," there is a long list of detectable objects. Which ones should I select?
The objects you select depend on the Bosch camera model and the type of IVA Pro license you are using. The list of detectable objects per IVA Pro license can be found in the "Introduction" section of this article. For assistance with matching the camera hardware and IVA Pro licenses to your needs, please contact your Bosch representative.
Bosch offers a forensic search plug-in for Milestone XProtect. How does it differ from the solution presented here?
The solution described here—searching for Bosch camera-detected objects through XProtect Centralized Search—does not require additional plug-ins, providing an out-of-the-box experience. However, one limitation is that it cannot combine object detection with Bosch IVA rules (such as line crossings or loitering). The Bosch forensic search plug-in offers limited object detection for people and vehicles only.
Can this search method be used in a Milestone XProtect Federated Architecture setup?
Yes, this functionality should work in a Federated Architecture setup. As long as live and playback video, along with metadata, are available from a Bosch camera, XProtect Centralized Search will function correctly. If the camera appears in the search dropdown menu, you should be able to execute the search.
Can I run all types of Bosch IVA Pro on a single camera to detect all objects?
No, it is not possible to run all IVA Pro packs simultaneously on one camera. You must select the specific IVA Pro packs that suit your use case. The only exception is the combination of Bosch IVA Pro License Plate Recognition and Car Make/Model, which can run together. For other packs, while multiple licenses can be installed on a single camera, only one can be active at any given time.
... View more