MQTT ONVIF integration

[madik7]

Hello,
We are working on integrating metadata from AXIS cameras with our systems based on the MQTT protocol. We have assumed that your devices support ONVIF profiles M.
We are performing the integration based on the AXIS P3265-LVE Dome Camera - 9mm, Axis OS: 11.11.73

1. Please let me know if we have correctly established the path forcing the sending of metadata via MQTT.

Step 1: send the AddEventBroker command via ONVIF with the correct MQTT Broker settings (after executing this command, messages arrive via MQTT but there is no VideoAnalytics topic with metadata messages)
Step 2: Query via VAPIX API for a list of feature flags (axis-cgi/featureflag.cgi), enable the selected_metadata_events flag (after executing this step, messages arrive from VideoAnalytics but without an image)
Step 3: Enable best snapshot using the config/rest/best-snapshot/v1/enabled endpoint (after executing this command, an image of the detection slice appears in the message)

Is this path correct and contains all the required operations? Can it be simplified? Is it possible to limit this entire configuration only to commands using ONVIF?

2. The structure of the message we receive after MQTT looks like this (I removed the data to make the json more readable):

{
  "UtcTime": "2024-09-06T09:21:22.324656Z",
  "Source": {},
  "Data": {
    "observations": "",
	"image": "",
    "classes": "",
    "id": "f4485df9-63f8-474a-8dba-4f2ca27f6b9c",
    "start_time": "2024-09-06T09:21:10.365929Z",
    "end_time": "2024-09-06T09:21:21.465862Z",
    "duration": "11.099900"
  }
}

However, in the ONVIF specification (https://www.onvif.org/specs/srv/analytics/ONVIF-Analytics-Service-Spec.pdf) the example indicates a different structure:

{
    "Frame": [{
            "@UtcTime": "2021-10-05T15:13:27.321",
            "@Source": "MyClassifier",
            "@context": {
                "acme": "http://www.acme.com/schema"
            },
            "Transformation": {
                "Translate": {
                    "@x": -1.0,
                    "@y": -1.0
                },
                "Scale": {
                    "@x": 0.003125,
                    "@y": 0.00416667
                }
            },
            "Object": [{
                    "@ObjectId": 15,
                    "Appearance": {
                        "Shape": {
                            "BoundingBox": {
                                "@left": 20.0,
                                "@top": 80.0,
                                "@right": 100.0,
                                "@bottom": 30.0
                            },
                            "CenterOfGravity": {
                                "@x": 60.0,
                                "@y": 50.0
                            },
                            "Polygon": {
                                "Point": [{
                                        "@x": 20.0,
                                        "@y": 30.0
                                    }, {
                                        "@x": 100.0,
                                        "@y": 30.0
                                    }, {
                                        "@x": 100.0,
                                        "@y": 80.0
                                    }, {
                                        "@x": 20.0,
                                        "@y": 80.0
                                    }
                                ]
                            }
                        },
                        "Color": {
                            "ColorCluster": [{
                                    "Color": {
                                        "@X": 213,
                                        "@Y": 135,
                                        "@Z": 126
                                    },
                                    "Weight": 0.9,
                                    "acme:ColorName": "White"
                                }, {
                                    "Color": {
                                        "@X": 102,
                                        "@Y": 176,
                                        "@Z": 119
                                    },
                                    "Weight": 0.5,
                                    "acme:ColorName": "Blue"
                                }
                            ]
                        },
                        "Class": {
                            "Type": [{
                                    "@Likelihood": 0.8,
                                    "#text": "Human"
                                }
                            ]
                        },
                        "HumanFace": {
                            "Gender": "Male",
                            "Age": {
                                "Min": 20,
                                "Max": 30
                            },
                            "Accessory": {
                                "Opticals": {
                                    "Wear": true
                                },
                                "Hat": {
                                    "Wear": true
                                }
                            }
                        },
                        "HumanBody": {
                            "Clothing": {
                                "Tops": {
                                    "Category": "LongSleeve"
                                },
                                "Bottoms": {
                                    "Category": "Shorts"
                                }
                            },
                            "Belonging": {
                                "Bag": {
                                    "Category": "Backpack"
                                }
                            }
                        }
                    }
                }
            ]
        }
    ]
}

Why is there such a difference in structure? Is it a matter of camera settings?

[github-actions[bot]]

This automatically generated reply acts as a friendly reminder.

Answers to your questions will most often come from the community, from developers like yourself. You will, from time to time, find that Axis employees answers some of the questions, but this is not a guarantee. Think of the discussion forum as a complement to other support channels, not a replacement to any of them.

If your question remains unanswered for a period of time, please revisit it to see whether it can be improved by following the guidelines listed in Axis support guidelines.

[vivekatoffice]

Hi @madik7 ,
I can see that AXIS P3265-LVE Dome Camera supports Profile M:

But here in FeatureList it shows MetadataOverMQTT="false" 😢

Reference: ONVIF™ ONVIF Core Specification Version 23.12 December, 2023

Maybe you need to wait for future Axis OS releases to use MetadataOverMQTT? 🤔

[bsriramprasad]

Ref: onvif-profile-m-specification

• ONVIF Profile M conformant device are NOT expected to support metadata over MQTT as Profile M if supported by device to support events over MQTT.