Expose metrics from MultimodalAgent and RealtimeModel

[davidzhao]

No description provided.

[yuyuma]

It looks like some basic considerations were made for the realtime model with a Usage model defined here:

agents/livekit-plugins/livekit-plugins-openai/livekit/plugins/openai/realtime/api_proto.py

Line 144 in 22f06bf

class Usage(TypedDict):

I just wanted to add that the exposed usage details should include input_token_details and output_token_details. Without those details the 3 existing token numbers are not useful because cached tokens, text tokens, and audio tokens are all priced differently.

Sample usage detail

usage: {
	total_tokens: 330
	input_tokens: 181
	output_tokens: 149
	input_token_details: {
		cached_tokens: 0
		text_tokens: 181
		audio_tokens: 0
	}
	output_token_details: {
		text_tokens: 34
		audio_tokens: 115
	}
}

Thanks in advance

[davidzhao]

please feel free to submit a PR :)

[yuyuma]

@davidzhao done, thanks!

[davidzhao]

MultimodalAgent metrics are in #1080