"Conversation already has an active response" error with MultimodalAgent

[davidzhao]

We've gotten reports in Slack that when certain function calls are used with MultimodalAgent, it would sometimes error out with:

2024-11-07 17:14:37,898 - ERROR livekit.plugins.openai.realtime - OpenAI S2S error {'type': 'error', 'event_id': 'event_AR7s53avu18NBq2Lk5O4r', 'error': {'type': 'invalid_request_error', 'code': None, 'message': 'Conversation already has an active response', 'param': None, 'event_id': None}} {"session_id": "sess_AR7r1ss6nsPVlPETCgFxi"}

It'd be great if anyone could produce a path to reproducing the error.