Syncing long conversations conversation.item.create

[josancamon19]

I've cached the items conversation, when syncing a page reload, to continue the conversation, or after 15min disconnect.

I tried sending user audio input, assistant text messages, 1 by 1.

The conversations get's received in items.events, but all the audio inputs sent, end up being returned as an empty Int16Array.

const addUserMessageAudio = (id: string, audio: Int16Array, text: string, previousItemId: string | undefined) => {
    console.log('~addUserMessageAudio', { id, text, previousItemId, audioLength: audio.length });
    clientRef.current.realtime.send('conversation.item.create', {
      item: {
        type: 'message',
        role: 'user',
        status: 'completed',
        content: [{ type: 'input_audio', audio: RealtimeUtils.arrayBufferToBase64(audio), transcript: text }],
        // content: [{ type: 'input_text', text: text }], 
      },
    });
  }

And if send the text, then when I speak to the model, it only responds with text, doesn't send any audio at that point.