243 max chat history length

[heatherlogan-scottlogic]

I set the max chat history for the session to be 1000 although happy to make larger/smaller.

For the limit of sending tokens to the api, i've used the max token limit per model.
It might help performance to decrease this further and summarise earlier conversion but i've added a separate ticket for this #260

Think it would be useful to performance test this in some way to see if the overhead of token calculation and filtering is worth it

[gsproston-scottlogic]

Great work! Looks super thorough. I am right in saying this doesn't include a limit on the session chat history array? Fine if not but we should raise a new ticket to deal with that.

[heatherlogan-scottlogic]

Great work! Looks super thorough. I am right in saying this doesn't include a limit on the session chat history array? Fine if not but we should raise a new ticket to deal with that.

I've put const maxMessageLength = 1000 on line 385 to limit it - i'll rename that variable actually as it's not the best.

Are you happy with a limit of 1000 or would you prefer another?

[gsproston-scottlogic]

Great work! Looks super thorough. I am right in saying this doesn't include a limit on the session chat history array? Fine if not but we should raise a new ticket to deal with that.

I've put const maxMessageLength = 1000 on line 385 to limit it - i'll rename that variable actually as it's not the best.

Are you happy with a limit of 1000 or would you prefer another?

ahh completely missed that 😅 yeah 1000 is more than enough I reckon.