Spews complete nonsense after any prompt

[Stooovie]

Tried StableLM model with llama inference. This is an answer to "hi!"

{ ========== [EXPL]
| 1) {prompt}

• 2. (1, "2")
     [/EXPL]};
     template <class E, class S>
     struct test_pair {
     typedef pair<E,S> type;
     };

int main(void) {
#define PRINT0(x) cout << #x ": " << x << endl
//PRINTTEST
test_pair<short int, string> a;
cout << "sizeof(std::pair <char, std::basic_string , long, short>) = "; printtest1(a);
}

I have not found any way to get any output that wouldn't be total BS.

[guinmoon]

Hi. Try to disable Mmap and correct prompt template.

[trufae]

this issue is related to this #91