The interactive program in the tutorial does not work properly.

[ksw-1024]

I ran the interactive program in the tutorial without modification and got anomalous output.
What problems may be occurring?

Output:

2023-05-12 09:58:12.596296: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
[2023-05-12 09:58:20,552] {utils.py:148} INFO - Note: NumExpr detected 12 cores but "NUMEXPR_MAX_THREADS" not set, so enforcing safe limit of 8.
[2023-05-12 09:58:20,552] {utils.py:160} INFO - NumExpr defaulting to 8 threads.
gptj_model_load: loading model from './GPT4ALL/models/ggml-gpt4all-j-v1.3-groovy.bin' - please wait ...
gptj_model_load: n_vocab = 50400
gptj_model_load: n_ctx   = 2048
gptj_model_load: n_embd  = 4096
gptj_model_load: n_head  = 16
gptj_model_load: n_layer = 28
gptj_model_load: n_rot   = 64
gptj_model_load: f16     = 2
gptj_model_load: ggml ctx size = 4505.45 MB
gptj_model_load: memory_size =   896.00 MB, n_mem = 57344
gptj_model_load: ................................... done
gptj_model_load: model size =  3609.38 MB / num tensors = 285
You: Please let me know what the weather will be like tomorrow.
AI:
You: Please let me know what the weather will be like tomorrow.
AI:
You: Please let me know what the weather will be like tomorrow.
AI:Please let me know what the weather will be like tomorrow.Please let me know what the weather will be like tomorrow.Please let me know what the weather will be like tomorrow.Please let me know what the weather will be like tomorrow.Please let me know what the weather will be like tomorrow.Please let me know what the weather will be like tomorrow.Please let me know what the weather will be like tomorrow.Please let me know what the weather will be like tomorrow.Please let me know what the weather will be like tomorrow.Please let me know what the weather will be like tomorrow.Please let me know what the weather will be like tomorrow.Please let me know what the weather will be like tomorrow.Please let me know what the weather will be like tomorrow.Please^C

PS: The output goes on forever, so I force quit with Control+C.

Code:

from pygpt4all import GPT4All_J
from transformers import pipeline

model = GPT4All_J('./GPT4ALL/models/ggml-gpt4all-j-v1.3-groovy.bin')

while True:
    try:
        prompt = input("You: ")
        if prompt == '':
            continue
        print(f"AI:", end='')
        for token in model.generate(prompt):
            print(f"{token}", end='', flush=True)
        print()
    except KeyboardInterrupt:
        break