How to load the tuned backbone?

[tqace]

I trained the model following Training instructions, and the backbone is also fine-tuned, how do I save and load the backbone for further evaluation?

[mmaaz60]

Hi @tqace,

I appreciate your interest in our work. You may have to uncomment the line at

Video-ChatGPT/video_chatgpt/train/llava_trainer.py

Line 48 in 11f10e2

# super(VideoChatGPTTrainer, self)._save(output_dir, state_dict)

to save the complete checkpoints in case if you are fine-tuning the backbone or LLM as well.

Please let me know if it works for you. Thank You.