Inference with MCTS

[garipovroma]

Hello, thank you for your work and contributions to the community.

I’ve recently developed an interest in your work and took a closer look at your code. However, I couldn’t find the code for inference with MCTS. Could you kindly upload it if possible?

[zwq2018]

yeah, very confused. It seems that there is no MCTS at all in the inference stage.

[Blacknana]

I have the same confusion. Could you please give an example of MCTS inference? And I'm interested in integrating it into open-source LLM serving like SGLang or vLLM.

[cjx-1234]

i have found a wonderful implementation for inference with MCTS from AlphaMath and its paper. btw, this paper have proposed step-level beam search algorithm which is more efficient and effective than MCTS in inference.