“A promising but yet-to-be-proven application for process reward models is to guide a tree search algorithm during inference, allowing the model to explore multiple reasoning paths.”