Metacognitive Capabilities of LLMs: An Exploration in Mathematical Problem Solving
The research developed a prompt-guided method to help LLMs discover and use their own mathematical skills. The process involves having an LLM label many skills, then grouping them into coarse skill families. This creates a repository of skill examples that the model can use during problem-solving, leading to significant performance improvements.