Rethinking with Retrieval: Faithful Large Language Model Inference

In this paper, we present a post-processing approach called rethinking with retrieval (RR) for utilizing external knowledge in LLMs. Our method begins by using the chain-of-thought (CoT) prompting method (Wei et al., 2022) to generate a diverse set of reasoning paths, as described in Wang et al. (2022). We then use each reasoning step in those paths to retrieve relevant external knowledge, which enables RR to provide more faithful explanations and more accurate predictions, as illustrated in Figure 1.