RAG

• RAG stands for Retrieval Augmented Generation
• At a high level RAG retrieves contextually relevant information from a collection of documents held in a data store outside the model (typically a vector store) and appends that context to the prompt that is ultimately sent to the large language model

---

Related §

• RAG and Fine-Tuning

---

Refs §

1. https://www.konko.ai/post/long-context-windows-vs-rag-for-information-retrieval-use-cases