RAG Pipeline

Retrieval-Augmented Generation.

1 min readEdit this page

Setup

import { RAGPipeline, VectorStore, loadFromText } from '@restjs/ai'
 
const rag = new RAGPipeline({ provider: ai, vectorStore: new VectorStore() })

Index

await rag.index(loadFromText(['REstJS supports PostgreSQL...']))

Query

const result = await rag.query('What databases are supported?')
result.response  // generated answer
result.sources   // documents used

Stream

for await (const event of rag.queryStream('Tell me about auth')) {
  if (event.type === 'sources') console.log(event.data)
  if (event.type === 'delta') process.stdout.write(event.data)
}