Streaming RAG: which architecture when documents and questions arrive at the same time
In a textbook RAG the corpus sleeps and indexing runs overnight. As soon as documents and questions arrive as streams, index freshness becomes a latency constraint. Three architectures, their millisecond budget, and the one that holds in production.