Retrieval quality should be measured using Precision@k, Recall@k, and MRR on a domain-specific evaluation set so that retrieval effectiveness is quantified with standard ranking metrics in the target domain.

Precision@k, Recall@k, and MRR on a domain-specific evaluation set.

— Beyond Retrieval - Pyrana Context Engine Whitepaper.pdf

8.1 Retrieval quality

— Beyond Retrieval - Pyrana Context Engine Whitepaper.pdf

domain-specific evaluation set

— Beyond Retrieval - Pyrana Context Engine Whitepaper.pdf