benchmark_term_ranking_fixtures

benchmark_term_ranking_fixtures(
    fixture_path=None,
    profiles=None,
    top_k=3,
    include_details=True,
    fixture_path_override=None,
)

Evaluate deterministic term ranking against versioned fixtures.

Parameters

Name Type Description Default
fixture_path Optional[str] JSON fixture path. Uses the packaged fixture path when omitted. None
profiles Optional[dict] Named profile mapping included in the benchmark result. None
top_k int Rank threshold used for top-k accuracy. 3
include_details bool Include one result row per case when True. True
fixture_path_override Optional[list] In-memory fixture list for tests. None

Returns

Name Type Description
dict Summary metrics, optional per-case results, and the supplied profiles.
Back to top