feat(mri): add jobs property to leaderboard#651
Conversation
Co-Authored-By: lino <lino@rapidata.ai>
ReviewThis PR adds a Findings
Nothing else stood out — pagination loop mirrors the existing pattern in |
Co-Authored-By: lino <lino@rapidata.ai>
ReviewThis PR adds a Findings
Nothing else stood out — pagination loop mirrors the existing pattern in |
What
Adds a
jobsproperty toRapidataLeaderboardthat returns a list of all Rapidata jobs that have run for the leaderboard.Why
Each model evaluation on a leaderboard is carried out by a job. Previously there was no way from the SDK to enumerate those jobs (e.g. to pull their individual results). This exposes them directly off the leaderboard object.
How
leaderboard/{id}/runs(100/page, newest first) and collects each run's associatedjobId.RapidataJobviaRapidataJobManager.get_job_by_id, so the returned objects are fully usable (get_results(),get_status(), etc.).Docs (
docs/mri.md) updated with a short usage snippet.pyright src/rapidata/rapidata_clientclean;blackformatted.Usage
🔗 Session: https://session-ed5c819e.poseidon.rapidata.internal/