Skip to content

Bump autoevals from 0.0.131 to 0.3.0#110

Merged
Abhijeet Prasad (AbhiPrasad) merged 1 commit into
mainfrom
dependabot/npm_and_yarn/autoevals-0.3.0
Jul 8, 2026
Merged

Bump autoevals from 0.0.131 to 0.3.0#110
Abhijeet Prasad (AbhiPrasad) merged 1 commit into
mainfrom
dependabot/npm_and_yarn/autoevals-0.3.0

Conversation

@dependabot

@dependabot dependabot Bot commented on behalf of github Jul 6, 2026

Copy link
Copy Markdown
Contributor

Bumps autoevals from 0.0.131 to 0.3.0.

Release notes

Sourced from autoevals's releases.

autoevals JavaScript v0.3.0

What's Changed

Full Changelog: braintrustdata/autoevals@py-0.3.0...js-0.3.0

autoevals Python v0.3.0

What's Changed

New Contributors

Full Changelog: braintrustdata/autoevals@py-0.2.0...py-0.3.0

autoevals Python v0.2.0

What's Changed

... (truncated)

Commits
Maintainer changes

This version was pushed to npm by GitHub Actions, a new releaser for autoevals since your current version.

Install script changes

This version adds preinstall script that runs during installation. Review the package contents before updating.


@dependabot dependabot Bot added dependencies Pull requests that update a dependency file javascript Pull requests that update Javascript code labels Jul 6, 2026
@github-actions

github-actions Bot commented Jul 6, 2026

Copy link
Copy Markdown

Braintrust eval report

Evals failed: Error: Command failed with exit code 1

@github-actions

github-actions Bot commented Jul 6, 2026

Copy link
Copy Markdown

Braintrust eval report

Evals failed: Error: Command failed with exit code 1

@github-actions

github-actions Bot commented Jul 6, 2026

Copy link
Copy Markdown

Braintrust eval report

Evals failed: Error: Command failed with exit code 1

@github-actions

github-actions Bot commented Jul 6, 2026

Copy link
Copy Markdown

Braintrust eval report

Evals failed: Error: Command failed with exit code 1

@AbhiPrasad

Copy link
Copy Markdown
Member

Dependabot (@dependabot) rebase

@dependabot dependabot Bot force-pushed the dependabot/npm_and_yarn/autoevals-0.3.0 branch 2 times, most recently from 47e9ea2 to f9f471f Compare July 8, 2026 17:49
@AbhiPrasad

Copy link
Copy Markdown
Member

Dependabot (@dependabot) rebase

Bumps [autoevals](https://github.com/braintrustdata/autoevals) from 0.0.131 to 0.3.0.
- [Release notes](https://github.com/braintrustdata/autoevals/releases)
- [Changelog](https://github.com/braintrustdata/autoevals/blob/main/CHANGELOG.md)
- [Commits](https://github.com/braintrustdata/autoevals/commits/js-0.3.0)

---
updated-dependencies:
- dependency-name: autoevals
  dependency-version: 0.3.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot dependabot Bot force-pushed the dependabot/npm_and_yarn/autoevals-0.3.0 branch from f9f471f to ebf48d1 Compare July 8, 2026 17:53
@AbhiPrasad Abhijeet Prasad (AbhiPrasad) merged commit 040f367 into main Jul 8, 2026
5 of 9 checks passed
@dependabot dependabot Bot deleted the dependabot/npm_and_yarn/autoevals-0.3.0 branch July 8, 2026 17:54
@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown

Braintrust eval report

Say Hi Bot Python (main-1783533305)

Score Average Improvements Regressions
Levenshtein 77.8% (+0pp) - -
Llm_calls 0 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 0tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 0tok (+0tok) - -
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 0tok (+0tok) - -
Duration 0s (0s) 2 🟢 -

@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown

Braintrust eval report

Say Hi Bot Python (main-1783533306)

Score Average Improvements Regressions
Levenshtein 77.8% (+0pp) - -
Llm_calls 0 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 0tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 0tok (+0tok) - -
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 0tok (+0tok) - -
Duration 0s (+0s) - 2 🔴

@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown

Braintrust eval report

Console logging (main-1783533311)

Score Average Improvements Regressions
Levenshtein 100% (+0pp) - -
Llm_calls 0 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 0tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 0tok (+0tok) - -
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 0tok (+0tok) - -
Duration 0s (+0s) - 20 🔴

My Evaluation (main-1783533311)

Score Average Improvements Regressions
Exact match 100% (+0pp) - -
Llm_calls 0 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 10tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 2tok (+0tok) - -
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 12tok (+0tok) - -
Duration 0.1s (-0.77s) 1 🟢 -

Say Hi Bot (main-1783533311)

Score Average Improvements Regressions
Levenshtein 100% (+0pp) - -
Llm_calls 0 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 0tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 0tok (+0tok) - -
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 0tok (+0tok) - -
Duration 1s (+0s) 3 🟢 17 🔴

@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown

Braintrust eval report

Say Hi Bot (main-1783533312)

Score Average Improvements Regressions
Levenshtein 100% (+0pp) - -
Llm_calls 0 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 0tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 0tok (+0tok) - -
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 0tok (+0tok) - -
Duration 1s (0s) 15 🟢 3 🔴

@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown

Braintrust eval report

Say Hi Bot (main-1783533321)

Score Average Improvements Regressions
Levenshtein 100% (+0pp) - -
Llm_calls 0 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 0tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 0tok (+0tok) - -
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 0tok (+0tok) - -
Duration 1s (0s) 8 🟢 1 🔴

@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown

Braintrust eval report

Say Hi Bot Python (abhijeet@braintrustdata.com-1783533569-f06f364f)

Score Average Improvements Regressions
Levenshtein 77.8% (+0pp) - -
Llm_calls 0 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 0tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 0tok (+0tok) - -
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 0tok (+0tok) - -
Duration 0s (0s) 2 🟢 -

@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown

Braintrust eval report

Say Hi Bot Python (abhijeet@braintrustdata.com-1783533570)

Score Average Improvements Regressions
Levenshtein 77.8% (+0pp) - -
Llm_calls 0 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 0tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 0tok (+0tok) - -
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 0tok (+0tok) - -
Duration 0s (0s) 2 🟢 -

@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown

Braintrust eval report

Say Hi Bot Python (abhijeet@braintrustdata.com-1783533569)

Score Average Improvements Regressions
Levenshtein 77.8% (+0pp) - -
Llm_calls 0 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 0tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 0tok (+0tok) - -
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 0tok (+0tok) - -
Duration 0s (0s) 2 🟢 -

@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown

Braintrust eval report

Say Hi Bot Python (abhijeet@braintrustdata.com-1783533569-c58f7c3d)

Score Average Improvements Regressions
Levenshtein 77.8% (+0pp) - -
Llm_calls 0 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 0tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 0tok (+0tok) - -
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 0tok (+0tok) - -
Duration 0s (0s) 1 🟢 1 🔴

@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown

Braintrust eval report

Say Hi Bot (HEAD-1783533578)

Score Average Improvements Regressions
Levenshtein 100% (+0pp) - -
Llm_calls 0 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 0tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 0tok (+0tok) - -
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 0tok (+0tok) - -
Duration 1s (+0s) 4 🟢 9 🔴

@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown

Braintrust eval report

Say Hi Bot (HEAD-1783533581)

Score Average Improvements Regressions
Levenshtein 100% (+0pp) - -
Llm_calls 0 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 0tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 0tok (+0tok) - -
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 0tok (+0tok) - -
Duration 1s (+0s) 1 🟢 16 🔴

@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown

Braintrust eval report

Console logging (HEAD-1783533581)

Score Average Improvements Regressions
Levenshtein 100% (+0pp) - -
Llm_calls 0 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 0tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 0tok (+0tok) - -
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 0tok (+0tok) - -
Duration 0s (0s) 20 🟢 -

My Evaluation (HEAD-1783533581)

Score Average Improvements Regressions
Exact match 100% (+0pp) - -
Llm_calls 0 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 10tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 2tok (+0tok) - -
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 12tok (+0tok) - -
Duration 0.9s (+0.8s) - 1 🔴

Say Hi Bot (HEAD-1783533581-90de8adb)

Score Average Improvements Regressions
Levenshtein 100% (+0pp) - -
Llm_calls 0 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 0tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 0tok (+0tok) - -
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 0tok (+0tok) - -
Duration 1s (0s) 19 🟢 -

@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown

Braintrust eval report

Console logging (HEAD-1783533582)

Score Average Improvements Regressions
Levenshtein 100% (+0pp) - -
Llm_calls 0 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 0tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 0tok (+0tok) - -
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 0tok (+0tok) - -
Duration 0s (+0s) - -

My Evaluation (HEAD-1783533582)

Score Average Improvements Regressions
Exact match 100% (+0pp) - -
Llm_calls 0 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 10tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 2tok (+0tok) - -
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 12tok (+0tok) - -
Duration 0.05s (-0.84s) 1 🟢 -

Say Hi Bot (HEAD-1783533582)

Score Average Improvements Regressions
Levenshtein 100% (+0pp) - -
Llm_calls 0 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 0tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 0tok (+0tok) - -
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 0tok (+0tok) - -
Duration 1s (+0s) 2 🟢 5 🔴

@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown

Braintrust eval report

Say Hi Bot (HEAD-1783533586)

Score Average Improvements Regressions
Levenshtein 100% (+0pp) - -
Llm_calls 0 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 0tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 0tok (+0tok) - -
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 0tok (+0tok) - -
Duration 1s (+0s) 1 🟢 18 🔴

@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown

Braintrust eval report

Say Hi Bot (HEAD-1783533591)

Score Average Improvements Regressions
Levenshtein 100% (+0pp) - -
Llm_calls 0 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 0tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Prompt_cache_creation_5m_tokens 0tok (+0tok) - -
Prompt_cache_creation_1h_tokens 0tok (+0tok) - -
Completion_tokens 0tok (+0tok) - -
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 0tok (+0tok) - -
Duration 1s (+0s) 1 🟢 18 🔴

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file javascript Pull requests that update Javascript code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant