Skip to content

Update APM SDK benchmarks reference - #12220

Open
dd-octo-sts[bot] wants to merge 1 commit into
masterfrom
ci/update-apm-sdks-benchmarks-reference-20260816
Open

Update APM SDK benchmarks reference#12220
dd-octo-sts[bot] wants to merge 1 commit into
masterfrom
ci/update-apm-sdks-benchmarks-reference-20260816

Conversation

@dd-octo-sts

@dd-octo-sts dd-octo-sts Bot commented Aug 16, 2026

Copy link
Copy Markdown
Contributor

What Does This Do

This PR updates the pinned apm-sdks-benchmarks GitLab CI includes and runtime clones to
DataDog/apm-sdks-benchmarks@90cf5c67a3e68ce369d31c0d7a750016f97f61a0.

Motivation

Keep Java SDK benchmarks current while retaining reproducible CI configuration.

Contributor Checklist

  • Verify CI passes successfully

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
@dd-octo-sts dd-octo-sts Bot added type: feature Enhancements and improvements comp: testing Testing tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels Aug 16, 2026
@dd-octo-sts
dd-octo-sts Bot requested review from a team as code owners August 16, 2026 04:16
@dd-octo-sts
dd-octo-sts Bot requested review from randomanderson and sarahchen6 and removed request for a team August 16, 2026 04:16
@datadog-prod-us1-4

This comment has been minimized.

@dd-octo-sts

dd-octo-sts Bot commented Aug 16, 2026

Copy link
Copy Markdown
Contributor Author

🟢 Java Benchmark SLOs — All performance SLOs passed

Suite Status
Startup 🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results
Scenario Candidate master Δ (95% CI of mean)
startup:insecure-bank:iast:Agent 14.85 s 14.67 s [+0.4%; +2.0%] (maybe worse)
startup:insecure-bank:tracing:Agent 13.64 s 13.76 s [-1.8%; +0.0%] (no difference)
startup:petclinic:appsec:Agent 17.49 s 17.25 s [+0.5%; +2.3%] (maybe worse)
startup:petclinic:iast:Agent 16.83 s 17.51 s [-8.1%; +0.4%] (no difference)
startup:petclinic:profiling:Agent 17.42 s 17.25 s [-0.3%; +2.2%] (no difference)
startup:petclinic:sca:Agent 17.41 s 17.34 s [-0.6%; +1.4%] (no difference)
startup:petclinic:tracing:Agent 16.57 s 16.22 s [-3.5%; +7.9%] (unstable)

Commit: 4dd9ca4d · CI Pipeline · Benchmarking Platform UI


Load and DaCapo benchmarks can be triggered manually in the GitLab pipeline. Results will appear in the Benchmarking Platform UI after completion.

@datadog-prod-us1-4 datadog-prod-us1-4 Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Datadog Autotest: PASS

More details

The new benchmark pin descends from the prior pin, retains all five referenced Java CI files, and leaves the Java benchmark and runtime-clone contracts unchanged. The shared YAML anchor propagates the new SHA consistently to every include and clone consumer.

Was this helpful? React 👍 or 👎

Open Bits AI session

🤖 Datadog Autotest · Commit 4dd9ca4 · What is Autotest? · @DataDog review to ask questions · Any feedback? Reach out in #autotest

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: testing Testing tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes type: feature Enhancements and improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants