Skip to content

Python Density & Payload Benchmarks - #6897

Open
george-kalisse-sada wants to merge 1 commit into
GoogleCloudPlatform:masterfrom
george-kalisse-sada:SADA_3a_python_payload_benchmarks
Open

Python Density & Payload Benchmarks#6897
george-kalisse-sada wants to merge 1 commit into
GoogleCloudPlatform:masterfrom
george-kalisse-sada:SADA_3a_python_payload_benchmarks

Conversation

@george-kalisse-sada

Copy link
Copy Markdown
Collaborator

Files: 2 new files

  • perfkitbenchmarker/linux_benchmarks/kubernetes/agentic/k8s_python_density_benchmark.py
  • perfkitbenchmarker/linux_benchmarks/kubernetes/agentic/k8s_payload_benchmark.py

Description: Adds two Python-focused GKE Agent Sandbox benchmarks:

Python Density: Measures Code Execution Latency (CEL), TTFE, RSS memory growth, and per-type latency breakdown (compute, syscall, import) at varying concurrent sandbox counts. Designed for density saturation sweeps.

Payload Transfer: Measures the cost of returning large observation payloads from gVisor sandboxes. Breaks down generation, serialization, stdout write, and total transfer time with throughput metrics.

@george-kalisse-sada
george-kalisse-sada force-pushed the SADA_3a_python_payload_benchmarks branch from bdab832 to 445ff49 Compare August 5, 2026 17:40
@roycaihw

roycaihw commented Aug 6, 2026

Copy link
Copy Markdown

/cc @Nishanth29


successful = result.get("successful_sessions", 0)
failed = result.get("failed_sessions", 0)
agg = result.get("aggregate", {})

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If the API returns aggregate as null on an error, agg.get(...) below might throw a NoneType error. maybe we can do agg = result.get("aggregate") or {} instead?


successful = result.get("successful_sessions", 0)
failed = result.get("failed_sessions", 0)
agg = result.get("aggregate", {})

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same here, if aggregate comes back null on a failure, result.get("aggregate", {}) returns None. we can use result.get("aggregate") or {} here too

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants