gammabench αLoop benchmark evidence
Source ↗

Captured measurements · source evidence

Benchmark evidence

Verified snapshots · explicit work contracts · paired comparisons

discovery · Gate outcome: Passed. Numerical qualification uses the retained tolerances and reference outputs.

Columns

Qualified cells lead with a candidate/reference multiplier, with captured medians below. Observed ranges and qualification are available in Details. Colours compare each workload with its selected reference, using qualified matched sample pairs. Select an original recorded comparison set for stored paired ratios. Latest available captures show absolute values only. Different contracts and timing boundaries have separate matrices.

2× worse Reference · 1× 2× better Unranked / unavailable

gammaloop-107135ddd4989a1980809a17a15d0d4cd002fff3-39425855540-1-gl04-q1-squared-ltd-vs-cff-4d-discovery · Generation time

Hyperfine 2.0.0 complete generation CLI process including import and state save · fixed-point-integrand-v1 · Lower is better

What this measurement includes

Finite nonzero integrands agree within the declared tolerance across revisions and requested evaluators

Included: Fresh generated state; Declared evaluator implementations; Fixed-point numerical validation

Excluded: CLI compilation; Point caching; Event processing

WorkloadGammaLoop
Native
2026-10-20 Capture role: baseline2026-10-20 Capture role: candidate
gl04-q1-squared-ltd-vs-cff-4dSelect a reference
0.57 s
Details

baseline · measured · gammaloop-107135ddd4989a1980809a17a15d0d4cd002fff3-39425855540-1-gl04-q1-squared-ltd-vs-cff-4d-discovery

Observed range: 0.56 s – 0.61 s

5 completed samples · 0 warmups excluded

Qualification: passed

Measurement statuses: {
"completed": 5
} · 0 missing values

Select a reference
0.31 s
Details

candidate · measured · gammaloop-107135ddd4989a1980809a17a15d0d4cd002fff3-39425855540-1-gl04-q1-squared-ltd-vs-cff-4d-discovery

Observed range: 0.31 s – 0.31 s

5 completed samples · 0 warmups excluded

Qualification: passed

Measurement statuses: {
"completed": 5
} · 0 missing values

GammaLoop / Native · 107135ddd4 · gammaloop-107135ddd4989a1980809a17a15d0d4cd002fff3-39425855540-1-gl04-q1-squared-ltd-vs-cff-4d-discovery: comparable; 5 matched pairs; candidate/reference median ratio 0.5465961058223224

Unsupported, failed and censored work

These records stay visible when the measurement or reference changes. They are not zero timings. Qualification timeouts do not bound a different measured stage.

    Detailed measurements and evidence

    Measurement CSV · Comparison CSV · Unsupported / censored CSV · Analysis JSON · Report checksums

    How to read these results

    • Observed ranges describe the captured samples, not confidence intervals.
    • Profile scopes may cover more work than completion metrics; inclusive costs are not additive phases.

    Summary medians use completed measurement samples. Warmups are excluded. Timeouts and missing samples remain visible and suppress pair rankings. Ratios are candidate / baseline; speedup above 1 favours the candidate using the metric’s declared direction. Ratios require declared semantic qualification, equal contracts and metric scopes, and complete matching rounds. Baseline selection filters precomputed comparisons; the browser does not calculate statistics. Metric and baseline filters leave unsupported and censored work visible.

    Measurements

    CaseEngine / variant · snapshotContractMetricMeasured scopeMedianObserved rangeUnitSamplesQualificationOrigin
    gl04-q1-squared-ltd-vs-cff-4dgammaloop / baseline · gammaloop-107135ddd4989a1980809a17a15d0d4cd002fff3-39425855540-1-gl04-q1-squared-ltd-vs-cff-4d-discoveryfixed-point-integrand-v1generation_secondsHyperfine 2.0.0 complete generation CLI process including import and state save0.5679892350.564677283 – 0.610259006s5 (5 completed); 0 warmups excludedpassedmeasured
    gl04-q1-squared-ltd-vs-cff-4dgammaloop / baseline · gammaloop-107135ddd4989a1980809a17a15d0d4cd002fff3-39425855540-1-gl04-q1-squared-ltd-vs-cff-4d-discoveryfixed-point-integrand-v1warm_runtime_seconds_per_sample.SingleParametricMean native warmed seconds per sample over the fixed corpus; ten warmup samples excluded0.00556369678754198550.0055547093849941005 – 0.0055858670839998925s/sample5 (5 completed); 0 warmups excludedpassedmeasured
    gl04-q1-squared-ltd-vs-cff-4dgammaloop / candidate · gammaloop-107135ddd4989a1980809a17a15d0d4cd002fff3-39425855540-1-gl04-q1-squared-ltd-vs-cff-4d-discoveryfixed-point-integrand-v1generation_secondsHyperfine 2.0.0 complete generation CLI process including import and state save0.3104607040.306298492 – 0.314868126s5 (5 completed); 0 warmups excludedpassedmeasured
    gl04-q1-squared-ltd-vs-cff-4dgammaloop / candidate · gammaloop-107135ddd4989a1980809a17a15d0d4cd002fff3-39425855540-1-gl04-q1-squared-ltd-vs-cff-4d-discoveryfixed-point-integrand-v1warm_runtime_seconds_per_sample.SingleParametricMean native warmed seconds per sample over the fixed corpus; ten warmup samples excluded0.0055237204927879670.005509151807023754 – 0.005532612106919777s/sample5 (5 completed); 0 warmups excludedpassedmeasured

    Paired comparisons

    CaseBaselineCandidateMetricStatusMedian ratioObserved ratio rangeMedian speedupPairsNotes
    gl04-q1-squared-ltd-vs-cff-4dgammaloop / baseline · gammaloop-107135ddd4989a1980809a17a15d0d4cd002fff3-39425855540-1-gl04-q1-squared-ltd-vs-cff-4d-discoverygammaloop / candidate · gammaloop-107135ddd4989a1980809a17a15d0d4cd002fff3-39425855540-1-gl04-q1-squared-ltd-vs-cff-4d-discoverygeneration_secondscomparable0.54659610582232240.5159581798945218 – 0.55670328958496461.8295044354470065Same recorded host
    gl04-q1-squared-ltd-vs-cff-4dgammaloop / baseline · gammaloop-107135ddd4989a1980809a17a15d0d4cd002fff3-39425855540-1-gl04-q1-squared-ltd-vs-cff-4d-discoverygammaloop / candidate · gammaloop-107135ddd4989a1980809a17a15d0d4cd002fff3-39425855540-1-gl04-q1-squared-ltd-vs-cff-4d-discoverywarm_runtime_seconds_per_sample.SingleParametriccomparable0.99315829101077880.9888743161487072 – 0.99401819595380131.00688884043072175Same recorded host

    Unsupported, failed and censored work

    These entries are not zero timings. Qualification timeouts do not establish a lower bound on a different measured stage.

    CaseEngineVariantSnapshotStageStatusReason / timing interpretationCap (seconds)Observed process duration (ns)Origin

    Contracts, versions and source evidence

    gammaloop-107135ddd4989a1980809a17a15d0d4cd002fff3-39425855540-1-gl04-q1-squared-ltd-vs-cff-4d-discovery · measured · 2026-10-20T13:25:18.265578+00:00

    snapshot · suite · hashes

    fixed-point-integrand-v1

    Finite nonzero integrands agree within the declared tolerance across revisions and requested evaluators

    Included

    • Fresh generated state
    • Declared evaluator implementations
    • Fixed-point numerical validation

    Excluded

    • CLI compilation
    • Point caching
    • Event processing

    Pinned tools

    {
      "baseline": {
        "kind": "executable",
        "path": "/nix/store/lnzgk5glyd17fh7kdbz1546xw8wac2gi-gammaloop-api-0.1.0/bin/gammaloop",
        "sha256": "d2d0b63736427da8db31d6e8fd9a46adb54ea1a7e4079f5f2330b71ba8da01df",
        "tool_path": "/nix/store/lnzgk5glyd17fh7kdbz1546xw8wac2gi-gammaloop-api-0.1.0/bin/gammaloop",
        "version": "107135ddd4989a1980809a17a15d0d4cd002fff3"
      },
      "candidate": {
        "kind": "executable",
        "path": "/nix/store/lnzgk5glyd17fh7kdbz1546xw8wac2gi-gammaloop-api-0.1.0/bin/gammaloop",
        "sha256": "d2d0b63736427da8db31d6e8fd9a46adb54ea1a7e4079f5f2330b71ba8da01df",
        "tool_path": "/nix/store/lnzgk5glyd17fh7kdbz1546xw8wac2gi-gammaloop-api-0.1.0/bin/gammaloop",
        "version": "107135ddd4989a1980809a17a15d0d4cd002fff3"
      },
      "hyperfine": {
        "kind": "executable",
        "path": "/nix/store/9ik81ccnqn0jlyx9qlcm767k1h09ydhd-hyperfine-2.0.0/bin/hyperfine",
        "sha256": "9b06d88ff2c903bfb07c3c5608c1ca978ada941b0190039a50d73f6379b7363b",
        "tool_path": "/nix/store/9ik81ccnqn0jlyx9qlcm767k1h09ydhd-hyperfine-2.0.0/bin/hyperfine",
        "version": "2.0.0"
      },
      "python": {
        "kind": "executable",
        "path": "/nix/store/wj1f56qky4pmjc7l0r6b6l7whnnw7hp6-python3-3.13.15/bin/python3",
        "sha256": "8b1577236d1a77db304db9fa3515423c3edf836b20ef8102215d77e8f35b3489",
        "tool_path": "/nix/store/wj1f56qky4pmjc7l0r6b6l7whnnw7hp6-python3-3.13.15/bin/python3.13",
        "version": "3.13.15"
      }
    }

    Recorded host

    {
      "available_affinity": [
        0,
        1,
        2,
        3
      ],
      "cpu": "x86_64",
      "cpu_count": 4,
      "cpu_model": "INTEL(R) XEON(R) PLATINUM 8573C",
      "exclusive_cpu_reservation": false,
      "hostname": "runnervmxehtw",
      "load_average_start": [
        1.2568359375,
        1.16455078125,
        1.158203125
      ],
      "machine": "x86_64",
      "platform": "Linux-7.0.0-1017-azure-x86_64-with-glibc2.42",
      "python": "3.13.15",
      "python_executable": "/nix/store/wj1f56qky4pmjc7l0r6b6l7whnnw7hp6-python3-3.13.15/bin/python3",
      "python_sha256": "8b1577236d1a77db304db9fa3515423c3edf836b20ef8102215d77e8f35b3489",
      "runner_image": "20261018.339.1",
      "selected_affinity": null,
      "shared_host": true
    }

    Schedule and provenance

    {
      "schedule": {
        "pairing_id": "gammaloop-107135ddd4989a1980809a17a15d0d4cd002fff3-39425855540-1-gl04-q1-squared-ltd-vs-cff-4d-discovery",
        "repeats": 5,
        "selected_tasks": [
          "baseline",
          "candidate"
        ],
        "warmups": 0
      },
      "provenance": {
        "adapter_sha256": "64e0900ef0fb0be8d8334cee648219d9b88acc16a5fe4ed4554de43f7d211da9",
        "build": {
          "baseline": {
            "context": {
              "cargo_lock_sha256": "c4555422fff8594bf12b96ca799cab842502fd2831ad9237fa200ceba46224c7",
              "flake_lock_sha256": "e10c5893b513d4c7120d841b47fbfddffb3ac4f1f5cb46a18c0f7542cbde8534",
              "profiles": {
                "bench": {
                  "lto": "fat",
                  "opt-level": 3
                },
                "ci-optim": {
                  "debug": false,
                  "inherits": "dev-optim"
                },
                "dev-optim": {
                  "inherits": "dev",
                  "opt-level": 2,
                  "package": {
                    "*": {
                      "opt-level": 3
                    },
                    "gammaloop-api": {
                      "opt-level": 2
                    },
                    "gammaloop-workspace-hack": {
                      "opt-level": 3
                    },
                    "gammalooprs": {
                      "opt-level": 2
                    }
                  }
                },
                "docs": {
                  "debug": false,
                  "inherits": "dev"
                },
                "docs-watch": {
                  "debug": false,
                  "inherits": "dev",
                  "package": {
                    "*": {
                      "opt-level": 2
                    }
                  }
                },
                "profiling": {
                  "debug": true,
                  "inherits": "release",
                  "lto": "fat",
                  "opt-level": 3
                },
                "release": {
                  "lto": "fat"
                }
              },
              "system": "x86_64-linux"
            },
            "package": "/nix/store/lnzgk5glyd17fh7kdbz1546xw8wac2gi-gammaloop-api-0.1.0",
            "store": {
              "/nix/store/lnzgk5glyd17fh7kdbz1546xw8wac2gi-gammaloop-api-0.1.0": {
                "ca": null,
                "deriver": "/nix/store/nvcs1wgqg5khiqn0qabbkdxkqpadxwy4-gammaloop-api-0.1.0.drv",
                "narHash": "sha256-pqmsk2Hj310ILzZNhwfg9+uvq3qUbrv5m0ktQSig0KI=",
                "narSize": 403887416,
                "references": [
                  "/nix/store/604gsr59rj7dzd0nrhp143rpvf7gyiaz-gcc-15.3.0-lib",
                  "/nix/store/lm3pknxi0ipypy3lxh1wmm8wvvavdwrn-glibc-2.42-84",
                  "/nix/store/pqai41045synjbbi7bmhgw2isl46d5ia-gammaloop-crate-gammaloop-api-build-0.1.0",
                  "/nix/store/wj1f56qky4pmjc7l0r6b6l7whnnw7hp6-python3-3.13.15",
                  "/nix/store/zilb1z0hnvjyxyvssp2gqgh3qmfxcxfi-vendor-cargo-deps"
                ],
                "registrationTime": 1792501292,
                "signatures": [],
                "storeDir": "/nix/store",
                "ultimate": true,
                "version": 1
              }
            }
          },
          "candidate": {
            "context": {
              "cargo_lock_sha256": "c4555422fff8594bf12b96ca799cab842502fd2831ad9237fa200ceba46224c7",
              "flake_lock_sha256": "e10c5893b513d4c7120d841b47fbfddffb3ac4f1f5cb46a18c0f7542cbde8534",
              "profiles": {
                "bench": {
                  "lto": "fat",
                  "opt-level": 3
                },
                "ci-optim": {
                  "debug": false,
                  "inherits": "dev-optim"
                },
                "dev-optim": {
                  "inherits": "dev",
                  "opt-level": 2,
                  "package": {
                    "*": {
                      "opt-level": 3
                    },
                    "gammaloop-api": {
                      "opt-level": 2
                    },
                    "gammaloop-workspace-hack": {
                      "opt-level": 3
                    },
                    "gammalooprs": {
                      "opt-level": 2
                    }
                  }
                },
                "docs": {
                  "debug": false,
                  "inherits": "dev"
                },
                "docs-watch": {
                  "debug": false,
                  "inherits": "dev",
                  "package": {
                    "*": {
                      "opt-level": 2
                    }
                  }
                },
                "profiling": {
                  "debug": true,
                  "inherits": "release",
                  "lto": "fat",
                  "opt-level": 3
                },
                "release": {
                  "lto": "fat"
                }
              },
              "system": "x86_64-linux"
            },
            "package": "/nix/store/lnzgk5glyd17fh7kdbz1546xw8wac2gi-gammaloop-api-0.1.0",
            "store": {
              "/nix/store/lnzgk5glyd17fh7kdbz1546xw8wac2gi-gammaloop-api-0.1.0": {
                "ca": null,
                "deriver": "/nix/store/nvcs1wgqg5khiqn0qabbkdxkqpadxwy4-gammaloop-api-0.1.0.drv",
                "narHash": "sha256-pqmsk2Hj310ILzZNhwfg9+uvq3qUbrv5m0ktQSig0KI=",
                "narSize": 403887416,
                "references": [
                  "/nix/store/604gsr59rj7dzd0nrhp143rpvf7gyiaz-gcc-15.3.0-lib",
                  "/nix/store/lm3pknxi0ipypy3lxh1wmm8wvvavdwrn-glibc-2.42-84",
                  "/nix/store/pqai41045synjbbi7bmhgw2isl46d5ia-gammaloop-crate-gammaloop-api-build-0.1.0",
                  "/nix/store/wj1f56qky4pmjc7l0r6b6l7whnnw7hp6-python3-3.13.15",
                  "/nix/store/zilb1z0hnvjyxyvssp2gqgh3qmfxcxfi-vendor-cargo-deps"
                ],
                "registrationTime": 1792501292,
                "signatures": [],
                "storeDir": "/nix/store",
                "ultimate": true,
                "version": 1
              }
            }
          }
        },
        "ci": {
          "baseline": "ff533fcd91d80577e8372c398c17a5924613e73c",
          "candidate": "107135ddd4989a1980809a17a15d0d4cd002fff3",
          "event": "pull_request",
          "framework_revision": "aa05a50c65e79f923a5616f7382b3efa0b71b492",
          "pr": 119,
          "repository": "alphal00p/gammaloop",
          "repository_url": "https://github.com/alphal00p/gammaloop",
          "run_attempt": 1,
          "run_id": 39425855540
        },
        "ci_gate": {
          "identity": {
            "baseline": {
              "commit": "107135ddd4989a1980809a17a15d0d4cd002fff3",
              "config_sha256": "a1c9331b0dc3de9cdfd1e895d0c39c6bf5fe99981ec041cc8acdd9f11e65dbef",
              "corpus_sha256": "91546c7de9b78fac35c1f29dd55d7e08033c13d8e4c40b8719ae2ae1cfbb497c",
              "fixture_sha256": "c8cf76ae153e8e1ae9a88e719ff59f6a6f41b64c6e42b43a94ca620ccf1991ac"
            },
            "candidate": {
              "commit": "107135ddd4989a1980809a17a15d0d4cd002fff3",
              "config_sha256": "a1c9331b0dc3de9cdfd1e895d0c39c6bf5fe99981ec041cc8acdd9f11e65dbef",
              "corpus_sha256": "91546c7de9b78fac35c1f29dd55d7e08033c13d8e4c40b8719ae2ae1cfbb497c",
              "fixture_sha256": "c8cf76ae153e8e1ae9a88e719ff59f6a6f41b64c6e42b43a94ca620ccf1991ac"
            }
          },
          "phase": "discovery",
          "policy": {
            "budget_seconds": 240,
            "certified_zero": {
              "certificate": {
                "id": "gl04-q1-squared-imaginary-v1",
                "sha256": "dfdbc3f2115f7c9e7f5fe1fcf3493029adadd87c109524a6519701080669acec"
              },
              "components": [
                {
                  "absolute_bound": 1.4901161193847656e-8,
                  "index": 1
                },
                {
                  "absolute_bound": 1.4901161193847656e-8,
                  "index": 3
                },
                {
                  "absolute_bound": 1.4901161193847656e-8,
                  "index": 5
                },
                {
                  "absolute_bound": 1.4901161193847656e-8,
                  "index": 7
                }
              ]
            },
            "correctness_format": "number",
            "correctness_tolerance": {
              "absolute": 0.0,
              "relative": 1e-9
            },
            "metric_families": [
              "evaluator_build_seconds",
              "warm_runtime_seconds_per_sample"
            ],
            "output_groups": [
              "SingleParametric"
            ],
            "pairs": 5,
            "reference_group": "SingleParametric",
            "schema_version": 1,
            "thresholds": {
              "generation_seconds": [
                0.5,
                0.5
              ],
              "warm_runtime_seconds_per_sample.SingleParametric": [
                0.5,
                1e-6
              ]
            }
          },
          "report": {
            "certified_zero_components": 4,
            "confirmation_required": 0,
            "correctness_mismatches": 0,
            "identity_mismatch": 0,
            "invalid_input": 0,
            "metrics": {
              "generation_seconds": {
                "discovery": {
                  "absolute_threshold": 0.5,
                  "baseline_median": 0.567989235,
                  "candidate_median": 0.310460704,
                  "median_absolute_delta": -0.257528531,
                  "median_relative_delta": -0.4534038941776776,
                  "pair_count": 5,
                  "paired_absolute_noise": 0.010687987787400028,
                  "paired_noise": 0.014984910646493313,
                  "relative_threshold": 0.5,
                  "slower_pairs": 0,
                  "status": 0
                },
                "status": 0
              },
              "warm_runtime_seconds_per_sample.SingleParametric": {
                "discovery": {
                  "absolute_threshold": 1e-6,
                  "baseline_median": 0.0055636967875419855,
                  "candidate_median": 0.005523720492787967,
                  "median_absolute_delta": -0.00003811328196964836,
                  "median_relative_delta": -0.006841708989221318,
                  "pair_count": 5,
                  "paired_absolute_noise": 7.1644243397149024e-6,
                  "paired_noise": 0.0012748950685252643,
                  "relative_threshold": 0.5,
                  "slower_pairs": 0,
                  "status": 0
                },
                "status": 0
              }
            },
            "schema_version": 2,
            "status": 0,
            "strict_correctness_mismatches": 20
          }
        },
        "controller_source_sha256": "11de376e3ef092987ab5c78ad9d8368b01df7f57c356bdb98161a76365ba9774",
        "workloads": {
          "gl04-q1-squared-ltd-vs-cff-4d": {
            "sha256": "c8cf76ae153e8e1ae9a88e719ff59f6a6f41b64c6e42b43a94ca620ccf1991ac"
          }
        }
      }
    }
    Raw records and logs (10)