Captured measurements · source evidence

Benchmark evidence

Verified snapshots · explicit work contracts · paired comparisons

discovery · Gate outcome: Passed. Numerical qualification uses the retained tolerances and reference outputs.

Comparison setMeasurementReferenceWorkloadSearch workloads

Columns

Qualified cells lead with a candidate/reference multiplier, with captured medians below. Observed ranges and qualification are available in Details. Colours compare each workload with its selected reference, using qualified matched sample pairs. Select an original recorded comparison set for stored paired ratios. Latest available captures show absolute values only. Different contracts and timing boundaries have separate matrices.

2× worse Reference · 1× 2× better Unranked / unavailable

gammaloop-48658b94b8bd6be515eea71b235bb13fa9e71527-39448909780-2-gl04-q1-squared-ltd-vs-cff-4d-discovery · Generation time

Hyperfine 2.0.0 complete generation CLI process including import and state save · fixed-point-integrand-v1 · Lower is better

What this measurement includes

Finite nonzero integrands agree within the declared tolerance across revisions and requested evaluators

Included: Fresh generated state; Declared evaluator implementations; Fixed-point numerical validation

Excluded: CLI compilation; Point caching; Event processing

Workload	GammaLoop
	Native
	48658b94b8 2026-10-20 Capture role: baseline	48658b94b8 2026-10-20 Capture role: candidate
gl04-q1-squared-ltd-vs-cff-4d	Select a reference 0.75 s Details baseline · measured · gammaloop-48658b94b8bd6be515eea71b235bb13fa9e71527-39448909780-2-gl04-q1-squared-ltd-vs-cff-4d-discovery Observed range: 0.74 s – 0.75 s 5 completed samples · 0 warmups excluded Qualification: passed Measurement statuses: { "completed": 5 } · 0 missing values	Select a reference 0.43 s Details candidate · measured · gammaloop-48658b94b8bd6be515eea71b235bb13fa9e71527-39448909780-2-gl04-q1-squared-ltd-vs-cff-4d-discovery Observed range: 0.42 s – 0.44 s 5 completed samples · 0 warmups excluded Qualification: passed Measurement statuses: { "completed": 5 } · 0 missing values GammaLoop / Native · 48658b94b8 · gammaloop-48658b94b8bd6be515eea71b235bb13fa9e71527-39448909780-2-gl04-q1-squared-ltd-vs-cff-4d-discovery: comparable; 5 matched pairs; candidate/reference median ratio 0.5737903819477097

gammaloop-48658b94b8bd6be515eea71b235bb13fa9e71527-39448909780-2-gl04-q1-squared-ltd-vs-cff-4d-discovery · Warmed runtime per sample · SingleParametric

Mean native warmed seconds per sample over the fixed corpus; ten warmup samples excluded · fixed-point-integrand-v1 · Lower is better

What this measurement includes

Finite nonzero integrands agree within the declared tolerance across revisions and requested evaluators

Included: Fresh generated state; Declared evaluator implementations; Fixed-point numerical validation

Excluded: CLI compilation; Point caching; Event processing

Workload	GammaLoop
	Native
	48658b94b8 2026-10-20 Capture role: baseline	48658b94b8 2026-10-20 Capture role: candidate
gl04-q1-squared-ltd-vs-cff-4d	Select a reference 0.01 s/sample Details baseline · measured · gammaloop-48658b94b8bd6be515eea71b235bb13fa9e71527-39448909780-2-gl04-q1-squared-ltd-vs-cff-4d-discovery Observed range: 0.01 s/sample – 0.01 s/sample 5 completed samples · 0 warmups excluded Qualification: passed Measurement statuses: { "completed": 5 } · 0 missing values	Select a reference 0.01 s/sample Details candidate · measured · gammaloop-48658b94b8bd6be515eea71b235bb13fa9e71527-39448909780-2-gl04-q1-squared-ltd-vs-cff-4d-discovery Observed range: 0.01 s/sample – 0.01 s/sample 5 completed samples · 0 warmups excluded Qualification: passed Measurement statuses: { "completed": 5 } · 0 missing values GammaLoop / Native · 48658b94b8 · gammaloop-48658b94b8bd6be515eea71b235bb13fa9e71527-39448909780-2-gl04-q1-squared-ltd-vs-cff-4d-discovery: comparable; 5 matched pairs; candidate/reference median ratio 0.9981441632859192

Unsupported, failed and censored work

These records stay visible when the measurement or reference changes. They are not zero timings. Qualification timeouts do not bound a different measured stage.

Detailed measurements and evidence

Measurement CSV · Comparison CSV · Unsupported / censored CSV · Analysis JSON · Report checksums

How to read these results

Observed ranges describe the captured samples, not confidence intervals.
Profile scopes may cover more work than completion metrics; inclusive costs are not additive phases.

Summary medians use completed measurement samples. Warmups are excluded. Timeouts and missing samples remain visible and suppress pair rankings. Ratios are candidate / baseline; speedup above 1 favours the candidate using the metric’s declared direction. Ratios require declared semantic qualification, equal contracts and metric scopes, and complete matching rounds. Baseline selection filters precomputed comparisons; the browser does not calculate statistics. Metric and baseline filters leave unsupported and censored work visible.

Search cases or textCaseComparison baselineCandidate / measurement variantMetricQualification / comparison status

Measurements

Case	Engine / variant · snapshot	Contract	Metric	Measured scope	Median	Observed range	Unit	Samples	Qualification	Origin
gl04-q1-squared-ltd-vs-cff-4d	gammaloop / baseline · gammaloop-48658b94b8bd6be515eea71b235bb13fa9e71527-39448909780-2-gl04-q1-squared-ltd-vs-cff-4d-discovery	fixed-point-integrand-v1	generation_seconds	Hyperfine 2.0.0 complete generation CLI process including import and state save	0.750784898	0.738842259 – 0.753886835	s	5 (5 completed); 0 warmups excluded	passed	measured
gl04-q1-squared-ltd-vs-cff-4d	gammaloop / baseline · gammaloop-48658b94b8bd6be515eea71b235bb13fa9e71527-39448909780-2-gl04-q1-squared-ltd-vs-cff-4d-discovery	fixed-point-integrand-v1	warm_runtime_seconds_per_sample.SingleParametric	Mean native warmed seconds per sample over the fixed corpus; ten warmup samples excluded	0.006832262851767242	0.006821957660545977 – 0.00686499403329844	s/sample	5 (5 completed); 0 warmups excluded	passed	measured
gl04-q1-squared-ltd-vs-cff-4d	gammaloop / candidate · gammaloop-48658b94b8bd6be515eea71b235bb13fa9e71527-39448909780-2-gl04-q1-squared-ltd-vs-cff-4d-discovery	fixed-point-integrand-v1	generation_seconds	Hyperfine 2.0.0 complete generation CLI process including import and state save	0.428138994	0.41876423 – 0.436001819	s	5 (5 completed); 0 warmups excluded	passed	measured
gl04-q1-squared-ltd-vs-cff-4d	gammaloop / candidate · gammaloop-48658b94b8bd6be515eea71b235bb13fa9e71527-39448909780-2-gl04-q1-squared-ltd-vs-cff-4d-discovery	fixed-point-integrand-v1	warm_runtime_seconds_per_sample.SingleParametric	Mean native warmed seconds per sample over the fixed corpus; ten warmup samples excluded	0.006819583287526683	0.006793764260545977 – 0.00707677518546798	s/sample	5 (5 completed); 0 warmups excluded	passed	measured

Paired comparisons

Case	Baseline	Candidate	Metric	Status	Median ratio	Observed ratio range	Median speedup	Pairs	Notes
gl04-q1-squared-ltd-vs-cff-4d	gammaloop / baseline · gammaloop-48658b94b8bd6be515eea71b235bb13fa9e71527-39448909780-2-gl04-q1-squared-ltd-vs-cff-4d-discovery	gammaloop / candidate · gammaloop-48658b94b8bd6be515eea71b235bb13fa9e71527-39448909780-2-gl04-q1-squared-ltd-vs-cff-4d-discovery	generation_seconds	comparable	0.5737903819477097	0.5554923984924204 – 0.590114890815957	1.7427967276229654	5	Same recorded host
gl04-q1-squared-ltd-vs-cff-4d	gammaloop / baseline · gammaloop-48658b94b8bd6be515eea71b235bb13fa9e71527-39448909780-2-gl04-q1-squared-ltd-vs-cff-4d-discovery	gammaloop / candidate · gammaloop-48658b94b8bd6be515eea71b235bb13fa9e71527-39448909780-2-gl04-q1-squared-ltd-vs-cff-4d-discovery	warm_runtime_seconds_per_sample.SingleParametric	comparable	0.9981441632859192	0.9896242047105992 – 1.0365218396709028	1.0018592872476169	5	Same recorded host

Unsupported, failed and censored work

These entries are not zero timings. Qualification timeouts do not establish a lower bound on a different measured stage.

Case	Engine	Variant	Snapshot	Stage	Status	Reason / timing interpretation	Cap (seconds)	Observed process duration (ns)	Origin

Contracts, versions and source evidence

gammaloop-48658b94b8bd6be515eea71b235bb13fa9e71527-39448909780-2-gl04-q1-squared-ltd-vs-cff-4d-discovery · measured · 2026-10-20T16:31:19.491852+00:00

snapshot · suite · hashes

fixed-point-integrand-v1

Finite nonzero integrands agree within the declared tolerance across revisions and requested evaluators

Included

Fresh generated state
Declared evaluator implementations
Fixed-point numerical validation

Excluded

CLI compilation
Point caching
Event processing

Pinned tools

{
  "baseline": {
    "kind": "executable",
    "path": "/nix/store/lwz0n3ms01pmfw50ayx40gkaq2n4h6ja-gammaloop-api-0.1.0/bin/gammaloop",
    "sha256": "56434a47eff30a87cacff98d103118b21848fbbfb4ad7e3aeb6392291d90316b",
    "tool_path": "/nix/store/lwz0n3ms01pmfw50ayx40gkaq2n4h6ja-gammaloop-api-0.1.0/bin/gammaloop",
    "version": "48658b94b8bd6be515eea71b235bb13fa9e71527"
  },
  "candidate": {
    "kind": "executable",
    "path": "/nix/store/lwz0n3ms01pmfw50ayx40gkaq2n4h6ja-gammaloop-api-0.1.0/bin/gammaloop",
    "sha256": "56434a47eff30a87cacff98d103118b21848fbbfb4ad7e3aeb6392291d90316b",
    "tool_path": "/nix/store/lwz0n3ms01pmfw50ayx40gkaq2n4h6ja-gammaloop-api-0.1.0/bin/gammaloop",
    "version": "48658b94b8bd6be515eea71b235bb13fa9e71527"
  },
  "hyperfine": {
    "kind": "executable",
    "path": "/nix/store/9ik81ccnqn0jlyx9qlcm767k1h09ydhd-hyperfine-2.0.0/bin/hyperfine",
    "sha256": "9b06d88ff2c903bfb07c3c5608c1ca978ada941b0190039a50d73f6379b7363b",
    "tool_path": "/nix/store/9ik81ccnqn0jlyx9qlcm767k1h09ydhd-hyperfine-2.0.0/bin/hyperfine",
    "version": "2.0.0"
  },
  "python": {
    "kind": "executable",
    "path": "/nix/store/wj1f56qky4pmjc7l0r6b6l7whnnw7hp6-python3-3.13.15/bin/python3",
    "sha256": "8b1577236d1a77db304db9fa3515423c3edf836b20ef8102215d77e8f35b3489",
    "tool_path": "/nix/store/wj1f56qky4pmjc7l0r6b6l7whnnw7hp6-python3-3.13.15/bin/python3.13",
    "version": "3.13.15"
  }
}

Recorded host

{
  "available_affinity": [
    0,
    1,
    2,
    3
  ],
  "cpu": "x86_64",
  "cpu_count": 4,
  "cpu_model": "AMD EPYC 7763 64-Core Processor",
  "exclusive_cpu_reservation": false,
  "hostname": "runnervm8k3b6",
  "load_average_start": [
    1.0,
    1.0,
    0.8994140625
  ],
  "machine": "x86_64",
  "platform": "Linux-6.17.0-1022-azure-x86_64-with-glibc2.42",
  "python": "3.13.15",
  "python_executable": "/nix/store/wj1f56qky4pmjc7l0r6b6l7whnnw7hp6-python3-3.13.15/bin/python3",
  "python_sha256": "8b1577236d1a77db304db9fa3515423c3edf836b20ef8102215d77e8f35b3489",
  "runner_image": "20261012.334.1",
  "selected_affinity": null,
  "shared_host": true
}

Schedule and provenance

{
  "schedule": {
    "pairing_id": "gammaloop-48658b94b8bd6be515eea71b235bb13fa9e71527-39448909780-2-gl04-q1-squared-ltd-vs-cff-4d-discovery",
    "repeats": 5,
    "selected_tasks": [
      "baseline",
      "candidate"
    ],
    "warmups": 0
  },
  "provenance": {
    "adapter_sha256": "64e0900ef0fb0be8d8334cee648219d9b88acc16a5fe4ed4554de43f7d211da9",
    "build": {
      "baseline": {
        "context": {
          "cargo_lock_sha256": "c4555422fff8594bf12b96ca799cab842502fd2831ad9237fa200ceba46224c7",
          "flake_lock_sha256": "e10c5893b513d4c7120d841b47fbfddffb3ac4f1f5cb46a18c0f7542cbde8534",
          "profiles": {
            "bench": {
              "lto": "fat",
              "opt-level": 3
            },
            "ci-optim": {
              "debug": false,
              "inherits": "dev-optim"
            },
            "dev-optim": {
              "inherits": "dev",
              "opt-level": 2,
              "package": {
                "*": {
                  "opt-level": 3
                },
                "gammaloop-api": {
                  "opt-level": 2
                },
                "gammaloop-workspace-hack": {
                  "opt-level": 3
                },
                "gammalooprs": {
                  "opt-level": 2
                }
              }
            },
            "docs": {
              "debug": false,
              "inherits": "dev"
            },
            "docs-watch": {
              "debug": false,
              "inherits": "dev",
              "package": {
                "*": {
                  "opt-level": 2
                }
              }
            },
            "profiling": {
              "debug": true,
              "inherits": "release",
              "lto": "fat",
              "opt-level": 3
            },
            "release": {
              "lto": "fat"
            }
          },
          "system": "x86_64-linux"
        },
        "package": "/nix/store/lwz0n3ms01pmfw50ayx40gkaq2n4h6ja-gammaloop-api-0.1.0",
        "store": {
          "/nix/store/lwz0n3ms01pmfw50ayx40gkaq2n4h6ja-gammaloop-api-0.1.0": {
            "ca": null,
            "deriver": "/nix/store/6695nv63fvxn3dmgnsrs4999qi4rn5i2-gammaloop-api-0.1.0.drv",
            "narHash": "sha256-HDKGSRR3W4GgYL1NKNcjGaS/Q8LJSdToiHc5Q/H5noI=",
            "narSize": 403887416,
            "references": [
              "/nix/store/604gsr59rj7dzd0nrhp143rpvf7gyiaz-gcc-15.3.0-lib",
              "/nix/store/lm3pknxi0ipypy3lxh1wmm8wvvavdwrn-glibc-2.42-84",
              "/nix/store/mnri0zxink79i54p90lrsy278jrlwv05-gammaloop-crate-gammaloop-api-build-0.1.0",
              "/nix/store/wj1f56qky4pmjc7l0r6b6l7whnnw7hp6-python3-3.13.15",
              "/nix/store/zilb1z0hnvjyxyvssp2gqgh3qmfxcxfi-vendor-cargo-deps"
            ],
            "registrationTime": 1792512400,
            "signatures": [
              "nix-ci:6E9tYBow90ZnQb4jYOu15QtbTL6jk7uUadUVaOQhrF6QjhH/BESpjTSfW+n5X81AjH1IEULfEdbw6938zMaxDw=="
            ],
            "storeDir": "/nix/store",
            "ultimate": false,
            "version": 1
          }
        }
      },
      "candidate": {
        "context": {
          "cargo_lock_sha256": "c4555422fff8594bf12b96ca799cab842502fd2831ad9237fa200ceba46224c7",
          "flake_lock_sha256": "e10c5893b513d4c7120d841b47fbfddffb3ac4f1f5cb46a18c0f7542cbde8534",
          "profiles": {
            "bench": {
              "lto": "fat",
              "opt-level": 3
            },
            "ci-optim": {
              "debug": false,
              "inherits": "dev-optim"
            },
            "dev-optim": {
              "inherits": "dev",
              "opt-level": 2,
              "package": {
                "*": {
                  "opt-level": 3
                },
                "gammaloop-api": {
                  "opt-level": 2
                },
                "gammaloop-workspace-hack": {
                  "opt-level": 3
                },
                "gammalooprs": {
                  "opt-level": 2
                }
              }
            },
            "docs": {
              "debug": false,
              "inherits": "dev"
            },
            "docs-watch": {
              "debug": false,
              "inherits": "dev",
              "package": {
                "*": {
                  "opt-level": 2
                }
              }
            },
            "profiling": {
              "debug": true,
              "inherits": "release",
              "lto": "fat",
              "opt-level": 3
            },
            "release": {
              "lto": "fat"
            }
          },
          "system": "x86_64-linux"
        },
        "package": "/nix/store/lwz0n3ms01pmfw50ayx40gkaq2n4h6ja-gammaloop-api-0.1.0",
        "store": {
          "/nix/store/lwz0n3ms01pmfw50ayx40gkaq2n4h6ja-gammaloop-api-0.1.0": {
            "ca": null,
            "deriver": "/nix/store/6695nv63fvxn3dmgnsrs4999qi4rn5i2-gammaloop-api-0.1.0.drv",
            "narHash": "sha256-HDKGSRR3W4GgYL1NKNcjGaS/Q8LJSdToiHc5Q/H5noI=",
            "narSize": 403887416,
            "references": [
              "/nix/store/604gsr59rj7dzd0nrhp143rpvf7gyiaz-gcc-15.3.0-lib",
              "/nix/store/lm3pknxi0ipypy3lxh1wmm8wvvavdwrn-glibc-2.42-84",
              "/nix/store/mnri0zxink79i54p90lrsy278jrlwv05-gammaloop-crate-gammaloop-api-build-0.1.0",
              "/nix/store/wj1f56qky4pmjc7l0r6b6l7whnnw7hp6-python3-3.13.15",
              "/nix/store/zilb1z0hnvjyxyvssp2gqgh3qmfxcxfi-vendor-cargo-deps"
            ],
            "registrationTime": 1792512400,
            "signatures": [
              "nix-ci:6E9tYBow90ZnQb4jYOu15QtbTL6jk7uUadUVaOQhrF6QjhH/BESpjTSfW+n5X81AjH1IEULfEdbw6938zMaxDw=="
            ],
            "storeDir": "/nix/store",
            "ultimate": false,
            "version": 1
          }
        }
      }
    },
    "ci": {
      "baseline": "ff533fcd91d80577e8372c398c17a5924613e73c",
      "candidate": "48658b94b8bd6be515eea71b235bb13fa9e71527",
      "event": "pull_request",
      "framework_revision": "aa05a50c65e79f923a5616f7382b3efa0b71b492",
      "pr": 119,
      "repository": "alphal00p/gammaloop",
      "repository_url": "https://github.com/alphal00p/gammaloop",
      "run_attempt": 2,
      "run_id": 39448909780
    },
    "ci_gate": {
      "identity": {
        "baseline": {
          "commit": "48658b94b8bd6be515eea71b235bb13fa9e71527",
          "config_sha256": "a1c9331b0dc3de9cdfd1e895d0c39c6bf5fe99981ec041cc8acdd9f11e65dbef",
          "corpus_sha256": "91546c7de9b78fac35c1f29dd55d7e08033c13d8e4c40b8719ae2ae1cfbb497c",
          "fixture_sha256": "c8cf76ae153e8e1ae9a88e719ff59f6a6f41b64c6e42b43a94ca620ccf1991ac"
        },
        "candidate": {
          "commit": "48658b94b8bd6be515eea71b235bb13fa9e71527",
          "config_sha256": "a1c9331b0dc3de9cdfd1e895d0c39c6bf5fe99981ec041cc8acdd9f11e65dbef",
          "corpus_sha256": "91546c7de9b78fac35c1f29dd55d7e08033c13d8e4c40b8719ae2ae1cfbb497c",
          "fixture_sha256": "c8cf76ae153e8e1ae9a88e719ff59f6a6f41b64c6e42b43a94ca620ccf1991ac"
        }
      },
      "phase": "discovery",
      "policy": {
        "budget_seconds": 240,
        "certified_zero": {
          "certificate": {
            "id": "gl04-q1-squared-imaginary-v1",
            "sha256": "dfdbc3f2115f7c9e7f5fe1fcf3493029adadd87c109524a6519701080669acec"
          },
          "components": [
            {
              "absolute_bound": 1.4901161193847656e-8,
              "index": 1
            },
            {
              "absolute_bound": 1.4901161193847656e-8,
              "index": 3
            },
            {
              "absolute_bound": 1.4901161193847656e-8,
              "index": 5
            },
            {
              "absolute_bound": 1.4901161193847656e-8,
              "index": 7
            }
          ]
        },
        "correctness_format": "number",
        "correctness_tolerance": {
          "absolute": 0.0,
          "relative": 1e-9
        },
        "metric_families": [
          "evaluator_build_seconds",
          "warm_runtime_seconds_per_sample"
        ],
        "output_groups": [
          "SingleParametric"
        ],
        "pairs": 5,
        "reference_group": "SingleParametric",
        "schema_version": 1,
        "thresholds": {
          "generation_seconds": [
            0.5,
            0.5
          ],
          "warm_runtime_seconds_per_sample.SingleParametric": [
            0.5,
            1e-6
          ]
        }
      },
      "report": {
        "certified_zero_components": 4,
        "confirmation_required": 0,
        "correctness_mismatches": 0,
        "identity_mismatch": 0,
        "invalid_input": 0,
        "metrics": {
          "generation_seconds": {
            "discovery": {
              "absolute_threshold": 0.5,
              "baseline_median": 0.750784898,
              "candidate_median": 0.428138994,
              "median_absolute_delta": -0.32131381999999997,
              "median_relative_delta": -0.4262096180522903,
              "pair_count": 5,
              "paired_absolute_noise": 0.011743492240199906,
              "paired_noise": 0.005241257133953397,
              "relative_threshold": 0.5,
              "slower_pairs": 0,
              "status": 0
            },
            "status": 0
          },
          "warm_runtime_seconds_per_sample.SingleParametric": {
            "discovery": {
              "absolute_threshold": 1e-6,
              "baseline_median": 0.006832262851767242,
              "candidate_median": 0.006819583287526683,
              "median_absolute_delta": -0.000012679564240559472,
              "median_relative_delta": -0.0018558367140807384,
              "pair_count": 5,
              "paired_absolute_noise": 0.00002414534470870055,
              "paired_noise": 0.0035319507192628696,
              "relative_threshold": 0.5,
              "slower_pairs": 2,
              "status": 0
            },
            "status": 0
          }
        },
        "schema_version": 2,
        "status": 0,
        "strict_correctness_mismatches": 20
      }
    },
    "controller_source_sha256": "11de376e3ef092987ab5c78ad9d8368b01df7f57c356bdb98161a76365ba9774",
    "workloads": {
      "gl04-q1-squared-ltd-vs-cff-4d": {
        "sha256": "c8cf76ae153e8e1ae9a88e719ff59f6a6f41b64c6e42b43a94ca620ccf1991ac"
      }
    }
  }
}

Raw records and logs (10)

baseline · measure 0 · completed: generation · record
candidate · measure 0 · completed: generation · record
candidate · measure 1 · completed: generation · record
baseline · measure 1 · completed: generation · record
baseline · measure 2 · completed: generation · record
candidate · measure 2 · completed: generation · record
candidate · measure 3 · completed: generation · record
baseline · measure 3 · completed: generation · record
baseline · measure 4 · completed: generation · record
candidate · measure 4 · completed: generation · record