Keyboard shortcuts

Press ← or → to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Phase 05 · Sub-layer 01 — Recompute MANC graph metrics to finite values (or pin the cause)

Recommended model: DeepSeek v4 Flash (opencode) — effort high

Routed: carter route -c moderate -r subagent -n coding,scientific → deepseek-v4-flash / high (bar 72, capability 75.3)

A bounded recompute-and-diagnose task on one dataset; either it yields finite metrics at higher sampling, or it confirms the data-quality cause — both are acceptable, well-scoped outcomes.

Working tree

Repository root. Cluster access for graph precompute. Does not edit bio/*.tex or discussion.tex (merge owns those).

Goal

MANC v0.9 produces a finite out-degree Gini and degree-fit α, and is included in the SCC/routing-diversity sampling — or the reason it cannot (genuine data-quality issue at the current ingest revision) is pinned down with evidence so the Limitations bullet can state it precisely rather than as an open anomaly.

Why this matters now

Limitations: “MANC v0.9 was excluded from the strongly-connected-component decomposition and from routing-diversity sampling (N_sampled=0) at 211,743 nodes, and its degree-fit α and Gini coefficient returned non-finite values.” This is the largest connectome in the graph analysis; a non-finite result on it weakens the cross-phylum figure (CF06) and degree-fits table.

Out of scope

  • The other coverage streams (morphometry/dual-network/developmental).
  • Editing numerals or Limitations (the Phase 05 merge does this after a full analyses re-run).
  • Changing the graph algorithms themselves.

Plan

  1. Reproduce the non-finite result: run the graph precompute / degree-fit for MANC and capture where it diverges (empty sample, overflow, disconnected handling, sampling cap N_sampled=0).
  2. Diagnose: is it (a) a sampling/timeout cap (raise it), (b) an ingest-revision data defect (missing edges), or (c) an algorithmic edge-case at 211k nodes? Use crates/core/connectome-graph/ metrics/paths.
  3. If (a): raise the sampling/Flight-timeout limits and recompute finite Gini/α + SCC/routing-diversity. If (b)/(c): document the precise cause with evidence (a query showing the defect) for the Limitations wording.
  4. Hand the merge: either the new finite values’ source (so the analyses re-run picks them up) or the pinned-cause note.

Acceptance criteria

  • Either MANC yields finite Gini and α and non-zero SCC/routing-diversity sampling, recomputed on the cluster; or a documented, evidenced data-quality cause (query/log showing it) is produced for the Limitations bullet.
  • The outcome is reproducible (commands + provenance recorded).
  • No bio/*.tex or Limitations edit here (deferred to merge).

Files likely touched

  • crates/core/connectome-graph/ (sampling/timeout config only — not algorithms) and/or the precompute job values.
  • article/reproducibility/ — diagnosis/provenance note.

Pitfalls

  • Symptom: recompute OOMs/times out at 211k nodes. Cause: the original N_sampled=0 likely is a cap. Recovery: raise the cap within memory limits; if infeasible, that itself is the documented cause.
  • Symptom: “fixed” Gini looks implausible. Cause: partial graph after a defective ingest. Recovery: validate edge counts vs the MANC source before trusting the metric.

Reference

  • crates/core/connectome-graph/{metrics,paths,topology}.rs.
  • Memory: “Graph precompute in ETL” (30min Flight timeout, escape hatches).
  • Gap inventory item 8.