Keyboard shortcuts

Press ← or → to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Outstanding work

Audit date: 2026-09-29. Source baseline: 026b4cb9 on trunk.

The largest remaining work is production recovery evidence, scientific acceptance, and manuscript release readiness. Many implementations already exist; an unchecked historical plan is not proof that a feature is missing.

The audit screened 574 tracked documentation/text artifacts: 476 in SynDB, 84 in QueryFabric, and 14 in Topoxide. It included text extracted from tracked PDF, DOCX, and ODT files, plus 104 ignored local ETL reports. Actionable claims were checked against newer records and selected source paths. This is a consolidated task index; the linked contracts retain their detailed criteria.

Update 2026-11-18: scientific impact and NWB/DANDI

This section supersedes the September audit for the scientific-impact work and the NWB/DANDI integration only. The other tables below are unchanged since the audit.

Scientific impact

The six impact tracks of 2026-11-12 (power-law fit range, rich-club null, noise floor, contactome and Peters’ rule, worm function atlas, federated quantiles) and the follow-ups on trunk are all merged. That covers the null sampler’s reciprocal-dyad move, the streaming rich-club null and the BANC cell-type contactome. All of them are inside the 0.11.1 images, which are built from eda5f027. Manuscript v1.1.1 is sealed in article/releases/v1.1.1. The BANC pair_contacts.parquet rerun is done.

Open, in order:

IDStateNext action and completion evidence
IMP-01done (092a87b1, PR #61)Electrical (gap-junction) BR-02 profiles get a four-class undirected census and a degree-preserving double-edge-swap null. Rows record census_algorithm = undirected_induced_4_v1 and sampler_revision = 3. The precompute revision stays graph_precompute_v11, so no other product is recomputed. With degrees fixed, the four electrical counts carry one signal, the triangle z-score. The CF09 bars show only its direction.
IMP-02blocked on a release from trunk ≥ 092a87b1In production, keep other graph writers off these datasets, then run syndb migrate ensure-schema. Next run syndb graph-precompute --replace-existing true with one --dataset for each of the seven dual-network datasets: celegans, celegans_male, celegans_pharynx, varshney, white_whole, wormneuroatlas, ciona. All seven use the full path, so no convergent-null result is replaced. Then run syndb article cache populate --figure CF09 --only pc_dual_triad_profile_ciona and syndb article cache build-figure-inputs --figure CF09. The checked-in CF09 manifest is stale until then, and both the submission audit and revalidation refuse it.
IMP-03blocked on IMP-02Revise article/sections/biological_methods.tex (both layers share one class order) and supplementary_figures.tex (Ciona’s 13-class dual profile, and the storage-direction reason for omitting electrical triads). Claim electrical triads only if the recompute is eligible. Then seal v1.2.
IMP-04open, optionalIn v1.1, 35 of the 39 rich-club cells pass the convergence gate. On the streaming path 21 of 24 pass. The four failing cells are reported as non-converged, which is honest as it stands. Closing them needs longer chains on those cells only.
IMP-05blocked by policyPublish Zenodo draft 10.5281/zenodo.20692792 at acceptance only (MS-09).
IMP-06openTwo graph-precompute recovery hazards predate this work. First, an interrupted --repair backfills the materialized views one at a time, and resume does not finish them. An older ok marker can then skip the dataset, or a fresh run can complete with views still empty. Fix it with a repair-in-progress marker. Second, ordinary replacement clears status with mutations_sync = 1 and only warns when a dual write fails. A resume on a lagging replica can then see the old ok and skip. Writers also take no lock around delete, insert and ledger publication. Publication counts rows by dataset, not by run, and does not wait for every serving replica to see them.

NWB export and DANDI

packages/nwb now covers the whole path:

  • syndb-nwb exports a dataset. Exports stream, so memory stays bounded by the neurons table: 100 M synapses peaked at 2.2 GiB.
  • syndb-nwb-check gates readiness.
  • syndb-nwb-publish uploads to a DANDI draft. It checks the downloaded bytes against the receipt hash, writes a publish receipt and links the Dandiset back to the SynDB dataset.
  • The dataset page lists external records.

All of this is on trunk: PR #63 (fc207770) covers the export, check and publish, and PR #62 (080b2dde) the dataset page. See the package README.

IDStateNext action and completion evidence
NWB-01merged; UI not deployedDeploy the UI with the next ui-rollout. The API needs no change.
NWB-02openRun one live syndb-nwb --dataset-id export against production. The new client calls are only tested against fakes. Keep the receipt.
NWB-03blocked: humanCreate the real Dandiset and agree its licence. Resolve the three C. elegans metadata issues in the README: session time, the composite subject, and the assumed age. Complete both reviews, bound to the final NWB hash.
NWB-04blocked: credential + approvalRun a sandbox roundtrip with syndb-nwb-publish --instance dandi-sandbox. It needs a DANDI sandbox API key and operator approval. Keep the publish receipt. A production upload (--instance dandi --link-dataset) is a separate approval. Publishing a Dandiset version (DOI) stays a manual DANDI step.
NWB-05openWrite a metadata YAML for each additional dataset. Only celegans_pharynx_cook2020.yaml exists, and the exporter rightly refuses to invent an identifier, a session time or a subject.

Known ceilings, kept deliberately:

  • Live exports bracket the published table versions before and after the fetch. That detects drift, not an ABA release, because the server has no version-pinned fetch.
  • The numcodecs CPPFLAGS=-std=gnu11 build override stays until dandi supports zarr 3. dandi 0.82 caps zarr below 3, and zarr 2 caps numcodecs below 0.16.

How to use this backlog

  • P0: production recovery or immediate acceptance prerequisite.
  • P1: scientific/manuscript release or supported-product acceptance.
  • P2: separately gated migration, collaboration, or improvement.
  • Deferred: conditional proposal, research, or explicitly declined work.
  • Open: work remains; partial: implementation or some proof exists; blocked: a named prerequisite is missing; verify: current deployment or release proof is missing. Close an item with a dated receipt and source revision, not just a successful build.

Priorities and role routing below are recommendations. They do not assign a person, adopt a scientific policy, or supersede an existing approval record. Operational observations from the original audit were historical. The separate 29 September live check updates the backup and schema observations only.

Execution order

  1. Close Central backup recovery, restore evidence, and commissioning defects.
  2. Start human/source-dependent scientific reviews while engineering proceeds.
  3. Finish source releases, exact parity, and real benchmark inputs.
  4. Refresh figure evidence, execute eligible analyses, reconcile claims, and publish the validated archive.
  5. Close UI/Flight acceptance and upstream integration evidence.
  6. Advance identity migration, partner deployment, and research through their independent prerequisites.
  7. Reconcile completed planning sections against retained acceptance evidence.

Operations and recovery

Routing: operations maintainers; NRP administrators where stated. Sources: reliability roadmap, operations journal, restore contract, commissioning, capacity reporting.

IDPriority / stateNext action and completion evidence
OPS-01P0 / partialDeploy and prove the manifest-aware full-base selection fix from 5e08826b; obtain a complete five-shard Central full backup, valid incremental chain, and independent S3 verification. The 29 September recovery candidate was built, published, verified by digest, and pinned in source; its toolbox and two offline binary regressions passed, alongside 76 chart tests. The candidate Job’s server-side dry run was still denied for low account utilization. Resolve admission and pass rollout/live acceptance; publication alone does not prove the deployed producer.
OPS-02P0 / blockedRetain four consecutive weekly restore PASS records with parity, cleanup, deadlines, and advancing success metrics. Manual restore success alone does not close the schedule gate.
OPS-03P1 / partialA manual isolated restore of meilisearch/2026-11-03T030038Z.snapshot passed on 2026-11-03 (30 documents, 13.5 s RTO, exact parity; receipt). Still implement the charted CLI producer/manual Job so the proof is repeatable without a hand-written pod.
OPS-04P0 / verifyMeilisearch snapshot and reconcile schedules are running (reconcile thawed 2026-11-03 after the restore proof and a verified manual Job). Prove the Helm-state backup and PostgreSQL verification producers. Keep destructive self-recovery under its own gate.
OPS-05P1 / blockedReconcile PostgreSQL public.dataset with provenance/summary inputs; obtain owner-produced capacity budgets and resource estimates; prove a manual report before scheduling it.
OPS-06P0 / partialSchema-preview correction completed on 2026-09-29: replicated local provenance storage, separate Distributed wrapper, database-owned DDL propagation, and syndb_distributed default; four focused unit tests and five command integration tests pass. Broader cutover execution/preflight and query-backed parity remain unimplemented acceptance work; a local marker is not live parity evidence.
OPS-07P1 / openSeparate service/ETL release ownership from CHI ownership; prove an image-only rollout leaves CHI resource versions and ClickHouse pod identities unchanged.
OPS-08P1 / blockedObtain administrator-owned operator RBAC/GitOps verification and close the documented CSI registration/recovery and alerting work.
OPS-09P1 / openImplement retention-aware transient ingest/rollback database cleanup through the Flight finalization lease, with durable publication records, dry-run output, and deletion audit events.
OPS-10P1 / partialRepeat the small-dataset graph-precompute canary; eliminate the documented hundreds-of-millions-row scan through measured dataset pruning while preserving exact scientific checks.
OPS-11P1 / partialComplete rollout/dataset SLO signals and quarterly download, finalization, publication, reconciliation-loss, and rollback exercises.

The live check found all ten ClickHouse pods Ready and recent successful West backup Jobs. Central full/incremental backups, restore drills, Meilisearch backup/reconciliation/self-recovery, Helm backup, and PostgreSQL verification were suspended. Job success and logged manifests are not restore acceptance.

Dataset availability and benchmark ETL

Routing: ETL/data maintainers and source owners. Sources: heterogeneous ETL, reliability roadmap, source/identity plan.

IDPriority / stateNext action and completion evidence
DATA-01P1 / partialClose availability per dataset: immutable source, prepared artifact, released table version, exact ClickHouse parity, and current derived products. The latest local ETL report’s zero errors does not prove completeness.
DATA-02P1 / partialAssemble the real-source eight-table benchmark bundle: neurons, synapses, spines, axons, dendrites, terminals, vesicles, and mitochondria, with truthful parent links and source-component metadata.
DATA-03P1 / partialSource implementation added on 2026-10-08: prepare-positions joins v1412 synapse references, groups shared compartments, resolves postsynaptic neuron ownership, and binds prepared artifacts to source hashes and explicit coordinate units. Imports require reconciled output; positions are labeled synaptic-junction proxies and unavailable morphology remains unknown. See the source contract. Complete-source reconciliation, neuron-universe validation, staged production jobs and released-table acceptance remain open.
DATA-04P1 / verifyReconcile MICrONS synapse counts and release state; finish FlyWire release and pinned-source identity verification.
DATA-05P1 / blockedAcquire and validate the complete Fish1 export; complete H01 data-use review and exact graph/spatial validation before scientific use.
DATA-06P1 / blockedRecover neuron and synapse sensitivity inputs for celegans_male, varshney, white_whole, and wormneuroatlas; verify digests and table versions.
DATA-07P1 / partialReconcile skeleton/connectivity identities for morphology-connectivity analyses; review Songbird source evidence, eligibility, and CF17 delivery. Later records already evidence a Songbird import.
DATA-08P2 / verifyDecide approved replacements or retirement for inactive sources; reconcile old local-raw-stage blockers with newer immutable artifacts, including mitochondrial inputs.

Scientific review and biological results

Routing: designated scientific reviewers/signers, analysis owners, and source curators. Sources: BR program, critical-path handoff, source-review pilot, claim readiness.

Immediate dependencies

IDPriority / stateNext action and completion evidence
SCI-01P1 / blockedComplete trusted human functional-role review/attestation, materialize the reviewed crosswalk, and obtain the separate BR-01 gate approval.
SCI-02P1 / blockedDecide Amendment 005 label-null adoption independently of the functional-role review; execute only after adoption.
SCI-03P1 / blockedSelect/adopt a BR-02R diagnostic policy and execute the diagnostic. A pass can enable preparation of the separate Amendment 004 result-analysis decision; only adopted/executed result analysis with fresh predeclared seeds can supply graph-null evidence.
SCI-04P1 / blockedResolve Cook SI1’s trusted binding and larval Data S2 acquisition/pinning; complete Ciona semantic judgments and mapping divergences. The pilot assessed 34 Ciona candidates, left 215 Cook/larval candidates blocked, and prepared two human-confirmable unchanged batches covering 15 rows.
SCI-05P1 / verifyResolve the last-recorded three open generic advisory items. NT-policy advisory acceptance is recorded, but advisory acceptance alone does not satisfy analysis readiness.
SCI-06P1 / partialStandardize isolate/zero-degree treatment across Rust, SQL, and Python; bind every new result/cache to frozen source identities; retain result-to-macro/table/panel traceability and drift checks.
SCI-07P1 / openComplete targeted novelty/literature review, independent scientific review, and offline replay before headline claims change.

The retained state has BR-01 blocked/unexecuted, BR-02R proposed/unadopted, and no eligible graph-null result evidence. BR-02 claim readiness has one eligible discovery root of the required three; worm and larval roots fail mixing diagnostics. Exact sparse census, null-model machinery, evidence capsules, review tooling, and substantial BR-01 execution plumbing already exist.

Program-specific acceptance

ProgramState and remaining work
BR-01 functional-role flowBlocked: SCI-01–03, execution, dataset-level comparisons, declared sensitivities, and claim verification.
BR-02 triad profilesPartial: eligible null chains across the discovery set, layer-specific products, and legacy motif/sampling compatibility cleanup. motifs.rs::triadic_census still retains sample_size.
BR-03 neurotransmitter wiringPartial: reviewed operational policy, complete threshold grids, chemical-only products, coverage/source-label checks, and cross-dataset stability.
BR-04 multiplex robustnessBlocked: validated chemical/electrical layers, suitable layer nulls, and held-out-species evidence.
BR-05 sex-specific integrationBlocked: reviewed shared-neuron crosswalk, matched comparisons, and targeted novelty review.
BR-06 developmentPartial: remaining Witvliet provenance and analysis gates; retained CF10 production validation is already marked satisfied.
BR-07 stable wiring backboneBlocked: three source-independent identity-matched graphs and a reserved confirmation source.
BR-08 spatial wiringOn hold: MICrONS/H01 units, masks, boundaries, types, completeness, and source-specific estimation.
BR-09 morphology-connectivityOn hold: matched morphology and connectivity in fly and mammalian sources.
BR-10 mitochondrial investmentDeclined as stated; reopen only for the specified independent replication or distinct question.
BR-11 bilateral symmetryReplication-only unless novelty is established; reviewed homologs and matched controls remain.
BR-12 cell-type redundancyBlocked: reviewed neuron-level types, complete graphs, and three-species feasibility/validation.

Identity and evidence infrastructure

Routing: schema/ETL/service maintainers and identity approvers. Sources: identity plan, replayability ledger, evidence migration.

IDPriority / stateNext action and completion evidence
ID-01P2 / blockedApprove UUID-v2 identity contracts; finish native-key/remapping recipes, resource estimates, and replay proofs. The retained ledger has zero migration-ready datasets.
ID-02P2 / blockedAfter ID-01, migrate registry/PostgreSQL references, compatibility aliases, and service identity checks; shadow-replay ClickHouse and rebuild derived products.
ID-03P2 / blockedProve the C. elegans canary and restore/rollback, perform controlled cutover, then consider v1 retirement. Identity migration is not a prerequisite for every biological task.
EVID-01P2 / partialComplete S3-compatible backend proof, backfill estimates, and exact shadow-index parity; separately authorize and implement any production serving read path. Local shadow proof is not a production cutover.

Manuscript release

Routing: manuscript, analysis, plotting, benchmark, and archive maintainers. Sources: figure provenance, evidence completion, archive manifest.

IDPriority / stateNext action and completion evidence
MS-01P1 / blockedRefresh all 12 production-designated manifests for the seven-day release policy. CF01/02/03/05/07/08 have null snapshots; CF06/09/10/12/13/17 have August snapshots at audit time.
MS-02P1 / openRepair CF08’s versioned coverage envelope, invalid status values, absent source versions, and missing snapshot; regenerate and validate.
MS-03P1 / partialRender CF17 panels from eligible source evidence. Layouts and a manifest exist; panel outputs were absent.
MS-04P1 / blockedObtain exact CF01 corpus-history snapshots and reviewed source-linked CF07 platform-comparison data.
MS-05P1 / partialComplete article-grade real benchmarks: eight-table bundle (DATA-02), MV, API, storage, graph, scale, and federation measurements, with the real-API validation gate.
MS-06P1 / blockedComplete CF09 exact layer triads and reviewed hub-overlap evidence; rerun MANC precompute/non-finite metrics; expand independent neuron morphometry and electrical coverage where suitable sources exist.
MS-07P1 / openRetain a real import → query → external-tool export transcript and final source/tool/version identities.
MS-08P1 / partialProve deterministic archival packaging and independent offline replay; reconcile supplement, references, diagnostic/coverage-panel placement, and all generated claims with accepted evidence.
MS-09P1 / blockedPublish the accepted archive for reserved DOI 10.5281/zenodo.20692792; reconcile the manifest’s unpublished-draft status with the manuscript’s current “archived” wording. Rebuild/audit the complete submission from one evidence set.

Current policy permits CF04, CF11, CF14, CF15, and CF16 as explicitly labelled synthetic controls. Their conversion to live data is not an inferred release requirement. The developmental-source survey is already done; a missing second suitable source is not an unconditional new ingestion commitment.

UI, authentication, and Flight

Routing: UI, service, authentication, and deployment maintainers. Sources: UI coverage, UI testing, Flight parity.

IDPriority / stateNext action and completion evidence
UI-01P1 / partialRetain acceptance for OAuth/auth, uploads, streaming downloads, saved queries/jobs, destructive actions, federation, archive workflows, accessibility (including the Firefox/WebKit subset), and failure recovery; scan release HTML, JS, source maps, WASM, and image layers for secrets and server-only dependencies. Dioxus has implementation and rollout receipts.
UI-02P1 / partialSupply actual browser identity, deterministic loading captures, ETL file-error injection, compatible baseline comparison, and visual/assistive-technology review. The current visual producer still emits null browser identity.
UI-03P1 / openFinish dedicated UI release ownership and independent deploy/rollback without API/schema/ETL mutation; retain performance budgets, asset retention, public-host checks, and an operator-signed observation-window closeout. Adopt the web-split WASM build only from measured unsplit/split bundle numbers. The proposed dedicated UI chart was absent.
UI-04P1 / verifyRecheck the last recorded CILogon unknown-client failure and GitHub Actions billing failure; record resolution or an active owner/blocker.
FLIGHT-01P1 / partialComplete bound-socket schema/action tests and broader DoGet/DoPut auth/policy, response metadata, cancellation, and failure parity. Production DoExchange is intentionally unsupported.
CLI-01P2 / openReconcile minimal-feature CLI support: the follow-up cargo test -p cli --no-default-features --bin syndb ops::cutover::tests build failed before tests with unguarded optional-dependency imports in Kubernetes, article, and operations modules. Use the documented default-feature build for current commissioning verification; decide and test the supported reduced-feature contract separately.

The retired Dioxus cutover plan (in Git history) fixed these invariants, which remain the UI acceptance contract: the same-origin UI BFF keeps the host-only, HTTP-only session cookie; /v1 is the only domain API and /api/* stays removed; authorization is enforced server-side for every loader, action, and stream; WASM bundles carry no secrets or server-only dependencies; and uploads and downloads stream or spool within stated limits.

QueryFabric and mesh validation

Routing: SynDB integration and upstream maintainers; mesh analysis owners. Sources: replacement extraction plan, upstream evidence, roadmap, mesh gates.

IDPriority / stateNext action and completion evidence
QF-01P1 / partialReconcile copied utilities with downstream adoption, behavior parity, duplicate removal, and publication eligibility; retain host-specific policy; refresh extraction evidence before plan retirement.
QF-02P1 / verifyObtain two clean footprint measurements, manual accessibility review, public docs/site proof, external technical feedback, and the exercised ten-crate publication path with signed tag/package/release URLs.
QF-03P1 / partialResolve documented dependency-advisory exceptions and remaining production identity/recovery/conformance evidence; gate any isolated-execution scope separately.
MESH-01P2 / partialFinish flat-array extract_path conversion and prove the 8.5K-neuron skeleton run within five minutes.
MESH-02P2 / blockedRetain held-out MICrONS precision/recall/F1 by confidence tier, GB-tree versus logistic comparison, CPU/GPU small-volume parity, ETL tests, and feature-complete Clippy evidence.

The pinned QueryFabric records describe a delivered 0.2.0 portability/compiler baseline, not a proven public release. Mesh geometry, GMM, CUDA kernels, Draco, multi-resolution, and active-learning tooling have substantial implementations.

Ellisman/NCMIR collaboration

Routing: partner scientific/technical/data/deployment owners and SynDB maintainers. Sources: gap register and implementation status.

IDPriority / stateNext action and completion evidence
COLLAB-01P2 / blockedName a real pilot collection/revision, scientific question, authoritative measurement table, acquisition method, licence/access terms, and raw-image custody.
COLLAB-02P2 / blockedReview specimen/replicate/object identities, coordinates, uncertainty, lineage, and ontology/table mappings; accept an attributable real partner package.
COLLAB-03P2 / blockedDecide importer/publication and ETL activation; prove real cross-store integration/restore and federation trust, endpoint, credentials, and operational ownership.
COLLAB-04P2 / blockedObtain independent biological validation and decide paired-functional-data scope. Synthetic/local contract proofs do not close these partner gates.

Documentation and export

Routing: corresponding implementation owners and documentation/manuscript maintainers. Sources: runbook index, ODT pipeline, and the workstream references above.

IDPriority / stateNext action and completion evidence
DOC-01P1 / openFill placeholder runbooks for backup collision/recency, CHI aborted, chronic CronJob failure, quota forecast, ratio violation, preflight failure, provenance divergence, PVC unmounting, replication queue, stale restore drill, and select-pin.
DOC-02P1 / partialReconcile stale implementation claims and dead paths; move completed guidance into stable references while preserving open acceptance gates. No complete active plan set qualified for unconditional retirement.
DOC-03P2 / openComplete numeric CSL citation style and siunitx table-column handling in ODT export. Decide fonts and SVG fallback separately; retire the Pandoc fork only after upstream inclusion and validation.

Corrections to carry into source documents

Stale claimCurrent evidence / remaining work
Reserve a DOIReserved; publication remains.
QueryFabric replacement plan missingPresent in the vendored tree linked above.
Dioxus migration not implementedImplementation/rollout exist; workflow and visual acceptance remain.
FAIR needs five entirely new overhaulsFederated search, authorization, ontology sync, circuit breakers, and provenance have implementations; revalidate individual claims.
Cook SI4 unavailableAcquired and hash-verified in the newer source-review record.
Four pending advisory reviewsLast recorded state is three open after NT advisory acceptance.
Sparse exact triads missingImplemented; eligibility and legacy compatibility remain.
Full-base backup selection unfixedFixed in September 27 source; deployed behavior needs proof.
ClickHouse syndb.datasets is canonicalCapacity contract uses PostgreSQL public.dataset.
Manuscript has only 16 scopesCurrent evidence policy includes CF17.
UI test support absenttests/support exists; some capture contracts remain blocked.

Conditional and deferred work

These need an explicit scope decision or their recorded reopening conditions:

  • Deferred operations: Keeper storage migration, next CHI quota, GD-D backup collision, GD-F stale-backup exercise, Helm-drift replacement, and federation/burst reassessment. Historical NRP outreach is explicitly NOT_PLANNED.
  • QueryFabric multi-resource migration/schema rebinding, federation HA/NAT and schema-conflict work, embedded backends, and ecosystem integrations.
  • Mesh GNN detection, wgpu, sparse boundary points, and segmentation correction.
  • Concurrent/mixed benchmarks, selectivity sweeps, temporal workloads, and adaptive iterations.
  • Source-tool backlinks, ER/nucleus schema expansion, desktop/mobile, offline PWA semantics, internationalization, and native rendering.
  • The retained 30 biological-discovery proposals and additional diagnostic figure placements; these do not override preregistered scientific gates.