Keyboard shortcuts

Press ← or → to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Phase 05 · Sub-layer 03 — Ingest an additional gap-junction (dual-network) dataset

Recommended model: DeepSeek v4 Pro (opencode) — effort high

Routed: carter route -c complex -r subagent -n coding → deepseek-v4-pro / high (bar 83, capability 83.5)

A full ETL stream for a connectome with electrical-synapse annotations, including the gap-junction matrix; complex coding with a correctness bar on the chemical/electrical split.

Working tree

Repository root. Cluster write + ETL. Does not edit bio/*.tex/discussion.tex.

Goal

The validated dual-network set gains at least one dataset with both chemical and electrical (gap-junction) connectivity, broadening it beyond C. elegans ×2 + Ciona so the dual-network comparison (CF09) is less coverage-limited.

Why this matters now

Limitations / biology text: “The validated dual-network analysis is narrower: both C. elegans datasets and Ciona have retained chemical and electrical metrics, whereas Platynereis is chemical-only … interpreted as a live but coverage-limited comparison rather than a powered cross-species law.” A fourth dual-network dataset moves it toward a real comparison.

Out of scope

  • Other coverage streams.
  • Re-running the dual-network stats by hand (merge re-runs the harness).
  • Forcing Platynereis to dual-network if its gap-junction source is genuinely absent.

Plan

  1. Identify a connectome with published gap-junction / electrical-synapse annotations not yet ingested with electrical edges (candidate: a dataset whose source includes an electrical adjacency matrix). Confirm the source actually carries gap junctions.
  2. Extend the ETL (Rust, crates/tools/etl/) to import the gap-junction matrix into the electrical-edge representation alongside chemical edges; register modality + provenance.
  3. Ingest; validate that load_dual_network_data() / split_by_synapse_type() now resolve chemical and electrical sub-networks for the new dataset.
  4. Add the citation to references.bib.
  5. Hand the merge: dataset live for the analyses re-run.

Acceptance criteria

  • A new connectome with real electrical-synapse edges is ingested; load_dual_network_data() returns chemical + electrical metrics for it.
  • ETL is Rust, registered with modality + DOI/licence.
  • Electrical edge count is non-trivial and traceable to the source gap-junction matrix (state it in provenance).
  • Citation added to references.bib.

Files likely touched

  • crates/tools/etl/ — gap-junction import; etl_registry/ — registration.
  • article/references.bib.
  • article/reproducibility/ — provenance.

Pitfalls

  • Symptom: electrical edges absent after ingest. Cause: the source’s gap-junction matrix wasn’t parsed (only chemical adjacency). Recovery: confirm the source file actually contains the electrical matrix before claiming the dataset qualifies.
  • Symptom: directed vs undirected confusion. Cause: gap junctions are bidirectional, chemical synapses directed. Recovery: import gap junctions as symmetric edges; verify reciprocity computes sanely.
  • Anti-pattern: Python ETL (project rule: Rust only).

Reference

  • packages/plot/src/syndb_plot/manuscript/data.py (load_dual_network_data, split_by_synapse_type).
  • Memory: “No Python in ETL”.
  • Gap inventory item 10.