Primary workflow notebooks¶
Run these in the stage order shown in the workflow overview.
Transcription QC sits between ingestion and matching and is currently
script-driven (submit_transcription_qc.sh) rather than notebook-driven.
Stage |
Notebook |
Purpose |
|---|---|---|
Ingestion |
Rainfall Rescue monthly ingest to Parquet |
|
Ingestion |
Ensemble JSON ingest to Parquet |
|
Matching |
Primary RR-DATA matching and metadata assignment |
|
Matching |
Residual ALLSHEETS matching for unmatched files |
|
Quality control |
QC1 monthly-total consistency check |
|
Quality control |
QC2 stage 1 regional-neighbour statistics |
|
Quality control |
QC2 stage 2 secondary ML check |
|
Export |
SEF export generation |
|
Analysis |
SEF summary analysis |
|
Analysis |
Consensus rainfall animation |
|
Analysis |
SEF rainfall animation with QC display |