HBCD MR Quality Control Procedures🔗
Raw MR Data QC🔗
Raw MRI QC combines automated and manual checks to evaluate unprocessed data and identify acquisition errors, image artifacts, or corrupted files before downstream processing. Automated QC is applied to all data. Due to the large data volume and time-intensive nature of manual inspection, manual visual review is only performed for series that fail automated QC. Although automated tools detect most quality issues, some artifacts may be missed if misclassified or not assessed as part of automated QC. Raw MR QC metrics are provided in the raw BIDS scans.tsv files in the release.
| Field | Description |
|---|---|
| [ Summary QC Metric ] | |
QC | Overall QC score: 1 (pass) or 0 (fail). If manual QC is not required, this equals auto_qc_score |
| [ Manual QC Metrics ] | |
notes | Optional notes from manual QC review |
nrev | Number of manual QC reviewers |
QU_cutoff | Qualitative manual QC score for FOV cutoff artifacts (dMRI, fMRI, and field maps) |
QU_line | Qualitative manual QC score for line artifacts (dMRI, fMRI, and field maps) |
QU_motion | Qualitative manual QC score for motion (sMRI and qMRI) |
QU_sus | Qualitative manual QC score for susceptibility artifacts (dMRI, fMRI, and field maps) |
| [ Automated QC Metrics ] | |
AdditionalInfo | Notes on classification and protocol compliance |
aqc_motion | Automated motion QC score for sMRI |
auto_qc_notes | Reason for automated QC failure |
auto_qc_score | Automated QC score: 1 (pass) or 0 (fail) |
b0_mean | Mean b=0 image intensity within the brain mask |
b0_{median|std} | Median or standard deviation of b=0 image intensity within the brain mask |
bad_philips_exam_card_values | Whether the QALAS exam card used for acquisition contained incorrect values |
brain_entropy | Entropy of voxel intensities within the brain mask |
brain_{mean|std|SNR} | Mean, standard deviation, or SNR of image intensity within the brain mask |
brain_{min|max|median} | Minimum, maximum, or median image intensity within the brain mask |
brain_{n|f}vox_max | Number or fraction of voxels within the brain mask at maximum image intensity |
brain_tSNR_{mean|median|std} | Mean, median, or standard deviation of temporal SNR within the brain mask |
brainvol | Volume of the brain mask (mm3) |
censor_thresh | Threshold used to censor outlier slices (dMRI) |
Completed | Whether the series contains the expected number of files |
cutoff | Sum of the dorsal and ventral cutoff scores |
{dorsal|ventral}_cutoff | Dorsal or ventral cutoff score |
{DT|RSI}err_rel | Median DTI or RSI RMS error across all frames and voxels, relative to the within-voxel RMS signal |
{DT|RSI}err_rel_b{X} | Median DTI or RSI RMS error across voxels for b-value X, relative to the within-voxel RMS b=0 signal (X = 0–3000) |
DTerr_{mean|median|std} | Mean, median, or standard deviation across frames of RMS residual error relative to RMS signal within brain voxels |
FA_{mean|median} | Mean or median fractional anisotropy within the brain mask |
FA_std | Standard deviation of fractional anisotropy within the brain mask |
fwhm_x | Full width at half maximum spatial smoothness along the x-axis (left–right) |
fwhm_y | Full width at half maximum spatial smoothness along the y-axis (anterior–posterior) |
fwhm_z | Full width at half maximum spatial smoothness along the z-axis (inferior–superior) |
FWHM{x|y|z}_b{X} | FWHM spatial smoothness along the x-, y-, or z-axis (L–R, A–P, or I–S) for b-value X (X = 0–3000) |
HBCD_compliant | Whether the series passes the minimal protocol compliance check |
line_max_{score|count} | Maximum line artifact score or count across frames |
line_mean_{score|count} | Mean line artifact score or count across frames |
line_nframes | Number of frames with line artifacts |
loris_qc_status | Pass/fail value mapped from the UCSD QC JSON file |
loris_selected | Whether the file is selected for further processing |
max_{dx|dy|dz|rx|ry|rz} | Maximum absolute x-, y-, or z-axis translation (d) or rotation (r) (mm) |
max_nbad_frames_per_frame | Maximum number of outlier frames identified for any frame |
max_nbad_frames_per_slice | Maximum number of outlier frames identified for any slice |
MD_{mean|median} | Mean or median mean diffusivity within the brain mask |
MD_std | Standard deviation of mean diffusivity within the brain mask |
mean_{motion|trans|rot} | Mean framewise displacement, translation, or rotation (mm) |
nbad_{frames|slices} | Number of frames or slices containing outlier slices or frames (dMRI) |
nbad_{frames|slices}_b{X} | Number of frames or slices containing outlier slices or frames for b-value X (dMRI; X = 0–3000) |
nbad_frame_slices | Number of outlier frame–slice combinations (dMRI) |
nbad_frame_slices_b{X} | Number of outlier frame–slice combinations for b-value X (dMRI; X = 0–3000) |
nframes_b{X} | Number of frames for b-value X (X = 0–3000) |
ngood_frames | Number of frames without outlier slices (dMRI) |
ngood_frames_b{X} | Number of frames without outlier slices for b-value X (dMRI; X = 0–3000) |
nonbrain_{mean|std|snr} | Mean, standard deviation, or SNR of image intensity outside the brain mask |
nreps | Number of repetitions or frames |
NumberOfFiles | Number of DICOM files |
NumberOfFilesExtra | Number of extra DICOM files received, including non-image, corrupt, or duplicate files |
NumberOfFilesMissing | Number of DICOM files apparently missing based on gaps in InstanceNumber values |
NumberOfFilesOrig | Number of DICOM files received before excluding non-image, corrupt, or extra files |
NumberOfFilesValid | Number of valid DICOM files after excluding non-image, corrupt, or extra files, but before excluding files from the final partial frame |
Num{Head|Neck|Spine}CoilElem | Number of head, neck, or spine coil elements |
part_of_a_pair | Whether the DWI file is part of a pair |
qc_selection | Whether the series is selected for manual QC |
qc_status | Manual QC review status, such as pending or complete |
revdisp | Whether manual QC reviewers disagreed |
subthresh_{02|03|04} | Number of seconds with framewise displacement below 0.2, 0.3, or 0.4 mm |
tSNR_b{X} | Median temporal SNR within the brain mask for b-value X (X = 0–3000) |
Protocol Adherence & Completeness Checks🔗
Acquired imaging data are automatically uploaded to central servers, where they undergo automated protocol compliance and completeness checks. Data that fail are flagged for review and excluded from release until the issues are resolved.
- Protocol compliance is performed by extracting imaging parameters from DICOM headers to confirm that key parameters (e.g., voxel size, TR, orientation) match the expected scanner protocol. Out-of-compliance series are flagged for review, with site followup as necessary.
- Completeness checks verify that all expected series are present in each imaging session. Missing data may be caused by aborted scans, incomplete sessions, and/or incomplete data transfer. Valid sessions are expected to include: T1w & T2w, 2 resting state functional runs (each accompanied by fieldmaps acquired in AP/PA phase encoding directions), diffusion scans (acquired AP/PA), quantitative QALAS and B1 maps, and MRS scan and SVS localizer.
Automated QC🔗
Data that pass protocol adherence and completeness checks move to the next stage of automated QC, calculated for modalities as follows:
| Modality | Automated QC Metrics |
|---|---|
| sMRI & qMRI |
|
| fMRI |
|
| dMRI |
|
| Field Maps | Detect line artifacts and field-of-view (FOV) cutoff |
| All | Compute SNR where applicable |
Manual Review🔗
Data are flagged for manual review based on automated QC results using multivariate prediction and Bayesian classifiers, so only a subset undergoes both automated and manual review. When a series is flagged, trained technicians perform visual review and rate artifact severity on a 0–3 scale: none (0), mild (1), moderate (2), or severe (3). Series rated 3 (severe) are automatically assigned an overall QC score of 0 (Fail) and excluded from downstream processing. For all others, final selection is informed by manual ratings, reviewer notes, and automated QC metrics.
| Modality | Manual QC Procedures & Scoring |
|---|---|
| sMRI |
|
| qMRI |
|
| dMRI, fMRI, fmaps |
|
| MRS |
|
BrainSwipes🔗
BrainSwipes is a gamified crowdsourcing platform used to perform manual QC of processed MRI data. Reviewers assess images from XCP-D visual reports, displaying a series of brain images in coronal, axial, and sagittal planes, and classify each report as Pass (1) or Fail (0).
BrainSwipes results are included in the Tabular Imaging domain:
- Report-level QC metrics: mean QC score and number of reviewers for each visual report
- Subject-level QC metrics: mean QC score and average number of reviewers across all reports for a participant
| QC Assessment | What is Evaluated |
|---|---|
| Surface Delineation | Accuracy of cortical surface placement and gray/white matter boundaries |
| Atlas Registration | Alignment between the participant's anatomical image and the reference atlas |
| Functional Registration | Alignment between functional and structural images and detection of major artifacts such as signal dropout |
Where to find QC data in release🔗
MR quality control (QC) is performed at multiple stages of data processing. The release includes the following QC metrics, reports, and manual review results, displayed below in roughly chronological order (from raw data QC to group-level analyses provided in the release documentation):
| QC Source | Stage | Description | Release Data |
|---|---|---|---|
| Raw MR QC | Raw DICOM | Automated and manual QC metrics, including compliance/completeness checks | scans.tsv files |
| MRIQC | Raw BIDS | Automated image quality metrics | MRIQC derivatives |
| Pipeline QC Reports | Processing | Pipeline-generated visual reports and automated metrics | Derivatives |
| BrainSwipes | Post-processing | Manual review results for structural and functional XCP-D QC reports | Tabular Imaging |
| Release QC Summaries | Group analysis | Group-level analyses/QC summaries provided in documentation, e.g., fMRI and dMRI QC Summary Statistics | Release documentation |
Dean III, D. C., Tisdall, M. D., Wisnowski, J. L., Feczko, E., Gagoski, B., Alexander, A. L., ... & HBCD MRI Working Group. (2024). Quantifying brain development in the HEALthy Brain and Child Development (HBCD) Study: The magnetic resonance imaging and spectroscopy protocol. Developmental Cognitive Neuroscience, 70, 101452. https://doi.org/10.1016/j.dcn.2024.101452
Gard, A. M., Hyde, L. W., Heeringa, S. G., West, B. T., & Mitchell, C. (2023). Why weight? Analytic approaches for large-scale population neuroscience data. Developmental Cognitive Neuroscience, 59, 101196. https://doi.org/10.1016/j.dcn.2023.101196
Hagler, D. J., Jr, Ahmadi, M. E., Kuperman, J., Holland, D., McDonald, C. R., Halgren, E., & Dale, A. M. (2009). Automated white-matter tractography using a probabilistic diffusion tensor atlas: Application to temporal lobe epilepsy. Human Brain Mapping, 30(5), 1535–1547. https://doi.org/10.1002/hbm.20619
Power, J. D., Barnes, K. A., Snyder, A. Z., Schlaggar, B. L., & Petersen, S. E. (2012). Spurious but systematic correlations in functional connectivity MRI networks arise from subject motion. NeuroImage, 59(3), 2142–2154. https://doi.org/10.1016/j.neuroimage.2011.10.018
Triantafyllou, C., Hoge, R. D., Krueger, G., Wiggins, C. J., Potthast, A., Wiggins, G. C., & Wald, L. L. (2005). Comparison of physiological noise at 1.5 T, 3 T and 7 T and optimization of fMRI acquisition parameters. NeuroImage, 26(1), 243–250. https://doi.org/10.1016/j.neuroimage.2005.01.007