HBCD MR Quality Control Procedures🔗

Raw MR Data QC🔗

Raw MRI QC combines automated and manual checks to evaluate unprocessed data and identify acquisition errors, image artifacts, or corrupted files before downstream processing. Automated QC is applied to all data. Due to the large data volume and time-intensive nature of manual inspection, manual visual review is only performed for series that fail automated QC. Although automated tools detect most quality issues, some artifacts may be missed if misclassified or not assessed as part of automated QC. Raw MR QC metrics are provided in the raw BIDS scans.tsv files in the release.

FieldDescription
[ Summary QC Metric ]
QCOverall QC score: 1 (pass) or 0 (fail). If manual QC is not required, this equals auto_qc_score
[ Manual QC Metrics ]
notesOptional notes from manual QC review
nrevNumber of manual QC reviewers
QU_cutoffQualitative manual QC score for FOV cutoff artifacts (dMRI, fMRI, and field maps)
QU_lineQualitative manual QC score for line artifacts (dMRI, fMRI, and field maps)
QU_motionQualitative manual QC score for motion (sMRI and qMRI)
QU_susQualitative manual QC score for susceptibility artifacts (dMRI, fMRI, and field maps)
[ Automated QC Metrics ]
AdditionalInfoNotes on classification and protocol compliance
aqc_motionAutomated motion QC score for sMRI
auto_qc_notesReason for automated QC failure
auto_qc_scoreAutomated QC score: 1 (pass) or 0 (fail)
b0_meanMean b=0 image intensity within the brain mask
b0_{median|std}Median or standard deviation of b=0 image intensity within the brain mask
bad_philips_exam_card_valuesWhether the QALAS exam card used for acquisition contained incorrect values
brain_entropyEntropy of voxel intensities within the brain mask
brain_{mean|std|SNR}Mean, standard deviation, or SNR of image intensity within the brain mask
brain_{min|max|median}Minimum, maximum, or median image intensity within the brain mask
brain_{n|f}vox_maxNumber or fraction of voxels within the brain mask at maximum image intensity
brain_tSNR_{mean|median|std}Mean, median, or standard deviation of temporal SNR within the brain mask
brainvolVolume of the brain mask (mm3)
censor_threshThreshold used to censor outlier slices (dMRI)
CompletedWhether the series contains the expected number of files
cutoffSum of the dorsal and ventral cutoff scores
{dorsal|ventral}_cutoffDorsal or ventral cutoff score
{DT|RSI}err_relMedian DTI or RSI RMS error across all frames and voxels, relative to the within-voxel RMS signal
{DT|RSI}err_rel_b{X}Median DTI or RSI RMS error across voxels for b-value X, relative to the within-voxel RMS b=0 signal (X = 0–3000)
DTerr_{mean|median|std}Mean, median, or standard deviation across frames of RMS residual error relative to RMS signal within brain voxels
FA_{mean|median}Mean or median fractional anisotropy within the brain mask
FA_stdStandard deviation of fractional anisotropy within the brain mask
fwhm_xFull width at half maximum spatial smoothness along the x-axis (left–right)
fwhm_yFull width at half maximum spatial smoothness along the y-axis (anterior–posterior)
fwhm_zFull width at half maximum spatial smoothness along the z-axis (inferior–superior)
FWHM{x|y|z}_b{X}FWHM spatial smoothness along the x-, y-, or z-axis (L–R, A–P, or I–S) for b-value X (X = 0–3000)
HBCD_compliantWhether the series passes the minimal protocol compliance check
line_max_{score|count}Maximum line artifact score or count across frames
line_mean_{score|count}Mean line artifact score or count across frames
line_nframesNumber of frames with line artifacts
loris_qc_statusPass/fail value mapped from the UCSD QC JSON file
loris_selectedWhether the file is selected for further processing
max_{dx|dy|dz|rx|ry|rz}Maximum absolute x-, y-, or z-axis translation (d) or rotation (r) (mm)
max_nbad_frames_per_frameMaximum number of outlier frames identified for any frame
max_nbad_frames_per_sliceMaximum number of outlier frames identified for any slice
MD_{mean|median}Mean or median mean diffusivity within the brain mask
MD_stdStandard deviation of mean diffusivity within the brain mask
mean_{motion|trans|rot}Mean framewise displacement, translation, or rotation (mm)
nbad_{frames|slices}Number of frames or slices containing outlier slices or frames (dMRI)
nbad_{frames|slices}_b{X}Number of frames or slices containing outlier slices or frames for b-value X (dMRI; X = 0–3000)
nbad_frame_slicesNumber of outlier frame–slice combinations (dMRI)
nbad_frame_slices_b{X}Number of outlier frame–slice combinations for b-value X (dMRI; X = 0–3000)
nframes_b{X}Number of frames for b-value X (X = 0–3000)
ngood_framesNumber of frames without outlier slices (dMRI)
ngood_frames_b{X}Number of frames without outlier slices for b-value X (dMRI; X = 0–3000)
nonbrain_{mean|std|snr}Mean, standard deviation, or SNR of image intensity outside the brain mask
nrepsNumber of repetitions or frames
NumberOfFilesNumber of DICOM files
NumberOfFilesExtraNumber of extra DICOM files received, including non-image, corrupt, or duplicate files
NumberOfFilesMissingNumber of DICOM files apparently missing based on gaps in InstanceNumber values
NumberOfFilesOrigNumber of DICOM files received before excluding non-image, corrupt, or extra files
NumberOfFilesValidNumber of valid DICOM files after excluding non-image, corrupt, or extra files, but before excluding files from the final partial frame
Num{Head|Neck|Spine}CoilElemNumber of head, neck, or spine coil elements
part_of_a_pairWhether the DWI file is part of a pair
qc_selectionWhether the series is selected for manual QC
qc_statusManual QC review status, such as pending or complete
revdispWhether manual QC reviewers disagreed
subthresh_{02|03|04}Number of seconds with framewise displacement below 0.2, 0.3, or 0.4 mm
tSNR_b{X}Median temporal SNR within the brain mask for b-value X (X = 0–3000)

Protocol Adherence & Completeness Checks🔗

Acquired imaging data are automatically uploaded to central servers, where they undergo automated protocol compliance and completeness checks. Data that fail are flagged for review and excluded from release until the issues are resolved.

  • Protocol compliance is performed by extracting imaging parameters from DICOM headers to confirm that key parameters (e.g., voxel size, TR, orientation) match the expected scanner protocol. Out-of-compliance series are flagged for review, with site followup as necessary.
  • Completeness checks verify that all expected series are present in each imaging session. Missing data may be caused by aborted scans, incomplete sessions, and/or incomplete data transfer. Valid sessions are expected to include: T1w & T2w, 2 resting state functional runs (each accompanied by fieldmaps acquired in AP/PA phase encoding directions), diffusion scans (acquired AP/PA), quantitative QALAS and B1 maps, and MRS scan and SVS localizer.

Automated QC🔗

Data that pass protocol adherence and completeness checks move to the next stage of automated QC, calculated for modalities as follows:

Modality Automated QC Metrics
sMRI & qMRI
  • Estimate motion artifacts using a deep learning model
  • Compute signal-to-noise ratio (SNR)
fMRI
  • Estimate head motion with average framewise displacement and data (sec) at FD thresholds of 0.2/0.3/0.4 mm (Power et al., 2012)
  • Detect line artifacts and FOV cutoff
  • Compute spatial smoothness (FWHM) and temporal SNR (tSNR) after motion correction (Triantafyllou et al., 2005)
dMRI
  • Estimate head motion (framewise displacement, FD)
  • Refine motion estimates via registration to tensor-synthesized images (Hagler et al., 2009)
  • Identify dark slices (caused by abrupt head movements) using RMS difference between raw and tensor-fitted data
  • Calculate total slices and frames with motion artifacts
  • Detect line artifacts and field-of-view (FOV) cutoff
Field Maps Detect line artifacts and field-of-view (FOV) cutoff
All Compute SNR where applicable

Manual Review🔗

Data are flagged for manual review based on automated QC results using multivariate prediction and Bayesian classifiers, so only a subset undergoes both automated and manual review. When a series is flagged, trained technicians perform visual review and rate artifact severity on a 0–3 scale: none (0), mild (1), moderate (2), or severe (3). Series rated 3 (severe) are automatically assigned an overall QC score of 0 (Fail) and excluded from downstream processing. For all others, final selection is informed by manual ratings, reviewer notes, and automated QC metrics.

Modality Manual QC Procedures & Scoring
sMRI
  • Motion artifacts (ripples, blurring), scored 0–3
  • Document additional issues (e.g., intensity inhomogeneity, ghosting
qMRI
  • Same artifact scoring (0–3)
  • Inspect derived data (parametric maps, ROI analysis, quantitative checks for 3D-QALAS)
dMRI, fMRI, fmaps
  • Score susceptibility artifacts, FOV cutoff, and horizontal line artifacts (present in sagittal view)
  • Note susceptibility artifacts, including signal dropout (common in posterior occipital cortex of infant fMRI data acquired in PA phase encoding direction), signal bunching, and warping
MRS
  • Visual inspection and overall QC only of SVS localizer (used to define spectroscopy ROI)

BrainSwipes🔗

BrainSwipes is a gamified crowdsourcing platform used to perform manual QC of processed MRI data. Reviewers assess images from XCP-D visual reports, displaying a series of brain images in coronal, axial, and sagittal planes, and classify each report as Pass (1) or Fail (0).

BrainSwipes results are included in the Tabular Imaging domain:

  • Report-level QC metrics: mean QC score and number of reviewers for each visual report
  • Subject-level QC metrics: mean QC score and average number of reviewers across all reports for a participant
BrainSwipes example
QC Assessment What is Evaluated
Surface Delineation Accuracy of cortical surface placement and gray/white matter boundaries
Atlas Registration Alignment between the participant's anatomical image and the reference atlas
Functional Registration Alignment between functional and structural images and detection of major artifacts such as signal dropout

Where to find QC data in release🔗

MR quality control (QC) is performed at multiple stages of data processing. The release includes the following QC metrics, reports, and manual review results, displayed below in roughly chronological order (from raw data QC to group-level analyses provided in the release documentation):

QC Source Stage Description Release Data
Raw MR QC Raw DICOM Automated and manual QC metrics, including compliance/completeness checks scans.tsv files
MRIQC Raw BIDS Automated image quality metrics MRIQC derivatives
Pipeline QC Reports Processing Pipeline-generated visual reports and automated metrics Derivatives
BrainSwipes Post-processing Manual review results for structural and functional XCP-D QC reports Tabular Imaging
Release QC Summaries Group analysis Group-level analyses/QC summaries provided in documentation, e.g., fMRI and dMRI QC Summary Statistics Release documentation

Dean III, D. C., Tisdall, M. D., Wisnowski, J. L., Feczko, E., Gagoski, B., Alexander, A. L., ... & HBCD MRI Working Group. (2024). Quantifying brain development in the HEALthy Brain and Child Development (HBCD) Study: The magnetic resonance imaging and spectroscopy protocol. Developmental Cognitive Neuroscience, 70, 101452. https://doi.org/10.1016/j.dcn.2024.101452

Gard, A. M., Hyde, L. W., Heeringa, S. G., West, B. T., & Mitchell, C. (2023). Why weight? Analytic approaches for large-scale population neuroscience data. Developmental Cognitive Neuroscience, 59, 101196. https://doi.org/10.1016/j.dcn.2023.101196

Hagler, D. J., Jr, Ahmadi, M. E., Kuperman, J., Holland, D., McDonald, C. R., Halgren, E., & Dale, A. M. (2009). Automated white-matter tractography using a probabilistic diffusion tensor atlas: Application to temporal lobe epilepsy. Human Brain Mapping, 30(5), 1535–1547. https://doi.org/10.1002/hbm.20619

Power, J. D., Barnes, K. A., Snyder, A. Z., Schlaggar, B. L., & Petersen, S. E. (2012). Spurious but systematic correlations in functional connectivity MRI networks arise from subject motion. NeuroImage, 59(3), 2142–2154. https://doi.org/10.1016/j.neuroimage.2011.10.018

Triantafyllou, C., Hoge, R. D., Krueger, G., Wiggins, C. J., Potthast, A., Wiggins, G. C., & Wald, L. L. (2005). Comparison of physiological noise at 1.5 T, 3 T and 7 T and optimization of fMRI acquisition parameters. NeuroImage, 26(1), 243–250. https://doi.org/10.1016/j.neuroimage.2005.01.007