Sex differences exist in behaviors, disease and neuropsychiatric disorders. Sexual dimorphisms however, have yet to be studied across the whole brain and across a comprehensive time course of postnatal development. Here, we use manganese-enhanced MRI (MEMRI) to longitudinally image male and female C57BL/6J mice across 9 time points, beginning at postnatal day 3. We recapitulate findings on canonically dimorphic areas, demonstrating MEMRI’s ability to study neuroanatomical sex differences. We discover, upon whole-brain volume correction, that neuroanatomical regions larger in males develop earlier than those larger in females. Groups of areas with shared sexually dimorphic developmental trajectories reflect behavioral and functional networks, and expression of genes involved with sex processes. Also, post-pubertal neuroanatomy is highly individualized, and individualization occurs earlier in males. Our results demonstrate the ability of MEMRI to reveal comprehensive developmental differences between male and female brains, which will improve our understanding of sex-specific predispositions to various neuropsychiatric disorders.