To effectively contain the spread of Coronavirus disease (COVID-19), public health agencies mandated special regulations. Though they protect us from COVID-19, these restrictions have inevitably changed the environment around us. It remains unclear how these changes may have impacted early cognitive development among infants born during the pandemic. Thus, this study examined how the COVID-19 restrictions have affected infants’ face recognition ability, a hallmark of their cognitive capacities. Specifically, we used the familiarization and visual pair comparison paradigm to examine face recognition performance among infants between 6 and 14 months of age amid the second wave of the pandemic (February to July 2021). Experiment 1 investigated the recognition of unmasked faces and found that only younger infants, but not older infants, recognized faces by showing a novelty preference. Experiment 2 examined the recognition of faces wearing a mask and found that only older infants, but not younger ones, recognized faces by exhibiting a familiarity preference. These results suggest that with limited interactions during the pandemic, infants could have developed an overly specialized face processing ability that failed to recognize the faces of strangers. Moreover, infants could have obtained more information on masked faces during the pandemic and adapted to the current situation. We further confirmed the restriction on infants’ interpersonal experiences with a survey conducted both before and during the pandemic. Overall, these findings demonstrated how the pandemic altered early perceptual development and further confirmed that interpersonal experiences during infancy are critical in their cognitive development.