The ability to recognize voices has an impact on our social lives. Voice recognition and memory may be impaired among people with autism. We tested if people who have autism had more difficulty relative to neurotypical controls remembering voices, using the Jena Voice Memory and Learning Test and two relatively large internet-based samples with even numbers of male and female participants. We found that only people who were diagnosed with autism as children (not people diagnosed with autism as adults or neurotypical people) showed voice recognition memory deficits. We replicated this finding in a second independent sample. We are confident about these findings because of our relatively large sample size and our replication. We did not detect any sex differences in voice learning and recognition memory. Our research suggests that not all high-functioning people with autism have voice recognition deficits. Code, data, and output are available here: https://osf.io/dsmka