A tight relation between the age distributions of stellar clusters and the properties of the interstellar medium in the host galaxy