Purpose: The level of support needed for adaptive functioning and behavioral problems of individuals with intellectual disabilities (ID) can be a source of stress for caregivers. The aim of this study was to explore the moderating role of caregivers' age on the associations between these stressors and quality of life (QoL) of the family caregivers. As these sources of stress in people with ID can coexist, the triple interaction between stressors and age was also examined. Methods: 208 relatives (mean age = 50.98 years, SD = 12.86) of people with ID participated in the research. Participants answered a questionnaire with sociodemographic variables, measures of stressors (level of support for adaptive functioning of the people with ID and behavioral problems) and measures of QoL (WHOQOL-BREF). Results: The association between the level of support needed for adaptive functioning and lower QoL was only significant among older relatives, whereas the association between behavioral problems and lower QoL was only significant among younger relatives. A three-way interaction between behavioral problems, level of support needed, and age indicated that the association between the level of support for adaptive functioning and QoL in older relatives was greater when there were higher levels of behavioral problems. Conclusions: The role of caregivers' age in their QoL differs depending on the nature of the stressor, and an accumulation of stressors can have a particularly negative impact on older caregivers. Interventions should be adapted for caregivers of different ages and take into account the particular sources of stress they have to cope with.