This study aimed to know the factors associated with quality of life (QOL) of elderly caregivers diagnosed with Alzheimer's disease from the perspective of these individuals. It was a descriptive study with qualitative approach based on the Collective Subject Discourse method. Twenty elderly caregivers diagnosed with Alzheimer's disease participated, during a month, in the period the month September 18 to October 18, 2017. Data collection was done through interviews with caregivers of elderly with Alzheimer's disease. The questions were asked and recorded on tape recorder, with the permission of the interviewee. Data were analyzed by the Descending Hierarchical Classification (DHC). Five classes were obtained: Quality of life concept for the elderly caregiver; Behavior of the elderly with Alzheimer; Memory problems in the elderly and repercussions on the caregiver's work; Change in family caregiver lifestyle; and Repercussion of "being a caregiver" in the quality of life. QOL was related to a range of factors (emotional, physical, financial, disease state in the elderly and the degree of knowledge of the caregiver about the disease). Caregivers have pointed out that non-harmony between these factors can be crucial to affect your personal and professional life as well as your QOL.