Cadernos de Saúde Pública
ISSN 1678-4464
33 nº.12
Rio de Janeiro, Dezembro 2017
ARTIGO
Escala de Estresse Percebido: análise fatorial confirmatória das versões EEP14 e EEP10 em duas amostras de gestantes da coorte BRISA
Ana Valéria Carvalho Pires Yokokura, Antônio Augusto Moura da Silva, Juliana de Kássia Braga Fernandes, Cristina Marta Del-Ben, Felipe Pinheiro de Figueiredo, Marco Antonio Barbieri, Heloisa Bettiol
http://dx.doi.org/10.1590/0102-311X00184615
Gestantes; Estresse Psicológico; Análise Fatorial
Introduction
Stress is a process of body reactions to everyday situations - called stressors - that can threaten a person's well being 1. The pregnancy period is considered a phase of emotional stress due to numerous and intense feelings associated with physiological and physical changes 2,3. Stress may be present in more than 75% of pregnant women, and frequent exposure to long-term stressors can involve health risks 4,5,6,7.
Maternal exposure to prenatal stress is associated with hypertension, spontaneous abortion, and preterm delivery 8. The fetus may show increased heart rate and impaired development, in addition to predisposition to mental diseases, allergies and asthma 9. Stress during pregnancy affects the behavior and emotional control of the children, making them more irritable, restless and prone to attention problems 8,10. Because of the high prevalence of stress during pregnancy and its association with adverse effects on the health of both mother and child, it is important to detect stress early in pregnancy using valid and reliable tools.
In 1983, Cohen et al. 11 elaborated the Perceived Stress Scale (PSS), which was applied to a sample of university students in the United States. The scale is based on the observation of the extent to which an individual perceives as stressful different situations faced throughout his/her life 12. There are three versions of the scale, one with 14 items (PSS14), corresponding to its complete version, and two reduced versions, with ten (PSS10) and four items (PSS4) - the latter is more used in telephone surveys. PSS has been widely used throughout the world 13,14,15,16,17,18,19,20 and was translated into several languages besides English: Arabic 10, Chinese 21, Thai 16, Mexican Spanish 18, Spanish 22, Greek 19, Japanese 20, French 23, and Brazilian Portuguese 24. PSS can be used for stress detection in a given population because it does not contain specific context questions 11,25.
In Brazil, the first study about the psychometric properties of PSS was conducted by Luft et al. 24 in Santa Catarina State. The scale was translated into Portuguese, and semantic, idiomatic, experimental, cultural and conceptual equivalences were evaluated. Through the principal component analysis (PCA), PSS showed good fit as a two-dimensional construct for the complete version (PSS14), and as a one-dimensional construct for the short version (PSS10).
Machado et al. 12 also found a one-factor solution similar to that of Luft et al. 24 for the PSS10 using PCA in a sample of school teachers in northeastern Brazil. However, Reis et al. 26, using PCA and confirmatory factor analysis (CFA) with the maximum likelihood (ML) estimator, found the two-factor solution to have the best fit in a sample of university teachers in southern Brazil. Recently, Faro 27 tested the three versions of PSS in the general population of Aracaju (Sergipe State), by CFA with the ML estimator, and found the two-factor model to be the best solution. Dias et al. 28 tested the one-factor model for the three versions of PSS in female university students using CFA with the ML estimator. They concluded that PSS10 presented the better fit, validity, internal consistency and stability compared to the two other versions. However, they did not test the two-factor solution.
Several validation studies of PSS have been carried out. However, there is no consensus in the literature about its dimensionality. A recent review pointed out that most of the studies highlight the two-factor model as having the best fit when compared to the one-factor model 29. In contrast, in Brazil, most studies found the best fit for the one-factor solution, especially for PSS10 12,24,28.
The lack of consensus about the PSS dimensionality may have been due to inadequate analytical strategies used in most previous studies. Most studies have examined the psychometric characteristics of the scale using PCA 12,17,24,25,30, which is a technique of data reduction that provides limited psychometric information and is not recommended to identify common factors and latent variables 14,30,31. In addition, we did not find investigations on PSS validity using CFA with the weighted least squares mean and variance adjusted (WLSMV) estimator 32, which is more appropriate for categorical variables. All studies that applied CFA used the ML estimator 14,16,18,19,21,26,27,28.
Moreover, validation studies of PSS have been conducted predominantly on samples of university professors, students and workers 29, whereas there is a lack of studies examining the PSS validity among pregnant women. Only one Arabic study analyzed the psychometric properties of the scale in a small sample (n = 113) of pregnant women 10.
Thus, this study aimed to evaluate the dimensional structure of two PSS versions (PSS10 and PSS14) using CFA, with the WLSMV estimator among pregnant women in two cities from two different Brazilian regions with contrasting socioeconomic conditions. In addition, reliability, convergent validity, discriminant validity and scalability were assessed. Finally, we believe that this broader analysis may provide further evidence of PSS validity in the Brazilian context.
Methods
Study design
This is a cross-sectional study and the data were obtained from the cohort study Etiological Factors of Preterm Birth and Consequences of Perinatal Factors for Child Health: Brazilian Birth Cohort Study of Ribeirão Preto and São Luís - BRISA23. The study was conducted in two Brazilian cities located in distinct regions. Details of the methods have been published elsewhere by Silva et al. 33.
Ribeirão Preto is located in the State of São Paulo, Southeastern Brazil, in a wealthy and industrialized region. Its Human Development Index (HDI) is 0.800, occupying the 40th place in Brazil. It had 604,682 inhabitants in 2010 and the per capita income was BRL 1,314.04 (USD 573.82). It is one of the most developed cities in Brazil, with 99% of residences receiving piped water and equipped with sanitary sewage (http://www.atlasbrasil.org.br/2013, accessed on 20/Jan/2015).
São Luís, the capital of the State of Maranhão, is located in the Northeastern region of the country. Its HDI is 0.768, occupying the 249th place in Brazil. It had 1,014,837 inhabitants in 2010 and the per capita income was BRL 805.36 (equivalent to USD 351.69). The city is in one of the poorest regions of the country, where only 50% of households are equipped with sanitary sewage, and 75% receive piped water (http://www.atlasbrasil.org.br/2013, accessed on 20/Jan/2015).
Participants
A total of 1,447 pregnant women from São Luís participated in the study, from February 2010 to June 2011. In Ribeirão Preto, the sample consisted of 1,400 pregnant women who were interviewed from February 2010 to February 2011. Both groups were convenience samples due to the difficulty of obtaining a random sample of pregnant women from the two cities.
Data collection
Previously trained undergraduate students contacted the women during the prenatal period in ultrasound clinics, prenatal outpatient clinics and public and private maternity hospitals. Those who had performed obstetric ultrasound before the 20th gestational week, when gestational age is determined more reliably, were invited to participate. Women with multiple fetuses were not included.
The interviews were held at the Clinical Research Center of the Mother-Child Unit of the University Hospital in São Luís, and at the Clinical Research Unit of the University Hospital, University of São Paulo, in Ribeirão Preto. Women completed a self-administered questionnaire about PSS during this visit when their gestational age was 22 to 25 weeks.
Measuring instrument
The PSS was the instrument used to measure stress during pregnancy, which evaluates the perception of stressful experiences in the preceding month using a Likert-type five-point scale 11. PSS contains 14 items, seven of them positive and seven negative, and responses range from 0 to 4 (0 = never; 1 = almost never; 2 = sometimes; 3 = fairly often; 4 = very often).
Most questions reflect negative feelings and the inability to deal with stress, although some questions address positive emotions and the ability to act in stressful situations 10. All items were designed to identify to what extent the respondents evaluate their life as unpredictable, uncontrollable and overloaded, and included central components of the experience of stress. The version used in this study was translated and adapted to Brazilian Portuguese by Luft et al. 24 and was self-administered.
Data analysis
Data analysis was conducted following the procedures here described:
(a) We first tested PSS with 14 categorical questions (PSS14) as a one-factor latent variable. Then we tested PSS14 as a two-factor latent variable, composed of two dimensions, one positive and the other negative. After this, we tested PSS10 as a one-factor solution or a two-factor solution. We used the WLSMV estimator, suitable for the analysis of categorical variables 32.
(b) Global model fit was evaluated by the following fit indices: root mean square error of approximation (RMSEA) - values close to 0.06 or below indicate good fit 34,35; values lower than 0.08 suggest adequate model fit 35,36, and values ≥ 0,10 indicate poor model fit 35,36; comparative fit index (CFI) and Tucker-Lewis index (TLI) ≥ 0.95 suggest good model fit 34,35, and values from 0.90 to < 0.95 indicate acceptable model fit 37. The chi-square test was also calculated but not used to assess the model fit because of its sensitivity to a large sample size.
(c) Scale reliability was estimated using internal consistency indicators: Cronbach's alpha (α) and composite reliability (CR), which were considered acceptable when ≥ 0.70 38. These two measurements of internal consistency were calculated for each of the two PSS dimensions (positive and negative) to determine whether the questions corresponding to each dimension were consistently measured in the two studied samples.
(d) Convergent validity was evaluated based on the factor loadings and the average variance extracted (AVE). The latter was considered to be appropriate when ≥ 0.50 39. Factor loadings ≥ 0.50 and statistically significant were considered to be supportive of convergent validity 35,38. High correlations between each PSS dimension and psychological violence were used to indicate adequate convergent construct validity 39. Psychological violence was measured using the World Health Organization (WHO) violence against women questionnaire. Women were asked four questions 40: since you became pregnant has someone insulted, belittled or humiliated, intimidated or scared, or threatened to hurt you? Answers on a Likert scale were coded 0 = never; 1 = once; 2 = a few times; 3 = many times. A one-factor latent variable to measure psychological violence has been validated in a previous study 41.
(e) Factor correlations < 0.85 between the PSS 39 positive and the negative factors and √AVE ≥ those correlations were considered to be supportive of adequate discriminant validity 38.
(f) We used the Mokken criteria to identify if some items could be excluded from the scale. Therefore, the Loevinger's H scalability index (HS) was calculated for each dimension of the scale and for each item. HS evaluates if the items measure the same latent trait and if there is item redundancy and validates the score as an ordinal measure of the latent trait. HS is considered acceptable for each item if > 0.30. Scalability was considered weak if 0.30 ≤ HS < 0.40, medium if 0.40 ≤ HS < 0.50 and strong if ≥ 0.50 42.
(g) We inspected the residual correlation matrix for values > 0.10 and calculated the modification indices 43.
The data from São Luís were analyzed first. Then the data from Ribeirão Preto were used as a validation sample to determine the stability of the factor solution in the two groups 44. The samples were analyzed separately following the same steps and procedures. The analyses were carried out using the Stata 11.0 statistical package (StataCorp LP, College Station, USA) and MPLUS 7.0 (Muthén & Muthén, Los Angeles, USA).
Ethical aspects
The Ethics Research Committees of the University Hospital, Federal University of Maranhão (protocol n. 4771/2008-30) and of the University Hospital, Faculty of Medicine of Ribeirão Preto (protocol n. 4116/2008) approved the study. All subjects gave written informed consent to participate.
Results
Table 1 Results of the confirmatory factor analysis of the Perceived Stress Scale - PSS14 and PSS10 versions. São Luís, Maranhão State, and Ribeirão Preto, São Paulo State, Brazil, 2010/2011.
|
Table 2 Factor loadings, measurement errors, factor correlations, Cronbach's alpha, composite reliability (CR), average variance extracted (AVE) and square root of the average variance extracted (√AVE) from the Perceived Stress Scale - PSS14 and PSS10 versions. São Luís, Maranhão State, and Ribeirão Preto, São Paulo State, Brazil, 2010/2011.
|
For the Ribeirão Preto sample, PSS14 showed low factor loadings for items 8 (0.33) and 12 (0.09), and the residual variances of these items were high (0.89 and 0.99). Factor correlations, Cronbach's alpha and composite reliability were satisfactory. However, AVE was < 0.50. PSS10 had a low factor loading for item 8, and the correlation between the positive and negative factors was -0.78. Cronbach's alpha was > 0.70 for the two factors. AVE was 0.50 for the positive factor but still below 0.50 for the negative dimension. However, AVE was higher for the abbreviated PSS10 compared to the full PSS14 scale. The AVE square roots for the positive and negative dimensions of the PSS14 and PSS10 models were all lower than their factor correlations
Because low factor loadings were found for the same items in the São Luís and Ribeirão Preto models, we estimated the Loevinger's H scalability index to detect the viability of excluding these items with low factor loadings. No major violations of the monotonicity assumption occurred. As shown in
Table 3 Loevinger's H for each item and for each dimension of the Perceived Stress Scale - PSS14 and PSS10 versions. São Luís, Maranhão State, and Ribeirão Preto, São Paulo State, Brazil, 2010/2011.
|
The residual correlation matrix showed few values slightly > 0.10. Among the modification indices suggested, none was deemed theoretically justifiable (suggestions for modification included cross loadings between the negative and positive dimensions). We considered that it is not possible for an item to measure at the same time a negative (suffering due to stress) and a positive (coping satisfactorily with stress) dimension.
Discussion
CFA identified a two-factor structure for the PSS 10- and 14-item versions as showing the best fit for both São Luís and Ribeirão Preto samples. The two-factor models presented satisfactory fit indices, good reliability, and convergent and discriminant validity, in addition to acceptable scalability. AVE and scalability were slightly higher for PSS10 than for PSS14. The results were consistent for both São Luís and Ribeirão Preto samples.
In São Luís, both two-factor PSS10 and PSS14 models presented good fit indices (RMSEA close to 0.06; CFI and TLI > 0.95) 34,35,36. In Ribeirão Preto, the 10-item model showed adequate fit and the 14-item version showed acceptable fit (RMSEA close to 0.08). Although this index calculates the error of approximation to the population 45, values in the 0.08-0.10 range are admissible when other fit indices are considered good, which was the case in Ribeirão Preto, where the two-factor PSS14 model had CFI and TLI > 0.95. Furthermore, it has been suggested that the model should be rejected only when RMSEA > 0.10 35,36. Thus, in both samples two-factor PSS10 and PSS14 models with positive and negative dimensions showed good or at least acceptable fit.
PSS scale has the advantage of assessing an individual's behavior before a stressful situation. Our results indicate that PSS is a construct with two dimensions, one composed of positive items, measuring “perceived coping”, and the other with negative items to measure “perceived distress”. If the person reacts negatively when the body does not adapt to the new situation, and responds in a misplaced way to the stimulus that caused this situation, this is called “perceived distress,” which is measured by the negative dimension of the scale. If the person responds positively, demonstrating resilience and coping capacity, this strategy is considered “perceived coping”, and is measured by the PSS 46 positive dimension. In this study, we called “perceived coping” a positive factor, and “perceived distress” a negative factor.
Good internal consistency indicates that the items consistently measure the same latent variable and are thus reliable 38. The two-factor PSS10 and PSS14 models had good internal consistency (α ≥ 0.70 and CR ≥ 0.70). In addition, internal consistency for the negative dimension was higher for PSS10 compared to the PSS14, whereas for the positive dimension it was lower for PSS10 than for PSS14. Internal consistency is a function involving the number of items and the value of factor loadings 47. Item 12 of the negative dimension, and items 4, 5 and 13 of the positive dimension were excluded by Cohen & Williamsom 25 when they proposed the reduced PSS10 version because these items had low factor loadings. In our samples, items 12 and 13 also showed low factor loadings, but items 4 and 5 did not. The higher internal consistency for the PSS10 negative dimension compared to the PSS14 may be explained by the exclusion of item 12, which had a very low factor loading (0.09) in our samples. Conversely, lower internal consistency for the PSS10 positive dimension compared to the PSS14 in our samples may be explained by item reduction (from seven to four items) and also by the exclusion of two items (4 and 5) that did not have low factor loadings in our data. However, internal consistency for the reduced PSS10 remained good (≥ 0.70) in both samples, even after the exclusion of the two items (4 and 5), with factor loadings in the range 0.60-0.70 in the PSS14 model.
Construct validity indicates the extent to which a set of measured variables reflects the theoretical latent construct that those indicators are supposed to measure. According to Raykov & Marcoulides 39, no single test can determine construct validity and its assessment should be largely based on theory and not on single tests and fixed cutoff points. High reliability is a precondition for validity, but a construct may be reliable but lack validity 39. Therefore, estimating correlations between different constructs is essential to address construct validity 48. Strong correlations between measurements of closely related constructs provide evidence of convergent validity, whereas weak correlations between measurements of unrelated constructs are indicative of discriminant validity 39. Some authors consider AVE an indicator of convergent validity 38,49, but this view has been questioned by some authors - Valentini & Damásio 47 argue that AVE does not measure convergent validity but is rather a reliability indicator, closely resembling CR.
Construct validity was investigated based on factor loadings, AVE and the correlations between closely related constructs. Ideally all factor loadings should be greater than 0.70 or at least ≥ 0.50 38 and statistically significant. All but three factor loadings were ≥ 0.50 (items 8 and 12 for the negative dimension and item 13 for the positive dimension). AVE was < 0.50 for all PSS10 and PSS14 dimensions in both samples, and values were much lower for the negative dimension. This may imply problems in convergent validity, because most of PSS variance was explained by measurement error rather than by the latent trait it is supposed to measure 38. However, the cutoff point suggested by some authors to indicate adequate convergent validity may be too stringent. According to Valentini & Damásio 47, AVE tends to reject indiscriminately models with low factor loadings, especially when the variances of the factor loadings are low (in our samples standardized variances of the factor loadings were very low, in the 0.017-0.025 range). An AVE of 0.50 corresponds to factor loadings around 0.70. Thus, it is not consistent to recommend factor loadings of at least 0.50 or higher and an AVE ≥ 0.50, since factor loadings of 0.50 corresponds to an AVE around 0.25. Low AVE values, which explain less than 50% of total variance, are commonly found in validation studies of other psychometric measures 50. In another PSS validation study in Brazil AVE was 0.34 28.
The correlations between the PSS10 and PSS14 positive and the negative subscales varied from -0.78 to -0.74 and were extremely significant. However, they were not too high (< 0.85), which suggest that, although the factors were part of a higher order latent variable, they reflected some characteristics that are unique to each factor. According to this criterion, discriminant validity exists between the subscales. On the other hand, the AVE square roots for the PSS14 and PSS10 positive and negative dimensions (0.58 to 0.71) were all lower than their factor correlations (0.72 to 0.81), suggesting problems in discriminant validity. Nevertheless, this criterion has been considered to be too stringent to provide evidence for separateness of sub-scales within a multidimensional scale 51.
The correlations between the two dimensions of stress (perceived coping and perceived distress) with psychological violence were within the expected range (0.46-0.59), suggesting adequate convergent construct validity. The correlations indicate that those constructs measure different things but are moderately or weakly associated because psychological violence is expected to increase perceived stress 52. Interestingly, the correlations were higher between psychological violence and perceived distress than between psychological violence and perceived coping.
Because some items had low factor loadings (< 0.50) and high measurement errors (items 8 and 12 for the negative dimension and item 13 for the positive dimension), we investigated the PSS14 and PSS10 scalability to determine if some items had weak scalability and could thus be dropped from the scale. Overall scalability was considered acceptable, but it was weak for the negative dimension and medium for the positive dimension. Items 8, 12 and 13 had low scalability and could thus be excluded from the scale. Item 12 was the most problematic because 99% of its residual variance was not explained by perceived distress. Perhaps “thinking about things that you have to accomplish” may not be translating into an experience of life that measures the perception of stress 27. Alternatively the high measurement error may be due to problems of understanding the content and meaning of the item, or even due to different interpretations about what the researcher intended to convey.
Items 12 and 13 were already removed from PSS14 in the reduced PSS10 scale. Thus, due to this fact, the reduced PSS10 version showed higher scalability values than the complete PSS14 version. However, item 8 “Could you not cope with all the things that you had to do?,” which composes the PSS10, also had low scalability in both of our samples. This has not been found in any of the comparative studies that investigated the PSS psychometric characteristics, including those whose sample consisted only of women 10,13,28, all displaying factor loadings ≥ 0.45 for this item. It is possible that this item has a different meaning during gestation. Perhaps thinking about the things pregnant women had to do might reflect everyday chores and responsibilities that may not always be related to stress. It has been found that women had higher perceived stress than men 14,19,22,23,24,27. Furthermore, Chaaya et al. 10 have shown that pregnant women tend to have more perceived stress than non-pregnant women. Thus, it is possible that pregnant women may perceive stress differently than non-pregnant women, and these different perceptions of stress may influence the scale structure. Studies comparing the factorial structure of the scale between pregnant and non-pregnant women are important to address this question. The possible exclusion of item 8 should be tested in other studies.
It should be pointed out that the use of a convenience sampling limited the external generalization of our findings. A greater proportion of pregnant women who participated in our study belonged to middle economic class C both in São Luís (67%) and Ribeirão Preto (60%). Thus low and high economic classes were underrepresented in our samples.
A strong point of the study is the large sample size obtained in the two cities. An additional strong point is that it is the first Brazilian study to assess the PSS dimensional structure in pregnant women. Some studies have used PSS to measure stress in pregnant women 5,10, but only one of them has tested the validity of the instrument 10 in a very small sample of 113 pregnant women.
In addition, our investigation used CFA with a more appropriate estimation method for categorical data, the WLSMV estimator, whereas the remaining studies that used CFA employed the ML estimator, more appropriate for continuous indicators 18,19,26. The use of CFA has the advantage of estimating convergent and divergent validity adjusting for measurement error 35. Although ML is extensively used in CFA investigations, some problems arise because the method treats categorical variables as continuous ones: (1) the estimated correlations between variables are attenuated, especially when the variables have less than five categories and a high degree of asymmetry; (2) the method produces errors in the estimation of the variance, and also produces incorrect estimation of some parameters 43.
This study contributed to the PSS validation because we used a more adequate method to assess validity (CFA) - criteria to assess model fit were stringent and scalability evaluation was performed. Furthermore, PSS was evaluated in two cities in a middle-income country with contrasting socioeconomic indicators.
Our results suggest that the two-factor models showed better fit and internal consistency than one-factor models. Considering all criteria evaluated (fit indices, reliability, convergent validity, discriminant validity, and scalability), the reduced two-factor PSS10 version seems to be a more appropriate scale for measuring perceived stress among pregnant women. Furthermore, the results were consistent in the two samples. However, these results should be corroborated by more studies evaluating the PSS dimensional structure among pregnant women from more diverse socioeconomic backgrounds, since our samples were mainly composed of middle-class women. It is possible that cultural differences and differences in understanding some items may have affected the scale validity.
Acknowledgments
The authors would like to thank the pregnant women who participated in the research, to the Maranhão State Research Foundation (FAPEMA) and the Brazilian Nacional Research Council (CNPq).
References
Cadernos de Saúde Pública | Reports in Public Health
Rua Leopoldo Bulhões 1480 - Rio de Janeiro RJ 21041-210 Brasil
Secretaria Editorial +55 21 2598-2511.
cadernos@fiocruz.br