BACKGROUND
Contemporary psychopathology understands dissociation as a series of altered processes spanning several dimensions, each of which may be involved to a greater or lesser extent (Cardena & Carlson, 2011). Thus, dissociative phenomena can be distinguished according to the areas of functioning affected (American Psychiatric Association, 2022): (1) perception of self and environment, resulting in symptoms such as depersonalization and derealization; (2) physical sensations, resulting in analgesia and anesthesia; (3) personal memory, whose fragmentation leads to dissociative amnesia; and (4) personal identity, whose dissociation can result in dissociative identity, formerly called multiple personalities.
In recent decades, several instruments have been developed and proposed to measure dissociation: Structured Clinical Interview for DSM Dissociative Disorders (Steinberg, 2000), Dissociative Disorders Interview Schedule (Ross et al., 1989), Multidimensional Inventory of Dissociation (Dell, 2006), Dissociation Questionnaire (DIS-Q; Vanderlinden et al., 1993), Somatoform Dissociation Questionnaire (SDQ-20; Nijenhuis et al., 1996), among others. However, the Dissociative Experiences Scale (DES-II) is the most widely used instrument for clinical and research purposes. The DES-II is a widely used psychometric tool to assess dissociative experiences differing in degree and intensity. The original version was developed by Bernstein and Putnam (1986), while the DES-II was adapted by Carlson and Putnam (1993).
Numerous studies throughout the world have supported the validity and reliability of the DES-II as a reliable measure of dissociative experiences. Versions have been adapted in Germany (Spitzer et al., 1998), Spain (Icarán et al., 1996), Finland (Lipsanen et al., 2003), France (Larøi et al., 2013); Israel (Somer et al., 2001), Italy (Garofalo et al., 2015), Mexico (Robles-García et al., 2006) Portugal (Espírito & Abreu, 2009), Puerto Rico (Martinez-Taboas, 1995), and Sweden (Körlin et al., 2007). These studies have shown that the DES-II has good internal consistency and adequate validity indicators. However, there is no absolute agreement on the internal structure of the DES-II.
The main criticism of the DES-II by academics is the large number of studies reporting different factorial models underlying the 28 items of the instrument. The primary and most widely accepted factorial proposal is that of Bernstein and Putman (1986), who reported an internal structure of three fundamental factors: absorption, depersonalization/realization, and amnesia. Several subsequent psychometric studies have endorsed the three-factor proposal, although these factors sometimes collect different items (Mazzotti et al., 2016; Ruiz et al., 2008; Stockdale et al., 2002). Other studies have reported two-factor (Garofalo et al., 2015; Larøi et al., 2013), four-factor (Espírito & Abreu, 2009; Ray & Faith, 1995), and seven-factor (Ray et al., 1992) internal structures, while others argue that this is a unidimensional measure of dissociation (Holtgraves & Stockdale, 1997; Saggino et al., 2020). It should be noted that many of these studies have been conducted with exploratory factor analyses and with very varied samples.
The inconsistent variability of factor structures across psychometric studies and the large amount of shared variance among factors in the multidimensional models of the DES-II could be an indicator of unidimensionality; that is, the DES-II measures the dissociation construct in a general way (Holtgraves & Stockdale, 1997; Saggino et al., 2020). Clarifying this issue is of utmost importance as clinicians and researchers may risk making erroneous inferences from the results obtained by factors or dimensions.
Adverse Childhood Experiences and Dissociation
Adverse Childhood Experiences (ACEs) refer to traumatic or stressful events that a child may experience during childhood, such as abuse, neglect, domestic violence, and parental divorce, among others. The relationship between ACEs and dissociation is that ACEs may increase the risk of developing dissociation in adulthood (Chiu et al., 2017; Fung et al., 2019). Children who experience trauma in childhood often develop coping strategies, such as dissociation, to cope with the pain and anxiety they experience (Fung et al., 2019).
It is important to note that not everyone who experiences ACEs will develop dissociation, as the response to trauma can vary widely by person and situation. However, there is a recognized correlation between exposure to ACEs and an increased risk of mental health problems in later life, including dissociation in some cases. For this reason, I will use the ACEs Questionnaire as a validity measure, expecting I will find a positive relationship between ACEs and DES-II. Similarly, people with dissociative disorders are expected to obtain higher scores on the DES-II (Lyssenko et al., 2018).
This research aimed to examine the psychometric properties of the Dissociative Experiences Scale (DES-II) and analyze the internal structure of the DES-II using confirmatory factor analysis (CFA) to determine the best-fitting competing model in Puerto Rico and to identify the dimensions underlying the 28 items.
METHOD
Design
In this research, I used a non-experimental, cross-sectional, instrumental design (Ato et al., 2013).
Participants
A sample of 341 Puerto Rican adults was recruited by distributing a paid advertisement on Facebook and Instagram social networks. The mean age of the sample was 43.99 (SD = 13.77). In terms of mental health, 32% (n = 109) receive individual psychotherapy services, 29.9% (n = 109) receive psychiatric services, and 40.8% (n = 139) have a professionally diagnosed mental health disorder. Table 1 presents the general characteristics of the sample.
Instruments
Dissociative Experiences Scale (DES-II). This scale consists of 28 self-report items measuring dissociative experiences and phenomena. DES-I and DES-II only differ in the format of responding to their items: the first version uses a 100 mm visual analog scale, and the second version uses a Likert-type scale with 11 response options ranging in 10% increments from 0% (never) to 100% (always). The total score is obtained by calculating the mean of the scores of the 28 items and can range from 0 to 100, where scores of 30 or more indicate high levels of dissociation (Putnam et al., 1996). For the present study, I revised the 28 items of the Martinez-Taboas (1995) version to ensure that it is understandable and applicable to the current population. None of the items were altered in idea or content. In the sample used in this study, my version obtained excellent internal consistency (α = .95; ( = .96).
Adverse Childhood Experiences Questionnaire (ACEs). The ACEs assess experiences of physical, emotional, and sexual maltreatment, lack of physical and emotional care, or dysfunctional family problems. In this study, I used the Spanish version of the California Surgeon General's Clinical Advisory Committee (available at https://www.acesaware.org/), which contains ten items that are answered by dichotomous responses (yes = 1, no = 0), indicating the occurrence of adverse experiences during the first 18 years of life. The scale's total score is obtained by summing the number of “yes” answers given by the person. Minimum scores range from 0 to 10. In this study, the ACEs obtained an acceptable internal consistency (α = .68; ( = .67) according to Streiner's criteria (2003 ).
Procedure
Data were collected using an online questionnaire on the PsychData platform. For this, I disseminated a promoted advertisement on Facebook and Instagram that provided general information about the study and a link directing people to the online survey. I employed an informed consent sheet to notify people about the purpose of the study, its voluntary nature, potential risks, and their right to withdraw at any time. I was also informed about the duration of their participation and their right to access the study results.
Statistical analysis
Once the data collection was completed, I downloaded them into the IBM SPSS Statistics version 29 program template. I carried out descriptive analyses, data distribution analysis, correlation, discrimination, and reliability analyses in this database. I used the STATA version 15.1 program to evaluate the multivariate normality of the data using the Doornik-Hansen (2008) statistical test. In STATA, I performed several CFAs using the maximum likelihood estimation method and the corrections of Satorra and Bentler (2001). To evaluate the CFAs, I considered the Chi-Square (χ2), Root Mean Squared Error of Approximation (RMSEA; values should be less than .08 to indicate a good fit), Tucker-Lewis Index (TLI), the Comparative Fit Index (CFI), and the Akaike Information Criterion (AIC). For the model to be considered well-fitted, the CFI and TLI values must exceed .95 (Byrne, 2010). I used the AIC to examine parsimony and compare models, where the model with the lower index would reflect a lower fit (Schumacker & Lomax, r2010). To calculate whether the sample size is sufficient to calculate the CFI and RMSEA, I used the Sample size calculator from Arifin (2023).
Following the recommendations of Fornell and Larcker (1981), I examined the convergent and discriminant validity of the DES-II using the Average Variance Extracted (AVE). To support convergent validity, the AVE must be equal to or greater than .50 (Bagozzi & Yi, 1988; Fornell & Bookstein, 1982). Although values lower than .50 can be considered adequate in certain circumstances: many items, standardized factor loadings greater than .50, and McDonald's Omega and Hancock and Müeller's H coefficients greater than .70 (Moral de la Rubia, 2019). In turn, to determine the discriminant validity of each DES-II factor, the Maximum Shared Variance (MSV) and the Average Shared Variance (ASV) must be lower than the value obtained from the individual AVE of each factor. The correlation between the DES-II factors was calculated using Spearman's rho coefficient. To interpret the correlations, I used Schober's classifications (Schober et al., 2018).
Given that the correlations between the factors in the multidimensional model with the highest fit were between large and unitary, I decided to assess the possible presence of a general factor (GF) using a bifactor model (Reise, 2012). Given that the commonly accepted and used goodness-of-fit indices tend to favor bifactor models (Gignac, 2016), I followed the recommendations of Dominguez-Lara and Rodriguez (2017) and calculated other statistical indicators to examine the robustness of the GF, these are the hierarchical omega (ωh; Zinbarg et al., 2006), the explained common variance by the GF (ECV; Berge & Sočan, 2004), the percentage of uncontaminated correlations (PUC; Reise et al., 2013) and the H of Hancock and Müeller (2001) coefficient. To conclude, in favor of unidimensionality, the ωh should be ≥ .70, the ECV ≥ .60, the PUC ≥ .70, and the H > .70 (Dominguez-Lara & Rodríguez, 2017).
Next, I conducted an item discrimination analysis using the item-total correlation (rbis), whose values must be > .30 (Kline, 2005). In turn, I calculated the reliability of the DES-II using Cronbach's Alpha and McDonald's Omega coefficient, which must be greater than .70 (DeVellis, 2016). To measure the discriminative power of the instrument as a whole, I calculated Ferguson's delta index (δ), which must be greater than .90 (Hankins, 2008). Finally, I calculated the mean scores obtained on the DES-II according to the diagnostic group and the average number of dissociative experiences according to the number of adverse childhood experiences reported by the sample. Differences between means were calculated using the Kruskal-Walli’s test.
Ethics Aspects
The Institutional Review Board (IRB) of the Ponce Health Sciences University in Ponce, Puerto Rico approved the research. The participants could answer the questionnaire after accepting the information under their consent. Informed consent was elaborated which included the objective of the study and the ethical principles of confidentiality, beneficence and non-maleficence, data protection, among others (American Psychological Association (APA), 2017).
RESULTADOS
Descriptive Analyses of the DES-II Items
The means of the DES-II items ranged from 4.34 to 44.55, with standard deviations ranging from 12.623 to 35.652. The results of the Kolmogorov-Smirnov and Shapiro-Wilk tests indicate that the item scores do not exhibit a normal distribution (see Table 2). I also calculated the mean and standard deviation of the sum of the 28 DES-II items (M = 21.50, DE = 7.22). The Shapiro-Wilk test (with Lilliefors correction) indicates that the data do not follow a normal distribution, W(341) = 0.858, p < .001. Similarly, the Doornik-Hansen statistical test shows no evidence of multivariate normality in the scale, χ2(2) = 231.135, p < .001. Due to the lack of normality in the data, I chose to apply the corrections proposed by Satorra and Bentler (2001) for estimating the fit of structural equation models since the lack of normality in the data can affect estimation errors and overall model adequacy.
Note. M = Mean; SD = Standard deviation; Skew = Skewness; Kurtosis = Kurtosis; Standard error of skewness = .132; Standard error of kur-tosis = .263. KS = Kolmogorov-Smirnov; SW = Shapiro-Wilk; Kolmogorov-Smirnov and Shapiro-Wilk degrees of freedom = 341, all p-values < .001; M1 = one-dimensional model; M2 = two-dimensional model; M3 = three-dimensional model; M4 = four-factor model; D = dissocia-tion, AB = absorption, AMN = amnesia, DEP = depersonalization/realization, DST = distractibility; BM = bifactor model; rbis = discrimination indices.
DES-II Competitive Models
Since the sample size was adequate to calculate the CFI and RMSEA (Arifin, 2023), I analyzed five competitive models using CFA: (M1) traditional unidimensional model (28 items in one factor); (M2) two-dimensional model; (M3) three-dimensional model; and (M4) four-dimensional model. These factor models were obtained in previous psychometric studies (Armour et al., 2014). Table 2 shows the distribution of items in each competitive model evaluated. Models M1, M2, and M3 did not demonstrate an adequate fit to the data (see Table 3). Model M4 was the only model that showed adequate fit indices without eliminating items. This model includes four dimensions or factors: absorption, amnesia, depersonalization/realization, and distractibility.
I used the AVE to identify the variance explained by each factor in the items. The higher the AVE value, the lower the error variance. The AVEs of the four dimensions of the M4 fluctuated between .44 and .56 (see Table 4), so they can be considered adequate and evidence convergent validity (Moral de la Rubia, 2019). However, all MSVs and ASVs drastically exceeded the AVEs, indicating an absence of divergent validity in the scale and suggesting that the variance not explained by the latent variables is high compared to the total variance in the data. The high correlations between the latent variables in the M4 model (between .76 and .95) point to the presence of a possible GF that I can label as dissociation or dissociative experiences and that explains more variance in the items than the four specific factors (SF) (see Table 4). To analyze this GF, I used a bifactor or direct hierarchical modeling (BM), as suggested by Dominguez-Lara and Rodriguez (2017). The BM presented more acceptable fit indices than the M4 (CFIsb = .93; TLIsb = .91; RMSEAsb = .05). Statistical indicators examining the robustness of the GF conclude in favor of the unidimensionality of the DES-II (ωh = .93; ECV = .81; PUC = .78; H = .96).
Note. AB = absorption, AMN = amnesia, DEP = depersonalization/realization, DST = distractibility; GF-D = general dissociation factor; AVE = average variance extracted; MSV = maximum shared variance; ASV = average shared variance; α = Cronbach’s alpha; w= McDonald’s Omega coefficient; ωh = hierarchical omega; ECV = explained common variance by GF-D; PUC = percentage of uncontaminated correlations; H = Han-cock and Müeller’s H coefficient; ωhs = hierarchical omega by dimension. Values above the diagonal represent correlations between latent factors, while values below the diagonal represent correlations of direct scores.
Discrimination and Reliability Analysis
The discrimination indices (rbis) of the M4 and the BM ranged between .53 and .81, so all items obtained discrimination indices greater than .30 (see Table 2). Regarding reliability, the DES-II achieved excellent internal consistency values (α = .95; ( = .96). Then, I calculated Ferguson's delta (δ) to measure the discriminative power of the DES-II total score. The results indicated Ferguson's delta of .992, exceeding the minimum value recommended by Hankins (2008).
Dissociative Experiences, ACEs, and Psychiatric Disorders
I analyzed the correlation between ACEs and DES-II total scores. The analysis showed a moderate correlation (rho = .30, p < .001) and statistically significant differences in the ACEs score means, χ2(3, N = 297) = 18.63, p < .001. The higher the ACEs, the greater the dissociative experiences. Finally, I calculated the prevalence of dissociative experiences by the diagnostic group. The principles dissociative disorders obtained statistically higher means, χ2(12, N = 341) = 57.361, p < .001; which is an indicator of criterion validity (see Table 5).
DISCUSSION
The purpose of the present study was to analyze the psychometric properties of the DES-II and, specifically, to examine its internal structure to determine the competitive model (unidimensional or multidimensional) that best fits Puerto Rico. In total, five models with CFA were evaluated: a unidimensional oblique model where all 28 items are loaded on one factor, a two-dimensional model, a three-dimensional model, a four-dimensional model, and a bifactor model. The CFAs showed that the DES-II does not reproduce the three-dimensional structure advocated by the creators of the instrument (Bernstein & Putnam, 1986; Carlson & Putnam, 1993) nor the factorial distributions found in other research in international contexts (Espírito & Abreu, 2009; Garofalo et al., 2015; Larøi et al., 2013; Mazzotti et al., 2016; Ray & Faith, 1995; Ray et al., 1992; Ruiz et al., 2008; Stockdale et al., 2002). This suggests two possible hypotheses: that the internal structure of the DES-II fluctuates according to the sociocultural context in which it is administered or that most of the studies conducted so far have yet to use adequate advanced statistics. For example, many instrumental studies conducted with the DES-II are exploratory rather than confirmatory, except for a few. In addition, very little research has evaluated hierarchical bifactor models (Stockdale et al., 2002) or used the Rasch model to examine the psychometric properties of the DES-II (Saggino et al., 2020). Both methodologies go beyond traditional instrument validation techniques and provide additional information not obtained from the CFA.
The CFA of all the multidimensional models reflected two interesting findings: (1) very high correlations between the dimensions, and (2) the MSVs and ASVs dramatically exceeded the AVEs. When this occurs, one must assume the existence of a general factor (Dominguez-Lara & Rodriguez, 2017; Reise, 2012) and that the variables in the multidimensional model have a significant common variance. In this case, I can hypothesize that the most significant proportion of variance of the 28 DES-II items is explained by a single general factor called dissociation or dissociative symptoms. All statistical indices of unidimensionality adequately assessed the robustness of the general factor. That is, assessing dissociation with the sum of the 28 items of the DES-II is good enough, and it would not be necessary to calculate the scores of the specific dimensions. This finding is congruent with the study of Saggino et al. (2020), who, using the Rasch model, concluded that the DES-II should be treated as a unidimensional dissociation index.
Theoretically, I can understand why most research accepts multidimensional models as the most appropriate; conceptually, absorption, amnesia, or depersonalization are different. Absorption refers to experiences such as becoming lost or self-absorbed in one's thoughts or daydreaming. Dissociative amnesia refers to momentary forgetfulness of events or periods. Moreover, depersonalization involves a feeling of unreality concerning oneself and one's body. Although conceptually distinct experiences, they are complicated to distinguish empirically using the 28 items of the DES-II since a large part of the variance in the observed data is not explained by the latent variables or specific components. This usually happens for two reasons: the measurement model needs to be completed, or the underlying phenomenon (dissociative experiences) might be more complex than initially thought. Now, if we understand dissociation conceptually as a continuum ranging from normal to pathological dissociative experiences (Putnam, 2000), the DES-II can be conceptualized as a comprehensive indicator that reflects the degree of dissociative experiences manifested by an individual, thus denoting a specific rating within a continuous variable. The findings of this study validate this premise, in that continuous line of dissociation, at one extreme are people without mental health diagnoses who obtained a mean of 15.75 on the DES-II, while at the other extreme are people with chronic and pathological dissociative experiences with a mean of 54.80. This same behaviour of the DES-II was reported in the meta-analysis conducted by Lyssenko et al. (2018), who found that scale means increased as they approached dissociative disorders.
The unidimensional findings of this study suggest two possible hypotheses: that the internal structure of the DES-II fluctuates depending on the sociocultural context in which it is administered or that most studies to date have not yet used adequate advanced statistics. For example, many instrumental studies conducted with the DES-II are exploratory (EFA) rather than confirmatory, except for a few. In addition, very little research has evaluated hierarchical bifactor models (Stockdale et al., 2002) or used the Rasch model to examine the psychometric properties of the DES-II (Saggino et al., 2020). Both methodologies go beyond traditional instrument validation techniques and provide additional information not obtained with EFAs or multidimensional CFAs. In summary, our findings support the clinical and research use of the DES-II to identify the presence of dissociative symptoms. However, it should not be used to discriminate or differentiate between factors in multidimensional models (absorption, amnesia, or depersonalization), at least until there is more psychometric evidence to support this role.
Regarding the internal consistency of the DES-II, as in previous studies, our results reflected acceptable reliability values, all above what is suggested by the literature (DeVellis, 2016). The correlations of each item with the total score manifest remarkable internal consistency, and the results provide empirical support for the discriminative power of the scale calculated with Ferguson's delta index. Also, the findings support the convergent validity of the instrument, given that the AVE and the standardized factor loadings of the items exceeded the minimum recommended by the literature (Bagozzi & Yi, 1988; Fornell & Larcker, 1981). Likewise, the moderate correlation between the DES-II and ACEs questionnaire and the statistically significant differences in scale scores by number of ACEs and diagnostic category provide additional evidence for the instrument's validity.
Limitations
Like all research, this study has limitations. First, the sample was collected incidentally and was not random. This makes the generalizability of the results limited. Second, the procedure for collecting the data needed to be revised, which may affect the study means and increase the standard error of measurement. Third, the number of women drastically exceeds the participation of men. On the other hand, following the findings of this study, I recommend administering the DES-II to another sample of participants with more male representation to perform the cross-validation process and test the factorial invariance of the instrument, as well as to evaluate the concurrent validity of the instrument using other scales that measure dissociation. For example, the DIS-Q (Vanderlinden et al., 1993) and the SDQ-20 (Nijenhuis et al., 1996) could be used for the validity process. I also recommend examining the properties of the DES-II in a strictly clinical sample, with a more representation of people with dissociative disorders.
Conclusion
In this study, the CFA with structural equations and the bifactor or direct hierarchical modelling strategy allowed me to contribute new insights into the unidimensional structure of the DES-II and its use in research and clinical settings. Finally, I propose that the 28 items of the DES-II be administered and treated in Puerto Rico as a unidimensional index of dissociation.