SciELO - Scientific Electronic Library Online

 
vol.17 número1Compromiso académico en los estudiantes universitarios de la Amazonía Peruana durante el contexto pospandemiaUniversidad digital postpandemia: teoría y aplicación a dos materias económicas índice de autoresíndice de materiabúsqueda de artículos
Home Pagelista alfabética de revistas  

Servicios Personalizados

Revista

Articulo

Indicadores

  • No hay articulos citadosCitado por SciELO

Links relacionados

  • No hay articulos similaresSimilares en SciELO

Compartir


Revista Digital de Investigación en Docencia Universitaria

versión On-line ISSN 2223-2516

Rev. Digit. Invest. Docencia Univ. vol.17 no.1 Lima ene./jun. 2023  Epub 15-Ene-2023

http://dx.doi.org/10.19083/ridu.2023.1618 

Artículos de investigación

Spanish adaptation and validation of the UGEQ questionnaire to assess group cohesion in university students

Adaptación y validación al español del cuestionario UGEQ para la evaluación de la cohesión grupal en estudiantes universitarios

Nicolás Ruiz-Robledillo1 
http://orcid.org/0000-0002-7522-5162

Natalia Albaladejo-Blázquez*  1 
http://orcid.org/0000-0002-9116-9092

Rosario Ferrer-Cascales1 
http://orcid.org/0000-0001-6015-7454

María Rubio-Aparicio1 
http://orcid.org/0000-0002-2599-4246

Juan J Madrid-Valero1 
http://orcid.org/0000-0002-3450-1159

Juan Vela-Bermejo2 
http://orcid.org/0000-0001-8124-3722

Grégoire Bosselut3 
http://orcid.org/0000-0002-0395-0998

1 University of Alicante, Faculty of Health Sciences, Department of Health Psychology, Alicante, Spain

2 University of Alicante, Faculty of Education, Department of Innovation and Didactic Training, Alicante, Spain

3 Univ Montpellier, EuroMov Digital Health in Motion, , IMT Mines Ales, France

Abstract

Introduction:

the assessment of group cohesion is a fundamental aspect in the context of higher education. However, there is a need for appropriate and specific instruments to assess this construct in the university context.

Objective:

to adapt and validate the University Group Environment Questionnaire (UGEQ) group cohesion measure to the Spanish population.

Method:

the sample used for this study consisted of 309 Spanish university students, with a mean age of 22.61 (SD=5.5). For data analysis, a confirmatory factorial analysis was performed, following the structure of the original instrument (UGEQ).

Results:

the results suggest optimal adjustment indices (CFI= 0.92; TLI=0.90; SRMR=0.068 and RMSEA= 0.081 [90% CI: 0.071-0.092]) and appropriate internal consistency (0.88 [95% CI: 0.86-0.90]) and temporal stability.

Discussion:

these findings support the use of the UGEQ as a valid and reliable instrument to assess group cohesion in the Spanish university context.

Keywords: educational environment; educational grouping; higher education institution

Resumen

Introducción:

la evaluación de la cohesión grupal es un aspecto fundamental en el contexto de la educación superior. Sin embargo, existe la necesidad de instrumentos apropiados y específicos para evaluar este constructo en el contexto universitario.

Objetivo:

adaptar y validar el University Group Environment Questionnaire (UGEQ) para evaluar la cohesión grupal en población española.

Método:

la muestra utilizada para este estudio estuvo formada por 309 estudiantes universitarios, con una edad media de 22,61 años (DE=5,5). Para el análisis de los datos, se realizó un análisis factorial confirmatorio, siguiendo la estructura del instrumento original (UGEQ).

Resultados:

los resultados sugieren índices de ajuste óptimos (CFI= 0,92; TLI=0,90; SRMR=0,068 y RMSEA= 0,081 [IC 90%: 0,071-0,092]) y consistencia interna adecuada (0,88 [IC 95%: 0,86-0,90]) y estabilidad temporal.

Discusión:

estos hallazgos apoyan el uso del UGEQ como un instrumento válido y fiable para evaluar la cohesión grupal en el contexto universitario español.

Palabras clave: entorno educativo; agrupación educativa; institución de educación superior

Introduction

Despite its numerous definitions and treatments, the concept of group cohesion, as applied to social areas and contexts, is a key process in terms of strengthening the creation, training and development of working groups, as well as in favoring positive early outcomes (Chang & Bordia, 2001; Barrasa & Gil, 2004). Traditionally, group cohesion was defined as a unitary construct (Fes-tiger, 1950). Over time, however, it has evolved to be considered a dynamic, multi-dimensional construct (Beal et al., 2003; Picazo et al., 2009). The most frequently used, classic definition was proposed by Carron, Brawley and Widmeyer (1998), who defined group cohesion as: "a dynamic process that is reflected in the tendency for a group to stick together and remain united in its pursuit of instrumental objectives and/or for the satisfaction of members’ affective needs". Later, Dion (2000) went on to conclude that social and task dimensions are fundamental to the multidimensional approach of the cohesion construct and are applicable to distinct group types. Social cohesion may be defined as the motivation to develop and maintain interpersonal relationships between group members. Task cohesion refers to the degree to which group members work together to accomplish their common goal (Carless & De Paola, 2000; Picazo et al., 2009; Weinberg & Gould 2010).

Researchers have examined group cohesion in a variety of fields, including the performance of sports teams (Bruner et al., 2014; Carron, 1998; Estabrooks et al., 1999; Eys et al., 2009; Gu & Solmon 2011; & Raedeke,), the employment context (Carless & De Paola, 2000; Riasudeen et al., 2019; Van Pelt, Hut-schemaekers et al., 2020) and the academic environment (Forrester & Tashchian, 2006; Van Leeuwen & Janssen, 2019; Dyson et al., 2020). Similarly, another area of study has looked at issues such as diversity and size of the different groups (Carron & Brawley, 2000; Gitterman, 2019), as well as attitude and personality aspects (Barrick et al., 1998; Deckers et al., 2018). But few studies have examined the assessment of group cohesion and the consequences of it in the context of higher education.

A debate exists regarding the degree of effectiveness in the pursuit of results by strengthening the cohesion of the group and its variables. Buckner (1988) proposed the strengthening of the "psychological sense of community" as an explanatory mechanism for the positive consequences of group cohesion; that is, the individual or group’s work, academic and sociological performance may depend on his/her sense of identity, belonging or brotherhood, with regard to a well-known and shared physical space. Along these lines, individuals who do not feel a sense of identity and do not perceive themselves as belonging to a group are at risk of being disconnected. Therefore, psychological and social factors such as identity (Daniels & Brooker 2014), self-esteem (Murray & Kennedy-Lightsey, 2013) and group cohesion (Marcos et al., 2010; Senior, 2001) may all be relevant to achieve success and improved performance (Thornton et al., 2020).

On the other hand, Carron and Brawley (2000) established two principles that underlie group cohesion: the instrumental or task-focused principle and the social or affective one. While the first considers the goal or intentionality as the axis in terms of creating the diverse groups, the second highlights a positive emotional bond between the individual members (Carron & Brawley, 2000). Furthermore, the type of coexistence existing between both (simultaneous or asynchronous) will determine the measure of group cohesion, based on four factors: group integration regarding the task, group integration regarding the social, individual attraction to the task and individual attraction to the group (Carron & Brawley, 2000; De Vita & Barbarito, 2016).

The scientific literature on group cohesion makes special note of the idea that promoting this cohesion encourages the following: social interaction, work dynamism and the information and learning acquisition processes (Briones & Tabernero, 2005; Segovia, & Fernández, 2010). Likewise, a taxonomy of repeating factors has been found in the diverse studies conducted on group cohesion, favoring this connection between groups (Murray & Kennedy-Lightsey, 2013; Valverde, 2001): frequency of interactions; group homogeneity and maturity; nature of the external context; belonging to specific groups; specific objectives and signs of success.

As for the theory of group cohesion in the academic sector, Carron & Dennis (2001) affirmed that active and collective participation of group members apparently leads to benefits in terms of productivity, learning, interaction, individual security and satisfaction during the workday. In the university setting, Forrester & Tashchian (2006) suggested that the consideration of cohesion in this academic area has been quite limited and non-specific. The main problem in the research of group cohesion in the university setting lies in the singular consideration (for its measurement) of group integration towards the task and the social, ignoring attitudinal aspects and the individual beliefs of group members (Forrester & Tashchian, 2006; Troth et al., 2012).

The multi-dimensional model of Carron et al. (1985) describes cohesion by distinguishing between the following principal dimensions: the individual’s connection to the group task (ATG-T) or measurement of the emotional aspects related to individual participation in the aspects of the group’s task; the individual’s connection to the social group (ATG-S), a variable that considers the group member’s feelings regarding their personal contribution to the group’s social aspects; integration of the group and the task (GI-T) which combines the member’s feelings regarding the similarity and unification of the group with regard to the task; group-social integration (GI-S) which, in this case, measures the group member’s feelings regarding the group’s similarity and unification as an indivisible social unit. This model gave rise to the GEQ questionnaire, which assesses the 4 previously mentioned dimensions (Carron, et al. 1985). Although this questionnaire was designed to measure cohesion in the context of sports, it has been subsequently applied to a wide variety of fields (Carron et al., 2012). Using the multi-dimensional model of Carron et al. (1985) as a reference point and expanding to consider that of Carron & Brawley (2000), Bosselut et al. (2018) designed and validated a new measure of cohesion that can be applied to the university context, the "University Group Environment Questionnaire" (UGEQ) in the French population. Studies analyzing the UGEQ have found that it has satisfactory psychometric characteristics.

To the best of our knowledge, however, no assessment instrument is available in the Spanish context having suitable psychometric properties to assess group cohesion in the university context. Therefore, the main objective of this work was to adapt and validate the university group cohesion measure (UGEQ) to the Spanish population, using a representative sample of Spanish university students. To reach this objective, the Spanish version of the UGEQ will be translated and adapted to the Spanish context. After that, its psychometric properties will be analyzed, considering the factorial structure, validity and reliability. Therefore, a brief and validated instrument may be available to assess the group cohesion of higher education students within the Spanish socio-cultural setting.

Methods

Participants

The sample included 309 students from the University of Alicante (Spain). The recruitment of participants was based on a convenience sampling method. The mean participant age was 22.61 (SD=5.5) and 63.1% were female. Participants were mainly Spanish (95.8%). As for study areas, 51.1% were enrolled in the Criminology degree program, 18.1% were in the Law and Criminology dual studies program, 17.5% were pursuing a degree in Gastronomy and Culinary Arts and the remainder (27.9%) were enrolled in other official degree programs offered by this university. Inclusion criteria were: (1) be an officially enrolled student at the University of Alicante; (2) ability to read and complete the questionnaires themselves; and (3) having signed the informed consent to participate in the study.

Sample size was calculated using a ratio of 20: 1. This criterion was established by doubling the well-known 10: 1 rule, since it has been demonstrated that distinct factors may affect the required sample size (Wolf et al., 2013). All participants offered their consent to participate in the study and were duly informed of their rights. Only individuals who agreed to participate and signed the informed consent were included in the study. To protect the confidentiality and anonymity of the data, no identifying information of participants was registered. Before participating in the study, members of the research team personally informed the students in class about the characteristics and objectives of the project, making it clear that participation was entirely voluntary and not part of their course of study. Furthermore, it was explained to them that participation would have no effect on their course grades. Data collection was carried out between January and June of 2020.

Instruments

Sociodemographic variables

Information on the following sociodemographic variables was collected from each participant: age, sex, current year of study, academic degree program and nationality.

Group cohesion questionnaire for university students, the "University Group Environment Questionnaire". This measure was used to assess group cohesion in university students. It is the Spanish adaptation of the University Group Environment Questionnaire" (UGEQ) (Bosselut et al., 2018). The instrument contains 16 items to be completed using a 9-point Likert-type scale, with response options in which participants are asked to indicate their degree of conformity with each item from "strongly disagree" to "strongly agree". The UGEQ questionnaire consists of 4 dimensions of cohesion: ATG-T: Individual’s perception of personal involvement in group tasks; ATG-S: Individual’s perception of personal involvement in the group on a social level; GI-T: Individual’s sense of group closeness regarding the task; GI-S: Individual’s sense of group closeness on a social level). This questionnaire was developed by Carron, et al (1985) and contains 33 items. The original scales were found to have suitable psycho-metric properties (Bosselut et al., 2018).

Academic Stressor Scale (EEA). This scale, which assesses stressors in the academic environment, contains 54 items and include 8 subscales: methodological deficiencies of the teaching staff, DEFMET; student academic overload, SOBACA; beliefs about academic performance, CRENREN; interventions in public, INTPUB; negative social climate, CLINEG; exams, EXAM; lack of value of content, CARVAL; and difficulties in participation, DIFPAR. This instrument has been found to have suitable psychometric properties and an overall scale reliability of 0.96, ranging from 0.81 to 0.94 for each of the subscales (Cabanach et al., 2016). The Cronbach’s alpha for the overall scale in our sample was 0.97. The following coeffcients were obtained for the dimensions: (DEFMET=0.95; SOBACA=0.94; CRENREN=0.93; INTPUB=0.89; CLINEG=0.95; EXAM=0.89; CARVAL=0.84; DIFPAR=0.85). Additionally, a CFA was fitted in order to check the structure of this scale in this sample. The model provided adequate fit statistics (CFI= 0.90; TLI=0.90; SRMR=0.051 & RMSEA= 0.057 [IC 90%: 0.053-0.061]).

Questionnaire on the Climate of Perceived Responsibility in the Classroom (ECRPA). This instrument assesses the climate of responsibility promoted by the teacher and students in the classroom. It contains 10 items distributed across 2 dimensions, which assess: the climate created by the teacher, CDD; and the climate created by the classmates, CDC. This questionnaire has been shown to have suitable validity and reliability in its original version, with Cronbach’s alpha scores ranging from 0.81 to 0.89 (Fernandez-Rio et al., 2019). In our sample, the Cronbach’s alpha value was 0.86 for the climate dimension created by the teacher and 0.93 for the climate created by the classmates. In addition to this, a CFA was fitted in order to check the structure of this scale in this sample adequate fit statistics were found (CFI= 0.95; TLI=0.93; SRMR=0.087 & RMSEA= 0.011 [IC 90%: 0,086-0.129]).

Procedure

The authors of the original version of the UGEQ scale were contacted to request their authorization to adapt the scale to the Spanish population. Brislin’s methodology (1970) was used for the translation and cross-cultural adaptation of the scales to Spanish and for the translation-back translation of the instruments to a different language. The international standards promoted by the International Test Commission (Hambleton et al., 2005; Hernandez et al., 2020; Muñiz et al., 2013) were also considered, proposing that the adaption of an instrument to a new language and culture should include guarantees of conceptual, cultural, linguistic and metric equivalence. The original scales were independently translated to Spanish by two native French speakers, bilingual in Spanish, having experience in the educational sector. For each item, they scored the degree of difficulty that they experienced in its translation, on a scale from 0 to 10 (0, no difficulty or maximum equivalence; 10, maximum difficulty or minimal equivalence). They were also asked to assess conceptual equivalence and to indicate the type of changes made, as follows: type A (no changes were necessary and the sentence structure was maintained), type B (the translation required modification to ensure semantic and conceptual equivalence), and type C (some elements were not applicable to the cultural context of the destination country). Subsequently, the research team, together with the translators, systematically reviewed the items and the response options. The two translations were compared and a discussion was held to obtain a consensual version of each of the items. The translation was subject to an assessment by two higher education experts, to estimate the semantic equivalence of the items to the constructs to which they refer, until obtaining an initial consensual Spanish version of the instrument. Subsequently, a back translation was performed by two bilingual translators with a strong domain of the Spanish language, who had not been previously involved in the original translation process. They were asked to quantitatively assess the syntactic and semantic equivalence using the same procedure followed in the direct translation. Finally, the back translation was compared to the original version, verifying that the meaning of the items was the same and that no relevant formal changes existed. Small discrepancies that were found were resolved in a plenary session, obtaining the initial pilot version of the questionnaire.

The pilot version was administered to 20 university students to assess the use of language, feasibility and understanding of the items. The questionnaire was administrated by members of the research team in a personal interview. Based on the data obtained, the members of the research team reviewed the objections and modifications considered, obtaining a consensual, definitive form. The questionnaire’s translation to Spanish may be consulted in Table 7.

The set of instruments was administered using a Google Forms link, published in the university’s institutional website in the announcements section of each of the study areas involved in this project. All of the students were informed of the study’s purpose, attaching a consent form that ensured their anonymity and the confidentiality of their responses. To encourage participation, two reminders were made through the university’s institutional intranet announcements, highlighting the importance of completing the instruments. Data for the retest was collected two months after the initial data collection.

All participants signed the consent form created in accordance with the Declaration of Helsinki (2013). Confidentiality of their data was guaranteed, and participants were informed that they were free to withdraw from the study at any time.

Statistical analysis

Descriptive analyses of the sample were carried out for all of the relevant study variables (age, sex, degree in which the student was enrolled, academic year of study). Sample distribution was analyzed in search of potential outliers for the distinct subscales. However, no participants had scores differing from the mean score by 3 or more standard deviations.

To analyze structural validity, a confirmatory factor analysis (CFA) was performed. The structure of the questionnaire followed that of the original questionnaire proposed by Bosselut et al. (2018), consisting of 4 factors with 4 items each. Analyses were carried out using the lavaan package (Rosseel, 2012) in R (R Core Team, 2016). To assess the model’s goodness of fit, the following indices were used: Comparative Fit Index (CFI), Tuckey-Lewis Index (TLI), Root Mean Square Error of Approximation (RMSEA), Standardized Root Mean-Square Residual (SRMR). These indices were selected based on the recommendations of past researchers, who validated their performance and stability with values approaching 0.95 for TLI and CFI, 0.06 for RMSEA and 0.08 for SRMR (Hu & Bentler, 1999). Models of invariance for sex (male vs female) and for academic year (students of initial courses [1st and 2nd] vs students of advanced courses [3rd, 4th and 5th]) were adjusted according to the following taxonomy: model 0, configural invariance; model 1, weak invariance; model 2, strong invariance; model 3, strict invariance; model 4, full invariance. In the comparison of models, the goodness of fit (according to the previously mentioned indices), the principle of parsimony and the CFI index were all considered, as recommended in the scientific literature (Cheung & Rensvold, 2002). The ML-Robust estimator was used.

The internal consistency of the scale was assessed using the Cronbach’s alpha and Omega coefficients, with the minimal acceptable value being 0.70 (Nunnally, 1978). The test-retest reliability was assessed using the intraclass correlation coefficient (ICC) for a total of 147 participants. To verify the convergent validity, the Pearson correlation matrix was examined for the UGEQ and the ECRPA and EEA questionnaires.

Results

Confirmatory factor analysis

Each item was examined to verify its minimum, maximum, mean, standard deviation, skewness and kurtosis, and frequency of each response (Table 1 and 2). The factorial loads for each item of the four factors making up the original questionnaire are presented in Table 3.

Table 1 Descriptive statistics of each item of the Spanish version of the UGEQ 

Table 2 Frequency of response for each option in each of the items that make up the questionnaire. 

Table 3 Factorial load matrix for the UGEQ and correlations between factors 

ATG-T: Individual’s perception of personal involvement in group tasks; ATG-S: Individual’s perception of personal involvement in the group on a social level; GI-T: Individual’s sense of group closeness regarding the task; GI-S: Individual’s sense of group closeness on a social level

The confirmatory factor analysis of the UGEQ had the following adjustment indices for this tetra-factorial structure: CFI= 0.92; TLI=0.90; SRMR=0.068 and RMSEA= 0.081 (90% CI: 0.071-0.092). The adjustment indices for the invariance models, adjusted for sex and academic year, are shown in Table 4. None of these models had a higher adjustment index than that of the original model (Table 4). As for the comparison of invariance models (always using the "configural" invariance model as a reference), significant differences were found in the "strict" model for both variables and in the "complete" model, they were found for the "academic year" variable. These differences, however, were always less than 0.03 in CFI. A second order confirmatory model was adjusted with 4 first order and 2 second order factors. All of the adjustment indices were lower than the original 4-factor model. Figure 1 shows the magnitude of the correlations between the 16 items that make up the UGEQ (Table 3).

Figure 1 Item correlation network 

Table 4 Goodness of fit of the invariance models for sex and academic year 

χ2: Chi-squared; df: degrees of freedom; CFI: Comparative Fit Index; TLI: Tuckey-Lewis Index; RMSEA: Root Mean Square Error of Approximation; SRMR: Standardized Root Mean-Square Residual

Internal consistency and Test-retest reliability

The Cronbach’s alpha values of the four factors making up the overall scale ranged from 0.72 to 0.86 (Table 5). In the case of Omega values, coefficients ranged from 0.74 to 0.86 (Table 5). These values indicate an adequate level of internal consistency for the Spanish version of the UGEQ.

Regarding temporal stability, a subsample of 147 (47.6%) participants was randomly selected to perform an additional assessment, two months following the initial one. This subsample employed for the retest analysis was equivalent to the original one, as no differences were found in any of the sociodemographic variables as compared to the original sample. The ICC values for the distinct subscales making up the instrument ranged from 0.41 to 0.64 (p<0.05) (Table 5) which can be considered as a moderate reliability (Koo & Li, 2016).

Table 5 Internal consistency and test-retest reliability 

ATG-T: Individual’s perception on personal involvement in group tasks; ATG-S: Individual’s perception of personal involvement in the group on a social level; GI-T: Individual’s sense of group closeness regarding the task; GI-S: Individual’s sense of group closeness on a social level; ICC: intra-class correlation index

Convergent validity

To assess the convergent validity, the Pearson correlation indices were calculated between the 4 subscales of the UGEQ and the other related questionnaires. The ATG-T subscale revealed a moderate association with the CLINEG subscales (r=-0.187), CDD (r=0.138) and CDC (r=0.278); the ATG-S subscale with the DEFMET (r=0.157), SOBACA (r=0.126), CRENREN (r=0.141), CARVAL (r=0.145) and DIFPAR (r=0.115) sub-scales; the GI-T subscale with the INTPUB (r=-0.121), CLINEG (r=-0.186), CDD (r=0.145) and CDC (r=0.387) subscales; and finally, the GI-S subscale, although not significantly related to any subscale, had the strongest association with INTPUB (r=-0.110) (Table 6).

Table 6 Correlation matrix between the UGEQ and the ECRPA and EEA questionnaires 

UGEQ subscales (ATG-T: Individual’s perception on personal involvement in group tasks; ATG-S: Individual’s perception of personal involvement in the group on a social level; GI-T: Individual’s sense of group closeness regarding the task; GI-S: Individual’s sense of group closeness on a social level)

ECRPA subscales (CDD: climate created by the teacher; CDC: climate created by the classmates)

EEA subscales (DEFMET: methodological deficiencies of the teaching staff; SOBACA: academic overload of the student; CRENREN: beliefs regarding academic performance; INTPUB: interventions in public; CLINEG: negative social climate; EXAM: exams; CARVAL: lack of content value; DIFPAR: participation difficulties)

**p<0.010; *p<0.050

Discussion

The main purpose of this study was to validate the Spanish version of the "University Group Environment Questionnaire" (UGEQ) scale in a sample of university students. The results obtained confirm the structure of the original questionnaire, with four factors (ATG-T, ATG-S, GI-S and GI-T) in a Spanish population. The adjustment indices obtained and the adjusted invariance models support the tetra-factorial structure. In addition, our results reveal an adequate internal consistency and significant test-retest correlations. Significant associations were found with distinct questionnaires related to the construct under study, demonstrating the instrument’s convergent validity.

The confirmatory factor analysis performed supports the tetra-factorial structure initially proposed by Bosselut et al (2018) based on the model of Carron et al (1985), which was originally developed for the sports setting, but was subsequently applied to numerous other contexts. These findings confirm the original structure in which group cohesion is assessed in the university context based on the following 4 dimensions: Individual’s perception on his/her participation in group tasks; Individual’s perception on his/her participation in the group on a social level; Individual’s feelings regarding how united the group is with regard to the task; Individual’s feelings regarding how united the group is on a social level. The goodness of fit indices obtained in our model [CFI= 0.92; TLI=0.90; SRMR=0.068 and RMSEA= 0.081 (90% CI: 0.071-0.092)] are acceptable according to the previously established criteria (Hu & Bentler, 1999). Moreover, the 4 dimensions of the questionnaire, have an adequate internal consistency. In addition, the results of the test-retest support the instrument’s suitable temporal stability. Although the obtained results regarding the Spanish adaptation of the UGEQ are acceptable and not optimal, it should be considered that it is an initial validation research, and future studies with larger samples and most representative students from different areas of knowledge are needed. In any case, based on the results, the Spanish version of the UGEQ replicates the original structure of the instrument, and could be useful to reliable evaluate group cohesion in the Spanish context.

Given that sex and academic year may have a major impact on the measurement of cohesion in the university context, the invariance models were adjusted for these two variables. The adjustment indices were always higher in the "configural invariance" model. Therefore, it can be assumed that this measure is not biased based on sex or academic school year (initial [1st and 2nd] vs advanced [3rd, 4th and 5th]). However, these results must be interpreted with caution since the adjustment indices were quite similar across all the invariance models. Therefore, sex and academic school year do not seem to have an impact on group cohesion in the Spanish university context from the measurement perspective. Hence, our adaptation could be reliable employed in different academic school years and between genders.

The UGEQ has been found to be an instrument capable of providing information on group dynamics in the university setting. It may also be applied to determine inter-individual synergies in performing an academic task in the classroom setting (satisfaction with the ideas of the other group members, positive perception of the work environment). All of this may help to determine why some students prefer to work alone or are unmotivated by group work (Barr et al., 2005; Urch et al., 2000). In addition, the instrument also assesses behavior, beyond the academic environment, on a social level.

This instrument may help advance our knowledge regarding the concept of group cohesion as a dynamic construct (Carron & Brawley, 2000). Future studies should consider the development of group cohesion during the university trajectory, analyzing whether or not this evolution is linear or fluctuating.

This work has various strengths, including its use of a representative university sample enrolled in distinct degree programs and education levels. Furthermore, data collection was conducted over the second quarter of the school year, to ensure that group relationships had already been established amongst the students. Our results are supported by the original instrument, being replicated in a Spanish population. However, this study has certain limitations. First, all of the participants went to the same university and therefore, were in the same geographic area, potentially reducing the sample’s variability. Therefore, it may be useful to confirm the results with those from other Spanish university publications. On the other hand, given the limited number of instruments available to assess group cohesion, the convergent validity can only be tested using scales that directly assess, not only the analyzed construct, but also, elements related to the same, including academic stress (EEA) or the climate of responsibility perceived in the classroom (ECRPA). In this sense, it has been demonstrated that a better group cohesion is significantly correlated with lower stress (Ha and Jue, 2022; Li et al., 2014; Prapavessis and Carron, 1996; Shiralkar et al., 2013) and positive classroom climate (Haugan et al., 2021; Wang et al., 2020). This factor has a positive role buffering source of academic stress, and hence, higher levels of group cohesion could moderate the negative impact of academic demands on stress and mental health of students; and at the same time, generate a positive classroom climate (Haugan et al., 2021; Wang et al., 2020). Moreover, the use of the CFA has limitations that tend to be overcome by the Exploratory Structural Equation Modeling (ESEM), but at the initial stage of this study, the CFA may be sufficient. ESEM has demonstrated advantages in comparison to CFA, mainly in relation to the restrictive assumptions of CFA, in which each item loads on only one factor (Marsh et al., 2014). Moreover, ESEM approach has shown benefits in several clinical and educational settings when validation and adaptations of questionnaires are developed, mainly in those cases in which the data or the characteristics of the evaluation instrument do not fit with the required criteria for CFA or other classical statistical approaches (Marsh et al., 2014; 2010). Finally, it would be interesting for future studies to examine potential cultural differences arising in the values associated with group cohesion in university students from distinct countries.

We can conclude that the Spanish version of the University Group Environment Questionnaire" (UGEQ) has quality metric guarantees (viability, reliability and validity) for the assessment of group cohesion in Spanish university students. Its factorial structure has been found to be stable across two countries with distinct cultures. The Spanish version of the UGEQ replicates the factorial structure of the original version and obtains suitable goodness of fit indices for the Spanish population. Therefore, we can determine that it is a brief, easy-to-complete self-reporting instrument that is useful for the assessment of group cohesion in a university context. It is also beneficial for the analysis of the main aspects underlying good group cohesion (ATG-T, ATG-S, GI-S and GI-T). Given these characteristics, this questionnaire is considered a viable and useful tool, particularly for higher education professionals and researchers. We believe that this study offers an accurate and effective assessment tool for the development of prevention and intervention programs to improve interpersonal relationships and collaborative work amongst peers in the context of higher education.

References

Barr, T., Dixon, A., & Gassenheimer, J. (2005). Exploring the "Lone Wolf" phenomenon in student teams. Journal of Marketing Education, 27, 81-90. [ Links ]

Barrasa, A., & Gil, F. (2004). Un programa informático para el cálculo y la representación de índices sociométricos. Psicothema, 16, 329-335. [ Links ]

Barrick, M.R., Stewart, G.L., Neubert, J.M., & Mount, M.K. (1998). Relating member ability and personality to work team processes and team effectiveness. Journal of Applied Psychology, 83, 377-391. [ Links ]

Bosselut, G., Heuze, J., Castro, O., Fouquereau, E., & Chevalier, S. (2018). Using Exploratory Structure Equation Modeling to validate a new measure of cohesion in the university classroom setting: The University Group Environment Questionnaire (UGEQ). International Journal of Educational Research, 89, 1-9. http://dx.doi.org/10.1016/j.ijer.2018.03.003 [ Links ]

Briones, E., & Tabernero, C. (2005). Formación cooperativa en grupos heterogéneos. Psicothema, 3, 396-403. [ Links ]

Buckner, J. C. (1988). The Development of an Instrument to Measure Neighborhood Cohesion. American Journal of Community Psychology, 16(6), 771-791. [ Links ]

Cabanach, R., Souto-Gestal, A., & Franco, V. (2016). Stressor Academic Scale for the evaluation of academic stressors in undergraduates. Revista Iberoamericana De Psicologia Y Salud, 7(2), 41-50.http://dx.doi.org/10.1016/j.rips.2016.05.001 [ Links ]

Carless, S.A., & De Paola, C. (2000). The measurement of cohesion in work teams. Small Group Research, 31, 71-88. [ Links ]

Carron, A.V. (1998). Group dynamics in sport. London, Ontario, Canada: Spodym. [ Links ]

Carron, A., & Brawley, L. (2000). Cohesion: Conceptual and measurement issues. Small Group Research, 31, 89-106. [ Links ]

Carron. A. V., Brawley. L. R. & Widmeyer, W. N. (1998). The measurement of cohesiveness in sport groups. In J. L. Duda (Ed.), Advances in sport and exercise psychology measurement (pp. 213-226). Morgantown, WV: Fitness Information Technology. [ Links ]

Carron, A.V., & Dennis, P.W. (2001). The sport team as an effective group. In J. M. Williams (Ed.), Applied Sport Psychology. Personal growth to peak performance. Mountain View, CA: Mayfield Publishing Company [ Links ]

Carron, A., Eys, M., & Martin, L. (2012). Cohesion: Its nature and measurement. In G. Tenenbaum, R. Eklund, & A. Kamata (Eds.), Measurement in sport and exercise psychology Champaign, IL: Human Kinetics. [ Links ]

Carron, A., Widmeyer, W., & Brawley, L. (1985). The development of an instrument to assess cohesion in sport teams - the group environment questionnaire. Journal of Sport Psychology, 7(3), 244-266. http://dx.doi.org/10.1123/jsp.7.3.244 [ Links ]

Chang, A., & Bordia, P. (2001). A multidimensional approach to the group cohesion-group performance relationship. Small Group Research, 32, 379-405. [ Links ]

Cheung, G., & Rensvold, R. (2002). Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance. Structural Equation Modeling, 9(2), 233-255. [ Links ]

Crust, L. (2020). Personality and mountaineering: A critical review and directions for future research.Personality and Individual Differences,163, 110073. [ Links ]

Daniels, J., & Brooker, J. (2014). Student identity development in higher education: Implications for graduate attributes and work-readiness. Educational research,56(1), 65-76. [ Links ]

From Vita, A. & Barbarito, M. (2016). Adaptación y validación de un test de cohesión grupal para bases antárticas: COGBA. Ciencias Psicológicas, 10 (2), 157 - 164. [ Links ]

Deckers, M., Altmann, T., & Roth, M. (2018). Conceptualizing and measuring group openness and cohesion as dimensions of group personality. Psychology ,9(1), 80-100. [ Links ]

Dyson, B., Howley, D., & Shen, Y. (2020). Being a team, working together, and being kind’: Primary students’ perspectives of cooperative learning’s contribution to their social and emotional learning. Physical Education and Sport Pedagogy, 1-18. [ Links ]

Estabrooks, P. A., & Carron, A. V. (2000). The Physical Activity Group Environment Questionnaire: An instrument for the assessment of cohesion in exercise classes. Group Dynamics: Theory, Research, and Practice, 4, 230-243. [ Links ]

Fernandez-Rio, J., Cecchini, J., Merino-Barrero, J., & Valero-Valenzuela, A. (2019). Perceived Classroom Responsibility Climate Questionnaire: A new scale. Psicothema, 31(4), 475-481. http://dx.doi.org/10.7334/psicothema2019.76 [ Links ]

Forrester, W. R., & Tashchian, A. (2006). Modeling the relationship between cohesion and performance in student work groups. International Journal of Management, 23, 458-464. [ Links ]

Gitterman, P. (2019). Social identities, power, and privilege: The importance of difference in establishing early group cohesion. International Journal of Group Psychotherapy, 69(1), 99-125. [ Links ]

Ha, J. H., & Jue, J. (2022). The Mediating Effect of Group Cohesion Modulated by Resilience in the Relationship between Perceived Stress and Military Life Adjustment. Sustainability, 14(13), 7794. [ Links ]

Hambleton, R. K., Merenda, P. F., & Spielberger, C. D. (2005). Adapting Educational and Psychological Tests for Cross-Cultural Assessment. New Jersey: Lawrence Erlbaum Associates Publishers. [ Links ]

Hernandez, A., Hidalgo, M. D., Hambleton, R. K., & Gomez-Benito, J. (2020). International test commission guidelines for test adaptation: A criterion checklist. Psicothema, 32(3), 390-398 [ Links ]

Hu, L., & Bentler, P. (1999). Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria Versus New Alternatives. Structural Equation Modeling-a Multidisciplinary Journal, 6(1), 1-55. http://dx.doi.org/10.1080/10705519909540118 [ Links ]

Koo T.K., Li M.Y. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016; 15(2):155-63. https://doi.org/10.1016/j.jcm.2016.02.012 [ Links ]

Li, A., Early, S. F., Mahrer, N. E., Klaristenfeld, J. L., & Gold, J. I. (2014). Group cohesion and organizational commitment: protective factors for nurse residents’ job satisfaction, compassion fatigue, compassion satisfaction, and burnout. Journal of Professional Nursing, 30(1), 89-99. [ Links ]

Marcos, F. M. L., Calvo, T. G., González, I. P., Miguel, P. A. S., & Oliva, D. S. (2010). Interactive effects of cohesion on the perceived efficacy, expectations of success and performance of basketball teams. Revista de Psicología del Deporte, 19(1), 1-14. [ Links ]

Marsh, H. W., Lüdtke, O., Muthén, B., Asparouhov, T., Morin, A. J., Trautwein, U., & Nagengast, B. (2010). A new look at the big five factor structure through exploratory structural equation modeling. Psychological Assessment, 22(3), 471. [ Links ]

Marsh, H. W., Morin, A. J., Parker, P. D., & Kaur, G. (2014). Exploratory structural equation modeling: An integration of the best features of exploratory and confirmatory factor analysis. Annual Review of Clinical Psychology, 10(1), 85-110. [ Links ]

Mudrack, P. E. (1989). Defining group cohesiveness: A legacy of confusion. Small Group Behavior, 20, 37-49. [ Links ]

Muñiz, J., Elosua, P., & Hambleton (2013). Directrices para la traducción y adaptación de los tests: segunda edición. Psichotema, 25(2), 151-157. [ Links ]

Murray, C. L., & Kennedy-Lightsey, C. D. (2013). Should I stay or go?: Student identity gaps, feelings, and intent to leave. Communication Research Reports, 30(2), 96-105. [ Links ]

Nunnally, J. C. (1978). Psychometric theory. New York: McGraw-Hill. [ Links ]

Pacewicz, C. E., Smith, A. L., & Raedeke, T. D. (2020). Group cohesion and relatedness as predictors of self-determined motivation and burnout in adolescent female athletes. Psychology of Sport and Exercise, 101709. [ Links ]

Pérez, E. B., & Urbieta, C. T. (2005). Cooperative training in heterogeneous groups. Psicothema, 17(3), 396-403. [ Links ]

Prapavessis, H., & Carron, A. V. (1996). The effect of group cohesion on competitive state anxiety. Journal of Sport and Exercise Psychology, 18(1), 64-74. [ Links ]

R Core Team. (2016). A language and environment for statistical computing. In. Vienna, Austria: R Foundation for Statistical Computing. [ Links ]

Riasudeen, S., Singh, P., & Kannadhasan, M. (2019). The Role of Job Satisfaction behind the Link between Group Cohesion, Collective Efficacy, and Life Satisfaction. Psychological Studies, 64(4), 401-410. [ Links ]

Rosseel, Y. (2012). lavaan: An R Package for Structural Equation Modeling. Journal of Statistical Software, 48(2), 1-36. http://dx.doi.org/10.18637/jss.v048.i02 [ Links ]

Segovia, A. O., & Fernández, L. G. S. (2010). The impact of size and diversity on group process and outputs. Psicothema, 22(1), 137-142. [ Links ]

Senior, R. M. (2001). Creating safe learning environments: Developing and maintaining class cohesion. Intercultural Education, 12(3), 247-259. [ Links ]

Shiralkar, M. T., Harris, T. B., Eddins-Folensbee, F. F., & Coverdale, J. H. (2013). A systematic review of stress-management programs for medical students. Academic Psychiatry, 37(3), 158-164. [ Links ]

Thornton, C., Miller, P., & Perry, K. (2020). The impact of group cohesion on key success measures in higher education. Journal of Further and Higher Education, 44(4), 542-553. [ Links ]

Troth, A. C., Jordan, P. J., & Lawrence, S. A. (2012). Emotional intelligence, communication competence, and student perceptions of team social cohesion. Journal of Psychoeducational Assessment, 30, 414-424. [ Links ]

Urch Druskat , V., & Kayes, D. (2000). Learning versus performance in short-term project teams. Small Group Research, 31, 328-353. [ Links ]

Valverde, M. (2001). Comportament humà en l’organització. Ed: Universitat Oberta de Catalunya. Barcelona. [ Links ]

Van Leeuwen, A., & Janssen, J. (2019). A systematic review of teacher guidance during collaborative learning in primary and secondary education. Educational Research Review, 27, 71-89. [ Links ]

Van Pelt, M., Hutschemaekers, G., Sleegers, P., & Roose, R. (2020). The relevance of practice development for professionalisation of social work: De relevantie van Practice Development voor Professionalisering van het Sociaal Werk. European Journal of Social Work, 1-14. [ Links ]

Wang, M. T., Degol, J. L., Amemiya, J., Parr, A., & Guo, J. (2020). Classroom climate and children’s academic and psychological wellbeing: A systematic review and meta-analysis. Developmental Review, 57, 100912. [ Links ]

Wolf, E., Harrington, K., Clark, S., & Miller, M. (2013). Sample Size Requirements for Structural Equation Models: An Evaluation of Power, Bias, and Solution Propriety. Educational and Psychological Measurement, 73(6), 913-934. http://dx.doi.org/10.1177/0013164413495237 [ Links ]

How to cite this article: Ruiz-Robledillo, N., Albaladejo-Blázquez, N,; Ferrer-Cascales, R, Rubio-Aparicio, M., Madrid-Valero, J.J., Vela-Bermejo, J.,Bosselut, G. (2023). Spanish adaptation and validation of the UGEQ questionnaire to assess group cohesion in university students. Revista Digital de Investigación en Docencia Universitaria, 17(1), e1618. https://doi.org/10.19083/ridu.2023.1618.

Appendices

Table 7 Spanish adaptation of the University Group Environment Questionnaire 

Received: April 06, 2022; Accepted: December 19, 2022

*Correspondence: Albaladejo-Blázquez, N. natalia.albaladejo@ua.es

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License