SciELO - Scientific Electronic Library Online

 
vol.24 número48Financial performance trends of United States Hockey Inc: a resource-dependency approach índice de autoresíndice de materiabúsqueda de artículos
Home Pagelista alfabética de revistas  

Servicios Personalizados

Revista

Articulo

Indicadores

  • No hay articulos citadosCitado por SciELO

Links relacionados

  • No hay articulos similaresSimilares en SciELO

Compartir


Journal of Economics, Finance and Administrative Science

versión impresa ISSN 2077-1886

Journal of Economics, Finance and Administrative Science vol.24 no.48 Lima jul./dic. 2019

http://dx.doi.org/https://doi.org/10.1108/JEFAS-05-2018-0052 

ARTICLE

 

Analysing the impact of a business intelligence system and new conceptualizations of system use

 

Rolando Gonzales1,*

Jonathan Wareham 2

1Tecnologías de Información e Investigación Operativa, Universidad ESAN, Lima, Peru

2 Information Technology, ESADE Business School - Campus Sant Cugat, Sant Cugat del Valles, Spain

Corresponding author:*rgonzales@esan.edu.pe


Abstract

Purpose: In this study, three models were empirically compared, the DeLone and McLean model, the Seddon model and the Modified Seddon model, by measuring the impact of a business intelligence system (BIS) in companies in Peru. After that, the mediators and dependent constructs were analysed to determine if they were behaving properly (a good level of variance explanation and significant relations with others constructs). The study used a sample of 104 users of the BIS, from companies in several important economic sectors, in a quasi-voluntary context and with six constructs: information quality, system quality, service quality, system dependence (system use), user satisfaction and perceived usefulness (individual impact).
Design/methodology/approach: To interpret the results, the authors used structural equations. The idea was to look for the best fit and explanations for the outcomes. The main difference in these models is that the DeLone and McLean model considers system dependence (system use) as a part of information system success, but in the Seddon model, it is a consequence of it.
Findings: The Seddon model seems to show the best fit and explanation for the outcomes. After that, a review of the system use construct was realised, because of its limited variance explained and the few significant relations with other constructs, to improve its explanation power in future research.
Research limitations/implications: It is estimated that the sample includes more than 15 per cent of all the companies that use a BISs in Peru, so the size of the sample is adequate, but it is not entirely random and therefore limits the generalizability of outcomes. Besides that, a sample size that is bigger could be better for the sake of making a more detailed analysis, permitting the use of some items with less power, or the use of another statistical procedure for structural equations such as the Asymptotical Distribution Free, permitting a more detailed analysis (Hair et al., 2006).
Originality/value: Business intelligence (BI), one of the most important components of information systems (IS), is playing a very relevant role in business in this time of high competition, high amounts of data and new technology. Currently, companies feel pressured to respond quickly to change and complicated conditions in the market, needing to make the correct tactical, operational and strategic decisions (Chugh and Grandhi, 2013). BI is one of the most important drivers of the decade (Gartner, 2013). Big companies of IS are creating special units specialised in BI, helping companies become more efficient and effective in daily operations.

Keywords: DeLone and McLeanmodel, Seddon model, System use construct, Impact of a business intelligence system


1. Introduction

Business intelligence (BI), one of the most important components of information systems (IS), is playing a very relevant role in business in this time of high competition, high amounts of data and new technology. Currently, companies feel pressured to respond quickly to change and complicated conditions in the market, needing to make the correct tactical, operational and strategic decisions (Chugh and Grandhi, 2013).

BI is one of the most important drivers of the decade (Gartner, 2013). Big companies of IS are creating special units specialised in BI, helping companies become more efficient and effective in daily operations. The field of BI is evolving at a fast speed, to become more innovative and obtaining knowledge of the data stream in a way never before done. Today innovative programmes of BI in all industries are being implemented (Chen et al., 2012; Sharda et al., 2014). A company that uses a business intelligence system (BIS) can be more effective and efficient and can disseminate knowledge inside the company, with business partners, improving the decision-making process and making the enterprise more competitive (Parzinger and Frolick, 2001). Measuring the impact of BIS is very important to get the best outcomes and increase the investment return rate.

In the last 40 years, there have been developed several models to measure the impact of IS. We could mention Theory of reasoned action (1975-1980), Theory of planned behaviour (1985), Technology Acceptance model (1986), User involvement (1984), Delone and McLean (1992), Seddon model (1997), Soh and Markus (1995), the modified model of Delone and McLean (2003), and others (Gonzales, 2008).

From these models, the more relevant has been the Delone and McLean (1992/2003) and its contrasting model, the Seddon model of 1997. We have used the operationalisation of Rai et al. (2002) to compare both models (the name of the construct Use is changed by System Dependence, and for the construct, Individual Impact is changed by Perceived Usefulness). In this case, we are comparing the two models and a Modified version of Seddon, in a BIS, used by "real" professionals of IT in "real" situation of several Peruvian companies using that system.

An additional point to review is the construct System Use (System Dependence in this paper), that is a construct that has not been performing well in these Information System Success models.

The objective of this study, as previously mentioned, is to compare the DeLone and McLean (2003) model and the Seddon (1997) model (with one additional variation), applied to a Business Intelligent System. The study was accomplished in Peru, a developing country in South America, by using a sample of 104 users for the system in 13 enterprises, having a quasi-volitional IS use context. After this analysis, the mediators and dependent constructs were reviewed to determine if they were behaving properly (a good level of variance explanation and significant relations with other constructs).

2. Literature review

2.1 The Delone and McLean information systems success model

Delone and McLean (1992) established a model that tried to measure the impact of the information system, considering six constructs. After ten years, DeLone and McLean (2003) reviewed the model, weighing several studies that used partially or completely their model. They said that the model had fulfilled the main objective established: to obtain the information system success, through multidimensional and interdependent constructs. They modified the model considering the next constructs: information quality, system quality, service quality, system use or intention to use, user satisfaction and net benefits. The model can be observed in Figure 1.

One of the independent constructs is Information Quality, and the variables related to it are accuracy, precision, output timeliness, reliability, completeness, relevance and currency. The second independent construct is System Quality, which recommends the consideration of variables such as performance of the system, trustworthiness of the computational system, on time and on-line response, and the ease of use of terminals (Swanson, 1974).

The third independent construct is Service Quality, which can be evaluated through technical competence of the IS staff, their attitude, their ability to complete the development of products and services on time, the span of time required to develop the systems. Marketing measuring tools such as SERVQUAL used to measure the dimensions of tangibles, responsiveness, assurance, reliability, and empathy (Chen et al., 2000).

In past years, several evaluations of the DeLone and McLean model have been made during studies that have been used partially or completely (Petter et al., 2008), corroborating most of the relations between constructs.

2.2 The Seddon information systems success model

The Seddon model (1997) tries to improve the DeLone and McLean (D&M) model from 1992. According to Seddon, the model was derived from the combination of a process models with another of variance. This model maintains a great part of the D&M model but is divided into two variance models, eliminating the process model. The first variance sub-model is the Partial Behavioural Model of IS Use. The second sub-model is the IS Success Model, a great part of the D&M model. Both models of variance are united, first from the Partial Behavioural model of IS Use, through the Individual, organisational, and Societal Consequences of IS Use, after that, from the IS Success model through the Partial Behavioural model of IS Use, from the User Satisfaction construct to the Expectations about the net benefits of future IS Use.

The Partial Behavioural model of IS Use is composed of expectations about the net benefits of future IS Use construct, that is directly related to the IS Use construct (behaviour). The IS Success model is composed by three bodies. The first one is Measures of Information and System Quality, with System Quality and Information Quality constructs. The second body is General Perceptual Measures of Net Benefits of IS Use, with the Perceived Usefulness, and User Satisfaction constructs. The second body is Other Measures of Net Benefits of IS Use, with the net benefits for Individuals, Organisations, and Society. The constructs of the first and third body influence the constructs of the second body. Besides that, the Perceived Usefulness of the second body is directly related to the User Satisfaction construct. Finally, the User Satisfaction Construct offers feedback with construct Expectations about benefits for future IS Use, of the Partial Behavioural model of IS Use. The Seddon model can be observed in Figure 2.

Seddon indicates that IS Use must be after impact and benefits because it does not cause them. It is affirmed by Seddon that IS Use is a behaviour that expresses a belief of goodness from using an information system. The Seddon model labels IS Use as behaviour caused by IS success. IS Use being a consequence of IS success. In relation to the construct System Use, this model was developed for volitional and non-volitional usage, in contrast to the DeLone and McLean model that solely assumes volitional use (Rai et al., 2002).

Several recent studies have used the Seddon model because it explains adequately the impact of an Information System (Brown and Jayakody, 2009; Kulkarny et al., 2006; and Sabherwal et al., 2006).

2.3 The modified Seddon information systems success model

Rai et al. (2002) used the DeLone and McLean model (1992) and the Seddon model (1997) to estimate the validity of both. It was found that both models exhibited a reasonable fit. They considered a third alternative, modifying the Seddon model. It was estimated that the perceived usefulness was related to individual impacts, considering that DeLone and McLean (1992) connected several constructs to individual impacts.

In this way, Rai et al. (2002) established a model of five constructs: system quality, information quality, perceived usefulness (individual impact), user satisfaction and system use. Besides that, they represent system use in terms of system dependence. The Seddon model was modified, including a correlational path between system use (system dependence) and perceived usefulness, so the best fit and variance explanation would be obtained. The model can be observed in Figure 3.

The more relevant studies that analysed the impact of Information System and Business Intelligence, using the DeLone and McLean, and Seddon models could be observed in Appendix 1.

3. Methods

The models used are quantitative, in which the individual User of the BIS, in a company that employs the system, is the unit of analysis. A Pilot Test was employed to test the tools, the questionnaire, and the model. Structural Equations were used for the analysis. The model is analysed with the DeLone and McLean model, the Seddon model, and the Modified Seddon model.

The study sample includes the most important companies in the Peruvian economy from different economic sectors: banking, food industry, consumer marketing products, pension funds, government, beauty products, market research, and credit cards. The Use of BISs in those companies is not mandatory and users have other channels providing the information, but in general, it is more cumbersome and perhaps the data is not as precise for the analysis, so the BIS is assumed as quasi-volitional or quasi-mandatory.

4. Quantitative analysis

A previous analysis of the data was realised to check the main characteristics of them that could be observed in Appendix 2 and 3. Reviewing the correlation table we find that the correlations are between medium and high, and that is because the variables are related to business, and we are going to find high correlations between items of the same construct, but using structural equations of covariance (SEM) that is not a problem (Hair et al., 2006).

Several tests were implemented to check the all the requirement for a multivariate analysis: normal distribution, completeness of the data, outliers, homoscedasticity, and linearity between dependent variables and independent variable. The Kolmogorov-Smirnov test was applied to all variables to verify the normality (Appendix 4). The multivariate normal distribution was verified using the EQS programme for SEM, eliminating the variables that could not satisfy this requirement.

The data was complete for each one of the 29 items for the analysis. There were only a few descriptive variables that were incomplete. The homoscedasticity was checked through a homogeneity test of variance between the dependent variables and the independent variables and mediator variables, using the Barlett and Levene test. We found only two variables with problems: IIDU and IIWU and were corrected through a mathematics factor of elevating the variable to the cubic power and then divided by 7. To verify the linearity between dependent variables and independent variables, a regression was run for each combination, and then check a graphic representation of the residuals to verify the random distribution, with favourable outcomes.

We compare the DeLone and McLean model, the Seddon model and a modified Seddon's model, in a sample of companies that use BISs. The initial sample was of 110 surveys, but after eliminating some outliers, the final sample consisted of 104 (Hair et al., 2006). The measurement of the constructs was made using a seven-point scale (semantic differential, Likert, ordinal and ratio: Iivari, 2005; Hong et al., 2006; Chen et al., 2000; McKinney et al., 2002). The questionnaire has 29 statements for the six constructs. The questionnaire was obtained from several sources, and it was translated three times. From English to Spanish, then from Spanish to English and then from English to Spanish, through different translators to fulfil the correct procedure in research.

The validity of the constructs was verified through face validity, convergent validity, discriminant validity, and nomological validity. All construct's validity statistics were considered satisfactory. The general reliability coefficients in the CFA and Structural model were satisfactory: Cronbach's alpha of 0.954 and Rho of 0.974. A pilot test was conducted with 68 observations to verify the questionnaire and apply the Exploratory Factor Analysis through Principal Components and Varimax rotation to verify that each item pertained to only one construct. The main results of the analysis could be observed in Appendix 5.

4.1 Sample analysis

A standard procedure was performed, starting with the Confirmatory Factor Analysis (CFA), and thereafter the Measurement model was established. The estimated method used in structural equations was Maximum Likelihood Estimation, with the complementary method of Robust from the EQS programme.

The CFA was initially established, using all the observable variables. The fit of the model was modified, working with X2, CFI, RMSEA, multivariate normal distribution adjustment, and the average variance extracted (AVE) (Byrne, 2006). Thereafter, the final Confirmatory Factor Analysis (CFA) was obtained with 22 items derived from 104 observations. The software used for the statistical analysis was Minitab, while the structural equations used EQS version 6.1. See Table I for statistics from the Confirmatory Factor Analysis.

5. Results

After completing the Confirmatory Factor Analysis, the Structural Model was established. Figure 4 presents the structural model found with the DeLone and McLean model, including the relations between constructs and the variance, explained for each dependent construct through R2.

In this case, a variance explanation of 65.2 per cent for Perceived Usefulness (Individual Impact), 77.3 per cent for User Satisfaction and 12.3 per cent for System Dependence (System Use) was obtained, and three significant relations were found (alpha 0.05). The independent constructs Information Quality and Service Quality have significant relations with the mediator construct User Satisfaction. Likewise, User Satisfaction has a significant relation to the dependent construct, Perceived Usefulness (Individual Impact). In contrast, the independent construct System Quality does not have any significant relation to the mediator constructs. The System Dependence (System Use) construct shows no significant relation to the independent constructs or dependent construct. The dependent construct, Perceived Usefulness (Individual Impact), is explained in 65.2 per cent (R2).

This model does not find any significant relationship between the System Dependence (System Use) and other constructs of the model, and it is worth considering that, as an indicator of the success of the system, it makes sense if it is voluntary or discretional, and not when the system has captive users, who do not have an alternative system to process information (Lucas, 1978).

For the Seddon model, the next results were found (including the relations between constructs and the variance explained for each dependent construct through R2), that can be observed in Figure 5.

In this second model, a variance explanation of 12.2 per cent for System Dependence (System Use), 80.3 per cent for User Satisfaction and 68.7 per cent for Perceived Usefulness (Individual Impact) and find five significant relations (alpha 0.05) are presented. The independent constructs Information Quality and Service Quality have significant relations with the mediator construct User Satisfaction. Likewise, User Satisfaction has a significant relationship with the dependent construct, System Dependence (System Use). The independent construct System Quality has a significant relationship with the mediator construct Perceived Usefulness (Individual Impact) and the Perceived Usefulness (Individual Impact) has a significant relation with the User Satisfaction construct. The dependent construct, System Dependence (System Use), is explained in 12.2 per cent (R2).

For the modified Seddon model, the next results were found (including the relations between constructs, and the variance explained for each dependent construct through R2), that can be observed in Figure 6.

In this third model, a variance explanation of 11.7 per cent for System Dependence (System Use), 80.3 per cent for User Satisfaction and 68.7 per cent for Perceived Usefulness (Individual Impact), and six significant relations are presented (alpha 0.05). The independent constructs Information Quality and Service Quality have significant relations with the mediator construct User Satisfaction. Likewise, User Satisfaction has a significant relationship with the dependent construct, System Dependence (System Use). The independent constructs Information Quality and System Quality have a significant relationship with the mediator construct Perceived Usefulness (Individual Impact) and the Perceived Usefulness (Individual Impact) has a significant relation with the User Satisfaction construct. The dependent construct, System Dependence (System Use), is explained in 11,7 per cent (R2).

We can compare the three models in the next Table II. The best model is the Seddon model; the second-best model is the Modified Seddon model, which is quite similar to the first model; and thirdly the DeLone and McLean model. The Seddon model has the best for CFI (0.958 against 0.957 and 0.948), RMSEA (0.068 against 0.068 and 0.076), R2 of Perceived Usefulness (0.687 against 0.687 and 0.652), R2 of User Satisfaction (0.803 against 0.803 and 0.791). The Seddon model explains the significance of the System Dependence construct in relation to other constructs of the model (like the Modified Seddon model), but the DeLone and McLean does not. The DeLone and McLean better explain System Dependence (R2 of 0.123, against 0.122 and 0.117 for the other models). In addition, for the total number of significant relations between constructs, the Modified Seddon model explained six relations, against five for the Seddon model and three for the DeLone and McLean model.

Some additional comparisons that we can make are with the study of Rai et al. (2002), in which there are various differences, especially with the Delone and McLean model, but less with two models of Seddon. The main differences could be explained by the fact that the Rai et al. (2002) study was realised with students of only one university, and this study was realised with executives of the IT department of several companies (Appendix 6).

The other comparison is with Wieder et al. (2012), in which they found a significative relation (**) between User Satisfaction and BI Use (System Dependence in this study). In this study we found the same relation in two of the three models: there were no relation in the DeLone and McLean model, but there was a relation in the Seddon model (*) and the Modified Seddon model (*). Wieder et al. use a variation of the DeLone and McLean model, using PLS, that is less demanding that EQS (structured equations of covariance).

6. The system use construct (system dependence)

There are several studies related to system usage, user satisfaction and the individual impact that had controversial outcomes. Some authors indicate that there is a direct relationship between system use and individual performance (Goodhue and Thompson, 1995); others did not find any relation between those constructs (Lucas and Spitler, 1999). There is a direct relation between System Use and User Satisfaction (Iivari, 2005; Halawi et al., 2007-2008; Bokhari, 2005; D´Ambra and Rice, 2000), and other authors indicate that there is not that relation (Baroudi et al., 1986). Other authors find a direct relation between System Use and the Individual Impact (Halawi et al., 2007-2008; Rai et al., 2002; Yuthas and Young, 1998; Guimaraes and Igbaria, 1997). Other authors did not find that relation (Gelderman, 1998; Roldan and Millan, 2000).

6.1 Voluntary and mandatory contexts

Norzaidi et al. (2008) examined the impact of user resistance on Intranet usage and its relation to performance in middle managers in an organisational context. They examined too, the cause and effect of usage and user resistance in a mandatory and in a voluntary usage. The study demonstrated that usage significantly explain the percentage of variance on the performance of managers. The outcomes of low resistance found in the study imply that the situation where managers are coerced to use Intranet because they do not have other alternatives to complete their jobs. Usage has been observed to have a strong effect on manager performance, and that is one of the success´ factors that influence individual performance.

Eom et al. (2012) realised a study about the role of information technology in e-learning system success in a mandatory context, using PLS to analyse the results, and found a significant relationship between Use and Individual Impact. They compared this study with the research of Rai et al. (2002) that worked in a voluntary context and analysed the data with LISREL and found significant relationships between both constructs. Besides that, compared with the research of Iivari (2005) that worked in a mandatory context analysed the data with PLS, and found no significant relations between both constructs.

He and King (2008), investigated the role of user participation in IS through a meta-analysis and found that the construct Usage was initially thought to be a relevant in Voluntary contexts. As established initially by some researchers like DeLone and McLean (1992), but after that found that some researchers indicated that users still have power over the level of use, grounded on their personal ability (attitude and intention), and after that the variability of their usage qualifies the system use construct as a relevant one (Hartwick and Barki, 1994).

Hennington et al. (2009) studied the usage in an electronic medical record system in a mandatory context. They found that understanding the correspondence between key technological acceptance constructs and usage, needed a multidimensional abstraction of the use construct (time spent using the system, timing of use, and mode of use). Although they agreed with Burton-Jones and Straub (2006) for using, context-specific measures for the use construct, instead of using lean measures (time spent using the system); they found that lean measures might be sometimes appropriate for specific conditions.

As was mentioned previously, Petter and McLean (2009) realised a meta-analysis of more than 50 studies that utilised the DeLone and McLean model to determine the validity and explanatory power of the Use (System Use) construct. They indicated that this construct needs to be improved, to establish significant relations with other constructs, and explain the impact of an IS model.

6.2 New conceptualizations of the system use construct

Dishaw and Strong (1998) tried to explain the System Use construct with a model with a mediator construct, Intention to Use, and the independent constructs related with the Task-Technology Fit: Intrinsic Fit, Contextual Fit, Representation Fit and Accessibility Fit; and with the Behavioural Control construct. They could explain 16 per cent of the variance of the System Use construct and 70 per cent of the Intention to Use construct.

Burton-Jones and Straub (2006) re-conceptualize the system usage construct in specific nomological circumstances, working in two phases, definition and selection. This scheme permits researchers to establish precise measures of system usage for a particular context. The first phase necessitates a definition of the system use and determines basic assumptions. In the selection phase, the system usage needs to be designed according to its structure and function.

To explain in a better way the System Use construct (duration, frequency, and intensity), Venkatesh et al. (2008), use a mediator construct, Behavioural Expectations, and two independent constructs, Behavioural Intentions and Facilitating Conditions, in a longitudinal field study, and explained between 60 per cent and 65 per cent of the variance of the dependent construct, System Use.

Continuing research to further specify the System Use Construct, Lallmahomed et al. (2013) utilised a model with the mediator construct Behavioural Intention, the independent constructs Performance Expectancy, Effort Expectancy, Social Influence, Facilitating Conditions and Hedonic Performance Expectancy, and System Use as dependent construct (Cognitive Absorption; volume, frequency and intensity; and Deep Structure Use), and achieved a variance explanation of 71 per cent of the dependent construct.

As could be observed in the previous lines, there are contradictory results of the relation of the System Use construct (System Dependence construct) with the Perceived Usefulness construct (Individual Impact construct), and other constructs as User Satisfaction. It is not completely clear too when specifying the voluntary or mandatory context, if the System Use construct has a direct and significant relationship with other constructs. Furthermore, some authors as Venkatesh et al. (2008) and Lallmahomed et al. (2013) has tried new conceptualisation of this construct, working with predictors of use, and have obtained good explanations of the System Use construct (between 60 and 65 and 71 per cent of the variance explained).

7. Discussion

The results received from this research indicates that the Seddon model performs and explains better what is happening with the BIS, compared to the DeLone and McLean model and with the Modified Seddon model. The fit is better than in the DeLone and McLean model (CFI of 0.958 vs 0.948; RMSEA 0.068 vs 0.076), the same goes for R2 Average explained (0.537 vs 0.522). The Seddon model has a significant relationship between the System Dependence (System Use) and the other constructs, whereas the DeLone and McLean do not. The Seddon model has five significant relations between the constructs, while the DeLone and McLean has only three. The Modified Seddon model obtains an almost as good result, as the Seddon model, with the only advantage that explains one additional significant relation between constructs (six in total).

In the last years, the DeLone and McLean model, which is one of the more used models to estimate the impact of an IS, has been evaluated through several studies that have used it partially or completely. Most of the relations between constructs have been confirmed (Petter et al., 2008). The construct System Use, as previously mentioned, could be a good indicator of a successful system when it is voluntary or discretional, and not when the system has captive users, who do not have an alternative system to process information (Lucas, 1978). Besides that, Petter and McLean (2009) performed a meta-analysis on the DeLone and McLean Success of IS model, considering 52 studies. They concluded that the User construct needed to be improved. Given that there no more consistent or confident measures exist, it would be difficult to find relations between this construct and the others of the model.

Wieder et al. (2012) performed research about the impact of BI tools on Performance working with the DeLone and McLean model of IS Success. They did not find a significant relation between User Satisfaction and BI Use but found a weak relation between BI Use and Performance Indicators. They indicated that it is possible to find several particularities in BISs: first, the most advanced users of the system use the system more, in its full capacity, find errors, create difficult questions about the system, become less satisfied with the system and possibly use it less. On the other hand, the less experimented users look for the simple ways of using the system, find everything they need, are happy with the system, and would use it more.

Second, the BIS are configured to elaborate reports for easy usage in a fully-automated way. Users who want to get the most from the system need to have advanced technical skills and need to know a little more about the basic configuration of the system. This is related to the frustration of the user, indicating a lack of friendliness and adequate technical characteristics of the system. Finally, there would be an inadequate System Use because of a shortage of mental and cultural awareness of BI, and the BIS would lack performance. Because of those reasons, the construction of the System Dependence (System Use), according to Rai et al., 2002, is not working well in the DeLone and McLean model, it does not get a good fit, nor does it have a good level of explanation.

The Modified Seddon model considers an additional restriction compared with the Seddon model. It indicates that there is a correlation between the Perceived Usefulness (Individual Impact) and the System Dependence (System Use) constructs. In this way, a better explanation and fit will exist. The supposition here is that the users of the Information System only have one viable choice for getting and analysing information, increasing the perceived benefit of the Perceived Usefulness (Individual Impact), so there is a correlation between Perceived Usefulness (Individual Impact) and System Dependence (System Use), with no causal relation between them.

The System Use (System Dependence) construct seems to work well in this research, using the Seddon IS Success model, nevertheless that variance explanation is not so high (12.2 per cent), and showing no relation with the Individual Impact (Perceived Usefulness) (observed when applying the modified Seddon IS Success model). Therefore, it could be interesting to make future research comparing these three models but working with a modified System Use (System Dependence) construct, considering the predictors of use, as proposed by Venkatesh et al. (2008) and Lallmahomed et al. (2013). The System Use construct could be mediated by a Behavioural Intention construct that works with the next independent constructs: Performance Expectancy, Effort Expectancy, Social Influence, and Facilitating Conditions. The System Use construct would have the next variables or components: User aspect (cognitive absorption), System Aspect (volume, frequency, intensity), and Task aspect (deep structure use).

As a way of attesting the practical and theoretical implications, and insinuate some conclusions, we can say that the Seddon model seems to explain better what happens with a BIS and will be preferable to use this model when making a research, nevertheless that it would be relevant to repeat this analysis to confirm the results. In the case of the Use Construct (System Dependence), it seems necessary when using it as a part of an Information System Success model, like the Delone and McLean model or Seddon model, that it has to be established with more detail, considering some complementarities like the mentioned by Burton-Jones and Straub (2006), Venkatesh et al. (2008), or Lallmahomed et al. (2013).

8. Limitations and recommendations for future studies

It is estimated that the sample includes more than 15 per cent of all the companies that use a BISs in Peru, so the size of the sample is adequate, but it is not entirely random and therefore limits the generalizability of outcomes. Besides that, a sample size that is bigger could be better for the sake of making a more detailed analysis, permitting the use of some items with less power, or the use of another statistical procedure for structural equations such as the Asymptotical Distribution Free, permitting a more detailed analysis (Hair et al., 2006).

As mentioned previously in the Discussion section, it would be interesting to continue the research of this subject, comparing the same three models, but conceptualising the System Use construct considering the predictors of use, to obtain a better explanation (variance) and getting more significant relations with other constructs. Another point would be to try to be more rigorous would be equally better, allowing the utilisation of some objective measures, not only perceptual measures for several of the constructs.

 

References

Baroudi, J., Olson, M. and Ives, B. (1986), "An empirical study of the impact of user involvement on system usage and information satisfaction", Communications of the Acm, Vol. 29 No. 3, pp. 232-238.         [ Links ]

Bokhari, R.H. (2005), "The relationship between system usage and user satisfaction: a Meta-analysis", Journal of Enterprise Information Management, Vol. 18 No. 2, pp. 211-234.         [ Links ]

Brown, I. and Jayakody, R. (2009), "Business e-commerce success: a test validation of a revised conceptual model", The Electronic Journal Information Systems Evaluation, Vol. 12 No. 2, pp. 129-148.         [ Links ]

Burton-Jones, A. and Straub, D.W. (2006), "Reconceptualising system use: an approach and empirical test", Information Systems Research, Vol. 17 No. 3, pp. 228-246.         [ Links ]

Byrne, B.M. (2006), Structural Equation Modeling with EQS, Psychology Press, New York, NY.         [ Links ]

Chen, H., Chiang, R. and Storey, V. (2012), "Business intelligence and analytics: from big data to big impact", MIS Quarterly, Vol. 36 No. 4, pp. 1165-1188.         [ Links ]

Chen, L., Soliman, K.S., Mao, E. and Frolick, M.N. (2000), "Measuring user satisfaction with data warehouses: an exploratory study", Information and Management, Vol. 37 No. 3, pp. 103-110.         [ Links ]

Chugh, R. and Grandhi, S. (2013), "Why business intelligence? Significance of business intelligence tools and integrating BI governance with corporate governance", International Journal of E-Entrepreneurship and Innovation, Vol. 4 No. 2, pp. 1-14, available at: www.researchgate.net/publication/273861123_Why_Business_Intelligence_Sign        [ Links ]

D´Ambra, J. and Rice, R.E. (2000), "Emerging factors in user evaluating of the world wide web", Information and Management, Vol. 1904, pp. 1-12, available at: www.elsevier.com/locate/dsw        [ Links ]

DeLone, W.H. and McLean, E.R. (1992), "Information systems success: the quest for the dependent variable", Information Systems Research, Vol. 3 No. 1, pp. 60-95.         [ Links ]

DeLone, W.H. and McLean, E.R. (2003), "The DeLone and McLean model of information systems success: a ten-year update", Journal of Management Information Systems, Vol. 19 No. 4, pp. 9-30.         [ Links ]

Dishaw, M.T. and Strong, D.M. (1998), "Assessing the software maintenance tool utilization using task-technology fit and fitness-for-use models", Software Maintenance: Research and Practice, Vol. 10 No. 3, pp. 151-179.         [ Links ]

Eom, S., Ashill, N.J., Arbaugh, J.B. and Stapleton, J.L. (2012), "The role of information technology in e-learning system success", Human Systems Management, Vol. 31 No. 3/4, pp. 147-163.         [ Links ]

Gartner (2013), "Gartner executive program survey of more than 2,000 CIOs shows digital technologies are top priorities in 2013", available at: www.gartner.com/newsroom/id/2304615 (accessed 7 June 2016).         [ Links ]

Gelderman, M. (1998), "The relationship between user satisfaction, usage of information systems and performance", Information and Management, Vol. 34 No. 1, pp. 11-18.         [ Links ]

Gonzales, R. (2008), Modelos Para Medir el Impacto de Los Sistemas de Información, Unpublished manuscript, ESAN University.         [ Links ]

Goodhue, D.L. and Thompson, R.L. (1995), "Task-technology fit and individual performance", MIS Quarterly, Vol. 19 No. 2, pp. 213-236.         [ Links ]

Guimaraes, T. and Igbaria, M. (1997), "Client/server system success: exploring the human side", Decision Sciences, Vol. 28 No. 4, pp. 851-876.         [ Links ]

Hair, J.F., Black, W.C., Babin, B.J., Anderson, R.E. and Tatham, R.L. (2006), Multivariate Data Analysis, Pearson Prentice Hall, Upper Saddle River.         [ Links ]

Halawi, L.A., McCarthy, R.V. and Aronson, J.E. (2007-2008), "An empirical investigation of knowledge management systems´ success", Journal of Computer Information Systems, Vol. 48 No. 3, pp. 121-135.         [ Links ]

Hartwick, J. and Barki, H. (1994), "Explaining the role of user participation in information system use", Management Science, Vol. 40 No. 4, pp. 440-465.         [ Links ]

He, J. and King, W.R. (2008), "The role of user participation in information systems development: implications for a Meta-analysis", Journal of Management Information Systems, Vol. 25 No. 1, pp. 301-331.         [ Links ]

Hennington, A., Janz, B., Amis, J. and Nichols, E. (2009), "Information systems and healthcare xxxii: understanding the multidimensionality of information systems use: a study of nurses´ use of mandated electronic medical record system", Communications of the Association for Information Systems, Vol. 25 No. 25, pp. 243-262.         [ Links ]

Hong, S., Katerattanakul, P., Hong, S. and Cao, Q. (2006), "Usage and perceived impact of data warehouses: a study in Korean financial companies", International Journal of Information Technology and Decision Making, Vol. 5 No. 2, pp. 297-315.         [ Links ]

Iivari, J. (2005), "An empirical test of the DeLone-McLean model of information system success", ACM SIGMIS Database, Vol. 36 No. 2, pp. 8-27.         [ Links ]

Kulkarny, U., Ravindran, S. and Freeze, R. (2006), "Knowledge management success model: theoretical development and empirical validation", Journal of Management Information Systems, Vol. 23 No. 3, pp. 309-347.         [ Links ]

Lallmahomed, M.Z.I., Rahim, N.Z.A., Ibrahim, R. and Rahman, A.A. (2013), "Predicting different conceptualizations of system use: acceptance in hedonic volitional context (facebook)", Computers in Human Behavior, Vol. 29 No. 6, pp. 2776-2787.         [ Links ]

Lucas, H.C. (1978), "Empirical evidence for a descriptive model of implementation", MIS Quarterly, Vol. 2 No. 2, pp. 27-42.         [ Links ]

Lucas, H.C. and Spitler, V.K. (1999), "Technology and performance: a field study of broker workstations", Decision Sciences, Vol. 30 No. 2, pp. 291-311.         [ Links ]

McKinney, V., Yoon, K. and Zahedi, F. (2002), "The measure of web-customer satisfaction: an expectation and disconfirmation approach", Information Systems Research, Vol. 13 No. 3, pp. 296-315.         [ Links ]

Norzaidi, M.D., Salwani, M.I., Chong, S.C. and Rafidah, K. (2008), "A study of intranet usage and resistance in Malaysia´s port industry", Journal of Computer Information Systems, Vol. 49 No. 1, pp. 37-47.         [ Links ]

Parzinger, M.J. and Frolick, M.N. (2001), "Creating competitive advantage through data warehousing", Information Strategy: The Executive’s Journal, Vol. 17 No. 4, pp. 10-15.

Petter, S., DeLone, W. and McLean, E. (2008), "Measuring information systems success: models, dimensions, measure, and interrelationships", European Journal of Information Systems, Vol. 17 No. 3, pp. 236-263.         [ Links ]

Petter, S. and McLean, E.R. (2009), "A Meta-analytic assessment of the DeLone and McLean IS success model: an examination of IS success at the individual level", Information and Management, Vol. 46 No. 3, pp. 159-166.         [ Links ]

Rai, A., Lang, S.S. and Walker, R.B. (2002), "Assessing the validity of IS success models: an empirical test and theoretical analysis", Information Systems Research, Vol. 13 No. 1, pp. 50-69.         [ Links ]

Roldan, J.L. and Millan, A.L. (2000), "Analysis of the information systems success dimensions interdependence: aan adaptation of the DeLone and McLean´s model of the spanish EIS field", BITWorld 2000, Conference Proceedings.         [ Links ]

Sabherwal, R., Jeyaraj, A. and Chowa, C. (2006), "Information system success: individual and organizational determinants", Management Science, Vol. 52 No. 12, pp. 1849-1864.         [ Links ]

Seddon, P.B. (1997), "A respecification and extension of the DeLone and McLean model of IS success", Information Systems Research, Vol. 8 No. 3, pp. 240-253.         [ Links ]

Sharda, R., Delen, D. and Turban, E. (2014), Business Intelligence, a Managerial Perspective, Pearson, Boston.         [ Links ]

Soh, C. and Markus, M.L. (1995), "How it creates business value: a process theory synthesis", Proceedings of the 16th International Conference of International Systems, Amsterdam, The Netherlands.         [ Links ]

Swanson, B.E. (1974), "Management information systems: appreciation and involvement", Management Science, Vol. 21 No. 2, pp. 178-188.         [ Links ]

Venkatesh, V., Brown, S.A., Maruping, L.M. and Bala, H. (2008), "Predicting different conceptualizations of system use: the competing roles of behavioral intention, facilitating conditions, and behavioral expectation", MIS Quarterly, Vol. 32 No. 3, pp. 483-502.         [ Links ]

Wieder, B., Ossimitz, M.-L. and Chamoni, P. (2012), "The impact of business intelligence tools on performance: a user satisfaction paradox?", International Journal of Economic Sciences and Applied Research, Vol. 5 No. 3, pp. 7-32.         [ Links ]

Yuthas, K. and Young, S.T. (1998), "Materials matters: assessing the effectiveness of materials management IS", Information and Management, Vol. 33 No. 3, pp. 115-124.         [ Links ]

 

 

Citation:

Gonzales, R. and Wareham, J. (2019), "Analysing the impact of a business intelligence system and new conceptualizations of system use", Journal of Economics, Finance and Administrative Science, Vol. 24 No. 48, pp. 345-368. https://doi.org/10.1108/JEFAS-05-2018-0052

 

Received: 22 May 2018

Revised: 30 November 2018

Accepted: 1 December 2018

 

Creative Commons License Todo el contenido de esta revista, excepto dónde está identificado, está bajo una Licencia Creative Commons