Journal article · 2017

Student Resistance to a Mandatory Learning Management System in Online Supply Chain Courses

Kenneth David StrangiD & Narasimha Rao VajjhalaiD

Journal of Organizational and End User Computing, 29(3), pp. 49–67 · Published

ScopusQ2Web of ScienceSSCI/SCIE

Summary

What question does this paper answer?

Which Technology Acceptance Model 3 (TAM3) factors explain students’ resistance to a new mandatory learning management system (LMS), and do they predict actual performance (course grade) as well as behavioral intention?

What did the study find?

In a sample of 65 senior supply chain management students at SUNY using a new mandatory Moodle LMS, perceived usefulness, enjoyment, voluntariness and results demonstrability predicted behavioral intention, while perceived resources, perceived ease of use, enjoyment, voluntariness and behavioral intention predicted actual course grade. Behavioral intention predicted actual performance (β = .052, T = 2.44, p = .02); computer self-efficacy, external control, computer anxiety, subjective norm, image, job relevance and output quality were not supported.

Why does it matter?

The authors argue that management students’ technology acceptance motivations will generalize to the future supply chain workforce, so understanding why they resist new mandatory software can help decision makers address critical success factors and improve organizational performance. They also contribute parsimonious models with very few factors that capture 56% of the variance in behavioral intention and 49% in actual performance.

Key findings

  1. The study analysed 65 senior undergraduate supply chain management students at the State University of New York (SUNY) who had to use a new mandatory Moodle learning management system in an online course, using course grade as the measure of actual behavior.
  2. In the SUNY LMS study, a multiple regression model with four factors—perceived usefulness, enjoyment, voluntariness and results demonstrability—captured 52.3% of the variance in behavioral intention (p < .01).
  3. The best-fitting model for actual course grade in the SUNY LMS study captured 48.6% of the variance (adjusted r² = 42.3, p < .01) using perceived resources, perceived ease of use, enjoyment, voluntariness and behavioral intention.
  4. Behavioral intention to use the mandatory LMS predicted students’ actual grade performance (multiple regression β = .052, T = 2.44, p = .02), confirming a key tenet of TAM3.
  5. Among the 65 supply chain students, perceived enjoyment was the only factor significantly correlated with behavioral intention (R = +0.59, p < .05), and none of the TAM3 factors were significantly correlated with grade.
  6. Computer self-efficacy, perceptions of external control, computer anxiety, subjective norm, image, job relevance and output quality were not causally related to either behavioral intention or actual performance in the LMS study.
  7. Including all TAM3 and demographic factors, the regression captured 88.3% of the variance in behavioral intention (adjusted r² = 60.4%) and the surface response regression captured 85.5% of the variance in grade (adjusted r² = 51.2%), but the authors judged these all-factor models theoretically weak.

Source: Strang & Vajjhala (2017), Journal of Organizational and End User Computing, 29(3), pp. 49–67. DOI: 10.4018/JOEUC.2017070103

Study at a glance

Design and results of Student Resistance to a Mandatory Learning Management System in Online Supply Chain Courses
Research questionCan TAM3 identify predictors of resistance to a new mandatory LMS, measured against both behavioral intention and actual grade?
DesignPost-positivist, theory-driven within-group study testing 14 hypotheses from the a priori TAM3 instrument.
Sample65 senior undergraduate global supply chain management students at SUNY Plattsburgh and Queensbury (43% female, mean age 22.1, 100% domestic US).
MethodsOnline TAM3 survey (8-point scale), Cronbach’s alpha, correlations, hierarchical and surface response regression, then multiple regression on behavioral intention and course grade.
Main resultBehavioral intention predicted actual grade (β = .052, T = 2.44, p = .02); enjoyment and voluntariness were linked to both intention and performance.
ImplicationStudents were ‘hedonistic’: positive enjoyment of the mandatory technology accounted for the absence of anxiety, self-efficacy or control effects.
CitationStrang & Vajjhala (2017) · DOI 10.4018/JOEUC.2017070103

Abstract

The authors explored how a technology model captured the factors that motivated and demotivated students to accept a new learning management system in online supply chain courses at an accredited public American university. Technology resistance is a well-known social science problem that results in reduced performance in business although it has rarely been examined in higher education. A new LMS is mandatory technology that is necessary to use in order to perform well in online global supply chain management courses. The authors drew a sample of graduating supply chain management students to explore this problem because these participants represent the next generation of employees who are likely to work with mandatory technology. The authors argue that it is important to study management students because their technology acceptance motivations will generalize to the future supply chain workforce. If decision makers could understand why management students resist new software, then they could develop strategies to address the critical success factors in hopes that organizational performance might be increased. The design was statistically powerful according to social research standards because the authors examined actual behavior by measuring grade as the dependent variable instead of relying on behavioral intent (BI) which is a subjective perceptional factor because participants are generally asked to self-report this through a survey. In keeping with published empirical literature the authors determined that perceived usefulness predicted BI using multiple regression. In contrary to the existing literature, they did not find that perceived resources (PR) was causally related to actual performance, although they did observe through regression that BI could be forecasted from PR. Their regression model indicated that perceived ease of use (PEOU) was not related to BI but in regression they found PEOU significantly impacted actual performance. These were two contradictory findings that PU impacted BI but not actual performance yet PR and PEOU predicted actual performance but not BI. Another unique departure from the empirical literature was that Computer Self Efficacy (CSE), Perceptions of External Control (PEC), and Computer Anxiety (CANX) were not related to either BI or actual performance. An interesting finding was that perceived enjoyment was strongly related to both BI and actual performance, although the perceptions were opposite between intention versus actual behavior. Multiple regression revealed that lower perceptions of enjoyment was significantly linked to BI while strong perceptions of enjoyment predicted actual performance. Although the authors were certain that peer influence would impact BI and actual performance, in their sample they did not find any support for subjective norm pressure on BI or actual performance. In a similar breakthrough they determined that job relevance and output quality were not causally linked to BI or actual performance. Another statistically significant finding was that positive perceptions of voluntariness were causally related to BI through multiple regression tests and also positively related to actual performance based on hierarchical regression. The authors determined that results demonstrability was causally related to BI from their multiple regression tests but interestingly it was not related to actual performance. The authors extensively discuss the above findings in their conclusions and provide many recommendations for future research. Finally, another valuable contribution the authors made to the scholarly community of practice through this study was to develop large effect-size parsimonious models with very few required factors that captured 56% of the variance on BI and 49% of the variance on actual performance.

Abstract as published in Journal of Organizational and End User Computing.

Keywords: Actual Behavior; Behavioral Intent; Higher Education; Learning Management System; Online Supply Chain Course; Technology Resistance

Key terms

Technology Acceptance Model 3 (TAM3)
An extension of the Technology Acceptance Model that explains behavioral intention to use a technology through factors such as perceived usefulness, perceived ease of use, enjoyment, subjective norm and computer self-efficacy.
Behavioral intention (BI)
A person’s self-reported intention to use a technology, usually treated as the antecedent of actual use.
Learning management system (LMS)
Software such as Moodle used to deliver and manage online course content and assessments.

Limitations

  • The study drew a small convenience sample (N = 65) from undergraduate supply chain management students at a public American university, which reduces the ability of the results to generalize outside this population.
  • All participants were American, so culture could not be tested as a predictor; replication with other disciplines, non-American universities, young employees in the workplace and larger samples is recommended.

How to cite

Strang, K. D., & Vajjhala, N. R. (2017). Student Resistance to a Mandatory Learning Management System in Online Supply Chain Courses. Journal of Organizational and End User Computing, 29(3), 49–67. https://doi.org/10.4018/JOEUC.2017070103

BibTeX
@article{strang2017student,
  title = {Student Resistance to a Mandatory Learning Management System in Online Supply Chain Courses},
  author = {Strang, Kenneth David and Vajjhala, Narasimha Rao},
  journal = {Journal of Organizational and End User Computing},
  volume = {29},
  number = {3},
  pages = {49--67},
  year = {2017},
  publisher = {IGI Global},
  doi = {10.4018/JOEUC.2017070103},
  url = {https://doi.org/10.4018/JOEUC.2017070103}
}
Download citation:BibTeXRISCSL-JSONMarkdown

Related research

Technology adoption and digital consumers

2020
Strang & Vajjhala (2020) · International Journal of E-Services and Mobile Applications · DOI 10.4018/IJESMA.2020010103
2019
Vajjhala & Strang (2019) · Proceedings of the 2019 International Conference on Information System and System Management (ISSM 2019), Rabat, Morocco · DOI 10.1145/3394788.3394790
2018
Potluri & Vajjhala (2018) · The Journal of Asian Finance, Economics and Business · DOI 10.13106/jafeb.2018.vol5.no2.73
2018
Vajjhala & Strang (2018) · Twenty-fourth Americas Conference on Information Systems (AMCIS 2018), New Orleans

All paper summaries → · Full publication list →