Analysis of Questionnaire Surveys Conducted in Higher Education Institutions from the Perspective of the Institutional Research for Teaching and Learning

Yoshioka Tsuyoshi; Morikura Yusuke; Kobayashi Ryo; Teruya Kensaku; Izumi Toshiro

Yoshioka Tsuyoshi Teikyo Heisei University, Tokyo, Japan
Morikura Yusuke Teikyo Heisei University, Tokyo, Japan
Kobayashi Ryo Teikyo Heisei University, Tokyo, Japan
Teruya Kensaku Teikyo Heisei University, Tokyo, Japan
Izumi Toshiro Teikyo Heisei University, Tokyo, Japan

Keywords: Higher Education, Questionnaire Analysis, Customer Satisfaction Analysis, IRTL, Faculty Development

Abstract

This study proposes a simplified Customer Satisfaction (CS) analysis procedure by summarizing the CS analysis method, which can be practically applied to questionnaire analysis from the perspective of Institutional Research for Teaching and Learning (IRTL). Most of the questionnaire surveys conducted in higher education institutions are mere aggregations of the percentage of responses. A course evaluation questionnaire assessment method applying CS analysis, which is often used in marketing, has already been established to solve this problem. However, this method cannot be practically implemented if IRTL organizations are not fully functional. Using this proposed method, it is possible to specifically analyze the items that need to be focused on and improved to enhance student satisfaction. Furthermore, this study also examines whether the proposed method could be applied to the analysis of questionnaires for student surveys that have been conducted in recent years. As a result, the proposed method based on the perspective of IRTL has also succeeded in summarizing the guidelines for higher education institutions to conduct survey analysis.

References

Abe, T., Tajima, T., & Kimura, H. (2006). Analysis of questionnaire using multivariate analysis for improving lectures. Journal of JSEE, 54(6), 136-140. doi:https://doi.org/10.4307/jsee.54.6_136

Dohi, S., Miyakawa, O., & Konno, N. (2012). Continuous CS analysis of using the SIEM to introduction to computer programming education in the school of engineering evening division at the department of electrical and electronic engineering. Journal of JSEE, 60(4), 56-62. doi:https://doi.org/10.4307/jsee.60.4_56

Endo, T. (2008). Gakusei ni yoru jugyō hyō ka no CS bunseki [CS analysis of course evaluation by students] (in Japanese). Saga Journal of Higher Education, 4, 1-10.

Fushikida, W., Kitamura, S., & Yamauchi, Y. (2012). Analysis of appeal and dissatisfaction in seminars for third- and fourth-year students with text mining. Japan Journal of Educational Technology, 36(Suppl.), 165-168. doi:https://doi.org/10.15077/jjet.KJ00008609803

Gö k, O. (2009). Linking account portfolio management to customer information: Using customer satisfaction metrics for portfolio analysis. Industrial Marketing Management, 38(4), 433-439. doi:https://doi.org/10.1016/j.indmarman.2008.02.010

Hamada, H., Hashimoto, T., Ishizuka, R., Nishida, N., Nishikawa, A., & Nakagawa, N. (2013). Anxiety factors of students immediately before practical care training: CS portfolio analysis. Rigakuryoho Kagaku, 28(1), 39-43. doi:https://doi.org/10.1589/rika.28.39

Kamaga, S. (2015). Analysis and measures to improve comments section of class evaluations using text mining. Shokei Educational Institution Bulletin, 47, 49-61. doi:https://doi.org/10.24577/seia.47.0_49

Kawakami, M., & Yoshizumi, K. (2008). Characterization of questionnaires of college student evaluation on lectures with respect to faculty development. Educational Information Research, 24(2), 57-67. doi:https://doi.org/10.20694/jjsei.24.2_57

Kurita, K. (2006). On-line course evaluation in the U.S.: A case study. Research on Academic Degrees and University Evaluation, 4, 105-113.

Matsuda, T., & Watanabe, Y. (2017). IR for educational planning, learning analytics, and educational engineering. Japan Journal of Educational Technology, 41(3), 199-208. doi:https://doi.org/10.15077/jjet.42028

Matsumoto, Y., & Tsukamoto, Y. (2004). Analysis of lecture evaluations and point quanti Education, 10, 21-32.

Minami, M. (2007). Gakusei ni yoru jugyō hyō ka e no CS bunseki no tekiyo” [Application of CS analysis to courses evaluation by students] (in Japanese). Bulletin of the Integrated Center for Educational Research and Practice, Mie University, 27, 29-34.

Minami, M. (2008). A study of indices of need to improvement based on the customer satisfaction analyses on class evaluations. Bulletin of the Faculty of Education, Mie University, 59, 291-297.

Minami, M., & Nakanishi, Y. (2010). Evaluation and improvement of couses using CS analysis. Bulletin of the Integrated Center for Educational Research and Practice, 30, 39-43.

Ministry of Education, Culture, Sports, Science and Technology (MEXT). (n.d.). Zenkoku gakusei chōsa [Nationwide student survey] (in Japanese). Retrieved from https://bit.ly/35OVdd5

Ministry of Education, Culture, Sports, Science and Technology (MEXT). (2014). Daigaku ni okeru kyōiku naiyō-tō no kaikaku jōkyō ni tsuite (gaiyō) [Reform status of educational content, etc. at universities (summary)] (in Japanese). Retrieved from https://bit.ly/2UrgR4C

Ministry of Education, Culture, Sports, Science and Technology (MEXT). (2019). Reiwa gan’nendo ‘zenkoku gakusei chōsa (shikō jisshi)’ ni tsuite [About “nationwide student survey (trial implementation)” in the academic year 2019] (in Japanese). Retrieved from https://bit.ly/3dbnsH1

Ministry of Education, Culture, Sports, Science and Technology (MEXT). (2020a). Reiwa gan’nendo ‘zenkoku gakusei chōsa (shikō jisshi)’ kekka” [Result of “nationwide student survey (trial implementation) in the academic year 2019] (in Japanese). Retrieved from https://bit.ly/3i6SQJt

Ministry of Education, Culture, Sports, Science and Technology (MEXT). (2020b). Reform status of educational content, etc. at universities in the academic year 2018. Retrieved from https://bit.ly/3qmEPdn

National Institute for Educational Policy Research (NIER). (2016). Daigakusei no gakushū jittai ni kansuru chōsa kenkyū ni tsuite (gaiyō) [Survey research on the actual learning situation of university students (summary)] (in Japanese). Retrieved from https://bit.ly/3j83JM3

Okada, Y., & Torii, T. (2018). Process model of educational information management in institutional research for teaching and learning. Japan Journal of Educational Technology, 42, 313-322. doi:https://doi.org/10.15077/jjet.42109

Takahashi, K., Hayashi, Y., Taneda, Y., Kagei, S., Yaguchi, T., & Kanzaki, N. (2005). School-wide course improvement and course evaluations: Report on current status of program. Kyoto University Researches in Higher Education, 11, 19-32.

The University of Chicago. (n.d.). Course evaluations. Retrieved from https://bit.ly/3j5YSv0

The University of Tokyo. (n.d.). Daigaku kyōiku no tassei-do chōsa [Survey on achievement in university education] (in Japanese). Retrieved from https://bit.ly/3i8rMd9

Tohoku University. (n.d.). Zengaku onrain jugyō ankēto’ no kekka gaiyō [Summary of the results of the “Tohoku university online course questionnaire”] (in Japanese). Retrieved from https://bit.ly/3x7fOVS

Waseda University. (2020). Onrain jugyō ni kansuru chōsa kekka [Survey results on online courses] (in Japanese). Retrieved from https://bit.ly/3j85nxd

Yamada, R. (2016). The development process of IR in the United States: Analysis of the function of IR in the framework of higher education policy and the issue of professionalism. Japanese Journal of Higher Education Research, 19, 25-47. doi:https://doi.org/10.32116/jaher.19.0_25