- Case study
- Open Access
Research performance of AACSB accredited institutions in Taiwan: before versus after accreditation
© The Author(s) 2016
- Received: 7 March 2016
- Accepted: 27 July 2016
- Published: 8 August 2016
More and more universities are receiving accreditation from the Association to Advance Collegiate Schools of Business (AACSB), which is an international association for promoting quality teaching and learning at business schools. To be accredited, the schools are required to meet a number of standards ensuring that certain levels of teaching quality and students’ learning are met. However, there are a variety of points of view espoused in the literature regarding the relationship between research and teaching, some studies have demonstrated that research and teaching these are complementary elements of learning, but others disagree with these findings.
Unlike past such studies, we focus on analyzing the research performance of accredited schools during the period prior to and after receiving accreditation. The objective is to answer the question as to whether performance has been improved by comparing the same school’s performance before and after accreditation. In this study, four AACSB accredited universities in Taiwan are analyzed, including one teaching oriented and three research oriented universities. Research performance is evaluated by comparing seven citation statistics, the number of papers published, number of citations, average number of citations per paper, average citations per year, h-index (annual), h-index, and g-index.
Discussion and evaluation
The analysis results show that business schools demonstrated enhanced research performance after AACSB accreditation, but in most accredited schools the proportion of faculty members not actively doing research is larger than active ones.
This study shows that the AACSB accreditation has a positive impact on research performance. The findings can be used as a reference for current non-accredited schools whose research goals are to improve their research productivity and quality.
- AACSB accreditation
- Business school
- Citation analysis
One major goal of each university in the higher education system is to assure the quality of teaching and learning. Nowadays, most faculty members (including professors and lecturers), whether in teaching or research oriented universities, are required to participate in both teaching and research activities. There has been much debate in the literature about the relationship between research and teaching. Some studies have shown that research and teaching are complementary elements of learning (Neumann 1992; Prince et al. 2007), however, others have arrived at the opposite findings (Marsh and Hattie 2002; Ramsden and Moses 1992). The conclusion depends on several factors, such as the students’ learning experience, the teaching level (whether including undergraduates and graduates), and so on.
The Association to Advance Collegiate Schools of Business (AACSB)1 was founded in 1916 to accredit schools in the business and management related fields. Their major mission is to improve the quality of management education. Business schools applying for accreditation must follow a set of standards created by the AACSB. For example, the 2013 standards focused on innovation, engagement and impact with students, employers and their communities. As of May 2014, 711 schools have achieved AACSB Accreditation, which is less than 5 % of all schools offering business related degrees worldwide. The accredited business schools are those recognized as having in place a systematic methodology for student learning and have shown continuous improvement of teaching and learning.
Unlike the afore-mentioned studies which have primarily examined links between research and teaching, the focus here is on whether there has been some level of improvement in research performance after receiving AACSB accreditation. The findings of this study could be used as a reference for schools which have not yet become accredited and for accredited schools seeking to revise their teaching and/or research goals. In addition, it usually takes time and needs to modify some teaching processes of many schools for years in order to receive AACSB accreditation. The findings allow current schools to consider whether pursuing the AACSB accreditation is a right choice for them. For the purpose of determination of answering the question of improvement, bibliometric analysis is conducted over the AACSB accredited institutions.
Studies based on bibliometric analysis usually focus on individuals (as in Abramo et al. 2014; Sangwal 2013), specific countries, [for example, Ivanovic and Ho’s 2014 study of Serbia or Panat’s study of India and China (2014)], specific research fields [such as fuel cell technology (Suominen 2014) and sustainable development (Hassan et al. 2014)], or both, for example, the study of soil science in the Philippines by Navarrete and Asio (2014) or chemical engineering in China by Fu et al. (2014).
There are two contributions of this current paper. First, in relation to the link between research and teaching, we examine whether international accreditation for the purpose of ensuring the quality of teaching and learning at business schools can have a positive impact on research performance. Second, it fills a gap in the bibliometric analysis literature, because there have been very few studies focusing on the research performance of AACSB accredited schools.
The rest of this paper is organized as follows. “Literature review” section provides an overview of the related literature dedicated to using the bibliometric analysis method for specific targets. “Methodology and data” section describes the methodology and data used in the current study. The results are discussed in “Results and discussion” section and finally, “Conclusion” section concludes the paper.
The effect of AACSB accreditation on business schools
As noted above the Association to Advance Collegiate Schools of Business (AACSB) has created a number of standards that the accredited schools should follow. This has had a certain impact on the teaching performance of these business schools as well as the faculty’s research performance. According to Khojasteh and Herring (2002), many teaching orientated schools must place a much greater degree of emphasis on research and other types of scholarly activities in order to achieve accreditation by the AACSB. In addition, faculty members are required to conduct research in order to maintain academic qualification status.
Some of the different effects of AACSB accreditation on business schools have been studied. For example, Webster and Hammond (2012) investigated how the performance of AACSB accredited schools may be influenced by customers (i.e., students of the school) and market orientation. Interested in the research perspective, Azad and Seyyed (2007) studied what are the important factors that could influence faculty research productivity at AACSB accredited schools in the GCC (Gulf Cooperation Council) countries.
In 2013, a new standard was included for AACSB research assessment of business schools that is assessment of the impact of faculty research.2 There are several ways to assess faculty performance depending upon the policy of the schools and the definition of impact, such as the number of publications, professional services offered, and government funding (Shinn 2014).
However, how AACSB accreditation affects a school’s research performance is unknown. In order to understand this it is necessary to measure the impact on research before and after accreditation, which is done based on the well-known method of citation analysis.
Bibliometrics are a set of methods used to quantitatively analyze academic literature (De Bellis 2009) with citation analysis being one of the most commonly used analysis methods. The bibliometric information associated with a publication usually includes author, affiliation, citations from other publications, co-citations with other publications, and so on. The related information can be used to further explore the impact of individual researchers or a set of researchers (Abramo et al. 2014; Sangwal 2013), the impact of different research fields (Hassan et al. 2014; Suominen 2014), or the impact of a particular paper or a publication (Tsai 2014; Ke et al. 2014). Abramo et al. (2014) attempted to answer the question of whether the authors of more frequently cited articles are also the most productive ones. They collected data for Italian academics in the hard sciences and showed that 58.3 % of the most highly cited articles were produced by the most productive scientists. Sangwal (2013) analyzed the citation rank-order distribution of papers of selected individual authors using five mathematical functions.
Hassan et al. (2014) presented a bibliometric study of the research landscape in sustainable development at both the country level and institute level. They found that China appears strong in terms of publication output in sustainable development and its sub-areas.
Suominen (2014) conducted a bibliometric study of the evolution of fuel cell research networks at a national level. They observed that a number of new countries have published fuel cell related work, while still remaining at the periphery of the related research. They suggested that further study is needed to uncover the sustainability of research efforts in emerging countries in the fuel cell field.
In addition to using the bibilometric analysis methods for individual researchers and specific research fields, Tsai (2014) combined computer science journal rankings including their impact factors, 5-year impact factors, and h-indices. They produced a journal re-ranking result, to be used as a reference for researchers when selecting their publication outlets. Ke et al. (2014) conducted a citation impact analysis of conference papers that appeared in oral and poster sessions at three different computer science conferences. They found the papers presented during the oral sessions to have a higher impact than those presented in the poster session. For example, a larger proportion of highly cited papers were from oral sessions as opposed to poster sessions. In addition, the average number of citations per orally presented paper was larger than per poster based paper.
Methodology and data
In this study, we gathered data on AACSB accredited institutions in business schools in Taiwan. Currently, there are 10 business schools that are accredited with four of them being accredited twice: Fu Jen Catholic University (FJU), National Chengchi University (NCCU), National Chiao Tung University (NCTU), and National Sun Yat-sen University (NSYSU). Note that once a business school earns AACSB accreditation, to preserve that accreditation it needs to be re-examined after 5 years to demonstrate that they fulfill the AACSB standards.
The basic information for FJU, NCCU, NCTU, and NSYSU
No. of faculty
These schools have slightly different undergraduate and graduate programs, so we use the Management Information Systems (MIS) Department for examination. Information about the research performance of the MIS faculty members at these four schools is also collected. Specifically, the Publish or Perish software3 is used to collect related information for faculty research performance including numbers of papers published, number of citations, average citations per paper, average citations per year, h-index (annual), h-index, and g-index.
The h-index has been recently proposed as a measure of both productivity and impact of the published work of a scientist or scholar (Hirsch 2005). It is based on a set of the scientist’s most frequently cited papers and the number of citations that they have received in other publications. In contrast, the g-index focuses more on frequently cited articles (Egghe 2006).
The research performance of these four schools before and after accreditation is evaluated based on the 5 years before and after the year of accreditation. For example, for FJU, the 5-year period between 2001 and 2005 represents the time before accreditation whereas the 5-year period between 2006 and 2010 represents the time after accreditation. The research performance during these two periods is compared for each case. Note that faculty members who were recruited during the period after accreditation are not considered.
Research performance of the four accredited schools
The average research performance of FJU, NCCU, NCTU, and NSYSU
For all seven citation statistics, the research oriented universities demonstrated a larger level of research performance improvement than the teaching oriented university in terms of the no. of papers, no. of citations, and citations/year (c.f., Fig. 1h). However, for the research oriented universities, there was a much larger level of improvement for ‘papers’, ‘citations/year’, and ‘hi, annual’ than for ‘citations’, ‘citations/paper’, ‘h-index’, and ‘g-index’. In brief, these statistics show that there was not the same level of improvement in research impact as in the level of productivity. On the other hand, the other four citation statistics show much larger improvement for the teaching oriented university than the research oriented universities.
These results indicate that accreditation of business schools by the AACSB could encourage them to enhance their research performance. In particular, research productivity (as shown by the no. of papers and no. of citations) at the research oriented universities, is enhanced more than the research impact (as shown by citations/paper, h-index, and g-index). On the other hand, the teaching university demonstrates a greater enhancement of research impact than research productivity.
We further classify all faculty members from each school as either active researchers (AR) or non-active researchers (NAR) according to their average research performance, as shown in Table 2. In this paper, a faculty member is defined as an active researcher if any of his or her citation statistics is larger than the average.
The research performance of active and non-active researchers at FJU
The research performance of active and non-active researchers at NCCU
The research performance of active and non-active researchers at NCTU
The research performance of active and non-active researchers at NSYSU
These results indicate that there was a greater improvement in research performance by NAR than AR in most AACSB accredited schools. Furthermore, the difference in improvement between AR and NAR was much larger at the teaching oriented universities, i.e., FJU, than at the research oriented universities. For the research oriented universities, including NCCU and NCTU, most of the performance metrics for NAR, such as the total number of citations, citations/paper, h-index, and g-index, also showed a larger level of improvement than AR.
Therefore, the analysis results demonstrate that the faculty members of schools that received AACSB accreditation showed improved research performances. Moreover, the level of improvement was higher for the non-active researchers at most universities.
The above results show the positive effect on the research performances after receiving the AACSB accreditation. They can be used as a reference for current non-accredited schools whose research goals are to improve their research productivity and quality. On the other hand, for the accredited schools, our results also suggest that keeping accredited every 5 years should be the right choice, which could possibly make some other (non-active researchers) faculties improve their research performances in the future.
In the education related literature, the relationship between research and teaching has been extensively discussed. This study examines this issue from another viewpoint. We focus on the effect that AACSB accreditation has on universities and research performance by examining the differences before and after accreditation.
Based on data from four AACSB accredited universities in Taiwan, including one teaching oriented and three research oriented universities, seven related citation statistics are examined, namely the number of papers published, number of citations, average number of citations per paper, average citations per year, h-index (annual), h-index, and g-index. The findings are summarized. First, there is a definite improvement in research performance after AACSB accreditation. However, for the three research oriented universities, the average number of citations per paper actually decreases. We found that there is a large increase in research productivity, as indicated by the number of published papers and total number of citations, but the research impact, as indicated by citations per paper, h-index, and g-index, does not have the same level of improvement. However, the teaching university showed a greater enhancement in research impact over research productivity. Second, there was a bigger improvement in research performance for non-active research faculty members than active ones. Moreover, this difference in improvement between active and non-active research faculty members was greater in the teaching oriented university.
This study shows that the AACSB accreditation has a positive impact on research performance. However, there remain some issues such as the limitations of this study that need to be further examined in the future. First, more teaching and research oriented universities across different countries should be compared. Second, longer examination periods could be considered when looking at the change in research performance. For example, the period between the second and third accredited years of different schools can be included for comparison. In addition, although the AACSB re-examines the accredited schools every 5 years, the research performance indicators using the 5-year period could be extended in order to reduce the gap between the actual publications and the accreditation dates. Last but not least, it would be useful to investigate other possible determinants of the increase in research after accreditation, e.g., whether the accredited schools changed their strategic objectives.
The first author, Dr. S-WK contributed to the preparation of research proposal and the writing of “Background” and “Literature review” sections. The second author, Dr. W-CL contributed to the preparation of “Methodology and data”, Results and discussion, Conclusion sections. The third author, Dr. C-FT assisted with the collection and analyses of the dataset as well as the final proofreading of the paper.
The authors declare that they have no competing interests.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
- Abramo G, Cicero T, D’Angelo CA (2014) Are the authors of highly cited articles also the most productive ones? J Informetr 8:89–97View ArticleGoogle Scholar
- Azad AN, Seyyed FJ (2007) Factors influencing faculty research productivity: evidence from AACSB accredited schools in the GCC countries. J Int Bus Res 6(1):91–112Google Scholar
- De Bellis N (2009) Bibliometrics and citation analysis: from the science citation index to cybermetrics. Scarecrow Press, LanhamGoogle Scholar
- Egghe L (2006) Theory and practice of the g-index. Scientometrics 69(1):131–152View ArticleGoogle Scholar
- Fu H-Z, Long X, Ho Y-S (2014) China’s research in chemical engineering journals in science citation index expanded: a bibliometric analysis. Scientometrics 98:119–136View ArticleGoogle Scholar
- Hassan S-U, Haddawy P, Zhu J (2014) A bibliometric study of the world’s research activity in sustainable development and its sub-areas using scientific literature. Scientometrics 99:549–579View ArticleGoogle Scholar
- Hirsch JE (2005) An index to quantify an individual’s scientific research output. Proc Natl Acad Sci USA 102:16569–16572View ArticleGoogle Scholar
- Ivanovic D, Ho Y-S (2014) Independent publications from Serbia in the science citation index expanded: a bibliometric analysis. Scientometrics 101:603–622View ArticleGoogle Scholar
- Ke S-W, Lin W-C, Tsai C-F, Hu Y-H (2014) Citation impact analysis of research papers that appear in oral and poster sessions: a case study of three computer science conferences. Online Inf Rev 38:738–745View ArticleGoogle Scholar
- Khojasteh M, Herring R (2002) Motivation of business school faculty to conduct research. Proceedings of the Academy of Business Education, Key WestGoogle Scholar
- Marsh HW, Hattie J (2002) The relation between research productivity and teaching effectiveness: complementary, antagonistic, or independent constructs? J Higher Educ 73:603–641View ArticleGoogle Scholar
- Navarrete IA, Asio VB (2014) Research productivity in soil science in the Philippines. Scientometrics 100:261–272View ArticleGoogle Scholar
- Neumann R (1992) Perceptions of the research-teaching nexus: a framework for analysis. High Educ 23:159–171View ArticleGoogle Scholar
- Panat R (2014) On the data and analysis of the research output of India and China: India has significantly fallen behind China. Scientometrics 100:471–481View ArticleGoogle Scholar
- Prince MJ, Felder RM, Brent R (2007) Does faculty research improve undergraduate teaching? An analysis of existing and potential synergies. J Eng Educ 96(4):283–294View ArticleGoogle Scholar
- Ramsden P, Moses I (1992) Associations between research and teaching in Australian higher education. High Educ 23:273–295View ArticleGoogle Scholar
- Sangwal K (2013) Comparison of different mathematical functions for the analysis of citation distribution of papers of individual authors. J Informetr 7:36–49View ArticleGoogle Scholar
- Shinn S (2014) Measuring faculty impact. BizEd Mag Lead Voice Bus Educ. http://www.bizedmagazine.com/archives/2014/5/features/measuring-faculty-impact
- Suominen A (2014) Phases of growth in a green tech research network: a bibliometric evaluation of fuel cell technology from 1991 to 2010. Scientometrics 100:51–72View ArticleGoogle Scholar
- Tsai C-F (2014) Citation impact analysis of top ranked computer science journals and their rankings. J Informetr 8:318–328View ArticleGoogle Scholar
- Webster RL, Hammond KL (2012) An organizational performance study of AACSB international member business schools. Am J Bus Educ 5(1):1–10Google Scholar