Experimental study on tourist satisfaction using participatory simulation in a virtual environment
© Chao et al.; licensee Springer. 2013
Received: 14 July 2013
Accepted: 7 October 2013
Published: 22 October 2013
Before traveling, tourists need to ensure that they will have a well-organized trip, which mainly involves a smooth flow of visits to different tourist attractions by themselves or following a pre-designed plan made by tourism service providers. The present study examined how the sequence of visiting tourist attractions influences tourist satisfaction at the expectation and experience levels. Participatory simulation with a virtual environment platform was employed in the experiments to assess their experience. The research reveals that the contrast bias has significant influence on the assessment.
Tourist satisfaction is one of the most important indicators of the future intention of tourists to visit (Osti et al. 2012). Tourism providers can improve their services by studying tourist satisfaction, especially their evaluation processes and preferences. In many studies about tourist satisfaction, the behavior model of satisfaction assessment is derived from studies about the consumers of general commercial products (e.g., Seddighi and Theocharous 2002; Tussyadiah 2006), rather than services that involve abundant physiological fluctuation and complex experience. Text-based questionnaires without further emotional interaction are commonly used to collect data for analyzing the assessment of tourists of their experience. However, human preferences are not constant and their assessment for satisfaction might not have a very rational or standardized basis as suggested in several studies about psychology and behavioral economics (Ariely and Zauberman 2000; Kahneman 2000a). Thus, tourist satisfaction with their expected or actual experience at each tourism attraction can be influenced largely by different sequences of visiting.
Contrast bias describes the inclination to overrate or underrate a subject compared with another (Herr et al. 1983). The present study adopts these concepts to refer to assessment biases with regard to tourist satisfaction. The contrast bias is exhibited when the sequence of visiting tourist attractions is changed in different contexts (e.g., the types of attraction and perceived quality of the service). In other words, previous travel experiences of tourists affect their assessment of the satisfaction of their next travel experiences.
Our study intends to explore the contrast bias on tourist satisfaction by participatory simulation in virtual environments (VEs). By combining experiments with the participation of real people and artificial tourism scenarios, we examine the theories beyond the simulation settings, thereby deepening our understanding of the assessment of tourists of their experience.
Previous studies and hypothesis development
Some researchers have suggested that tourists assess their expected or experienced satisfaction with destinations through the “characteristics” they possess (Seddighi and Theocharous 2002; Tussyadiah 2006). The researchers argue that tourists “consume” each characteristic (e.g., natural beauty, cultural heritage, and entertainment elements) of the tourism destination. Most studies about tourist behavior were inspired by research about consumer behavior (Lancaster 1966), and other research results in tourism (Wu and Carson 2008; Yang et al. 2009). However, in this assessment model, tourists have very rational and stable preferences towards different types of attractions and destinations, which may contradict reality (e.g., Kahneman and Tversky 1979; Kahneman 2000a).
Studies in behavioral economics revealed that consumers are not only rational as modeled in many other studies, but their preferences also seem to be easily framed and their decisions are reversed under different contexts (Ariely and Zauberman 2000). Interesting findings on behavioral economics, such as affection treadmill (Kahneman 2000b) and hedonic adaptation (Frederick and Loewenstein 1999), provide new perspectives to improve the model for the general assessment of tourists of their experience.
Hedonic treadmill and perceived variety
The term “hedonic treadmill” was brought up in wellness studies (Diener 2000). “Hedonic treadmill” generally means the phenomenon in which people have a very strong capability to adapt to pleasant or painful events that happen in their life, and thus move back to an emotional baseline prior to the changes (Myers and Diener 1996). Many other researchers have extended the definition by distinguishing different types of “treadmill” according to their adaptation channel (Kahneman 2000b). The present study simply adopted the general concept of human attentiveness to adapt to pleasant or unpleasant experiences.
As pointed out by many researchers, having a variety of activities is one of the most crucial factors for resisting the hedonic treadmill of happiness in life (Lyubomirsky 2005; Chernev 2011). However, simply increasing the variety may not be the ultimate solution to reduce adaptation (Redden and Haws 2012). Researchers in marketing science have pointed out that categorization that influences the perceived variety of consumer products also effectively affects how consumers rate their enjoyment by changing the settings of assertion (Kahn and Wansink 2004). These studies suggested that the differences in the types of context in which the subject is compared with, might also contribute to the contrast bias.
Related works in tourism studies
Most stakeholders in the tourism industry prefer repeaters, and invest much to attract and nurture loyal visitors, but like many other types of consumers, tourists show a variety-seeking behavior (Kemperman et al. 2000; Jang et al. 2007). Even repeating visitors usually return to the same tourism destination after some time rather than immediately, and the reasons for their return are quite complex (Kozak 2001). Little is known about how the contrast of tourist experience can affect their enjoyment or satisfaction. The present study believes that the difference in the sequence of visiting, which leads to the contrast of different tourist experiences, affects the judgment of tourists regarding their satisfaction. The results of this study will help travel agencies to improve their services, especially for arranging guided tours. The hypothesis is important for tourism-related information providers (websites, publishers) in organizing the information and spotlighting promotions.
Some researchers in tourism services have successfully applied information technology to assist their studies of the assessment of tourists of their experience (Gretzel 2011; Johnson and Sieber 2011; Yang et al. 2009). Information systems are powerful tools in developing decision-making support systems, conducting observation, collecting data, and developing simulations. However, as tourist experience involves abundant physical and emotional interactions between tourists and tourism spaces, the present study needs to develop a thorough and efficient method of studying the behavioral patterns of tourists, especially their dynamic, emotional, and sometimes, irrational decision-making. The recent trend of applying VEs in assessing user experience solves such a problem by providing assistance in creating and controlling interactive and real-world-like environments (Rebelo et al. 2012). Hence, to deepen our understanding of the assessment of tourists of their experience and to examine the contrast bias, the present study proposes the application of VEs, i.e., artificial but real tourism destination-like, and the use of participatory simulations to observe the assessment tourists of their experience.
OpenSimulator is an open-source platform, which allows users to create, customize, and access VEs.
It supports real-time interactive three-dimensional (3D) applications to create vivid tourism experience for participants.
It allows real time recording of the process and the assessment of tourists.
Although most studies that applied this software are not in the area of tourism services, some tourism services have successfully utilized the OpenSimulator or similar VE platforms to develop simulation platforms for education (Moschini 2010; Sheehy 2010) and study of human behavior (Koutsabasis et al. 2012). We believe that OpenSimulator can also be utilized to study tourist decision-making and assessment, and thus improve future tourism services.
Application to tourism studies
We developed participatory simulation with OpenSimulator (OpenSimulatorulator) to examine the contrast bias on tourist satisfaction of their travel experience. The process by which a tourist assesses his/her satisfaction with any kind of tourism experience can be separated into two different levels, namely, expectation and experience (Bosque and Martín 2008). With the help of some other users and developers (Lindakellie) of OpenSimulator in providing contents to design virtual worlds under a creative common license, we developed two different sets of virtual tourism destinations to test the effects at the expectation and experience level.
These are two states of satisfaction during the trip (Oh et al. 2012). The expected satisfaction is usually generated during the decision-making process on destinations or attractions, while experienced satisfaction occurs during travel activities. The expectation level refers to the process where tourists are provided with different options of tourist attractions, and evaluate whether they will be satisfying or not. The experience level refers to the process where tourists evaluate whether tourist attractions were satisfying or not after actually visiting. This study assumes that the contrast bias (of the types of the tourist attraction and the perceived quality of the attraction) can be detected. An attraction varies because of the difference in the visiting sequence, nature of attractions, and expected or experienced satisfaction. The satisfaction may be influenced by the contrast effect of the types of tourist attractions (same or different). However, the contrast bias of the perceived quality of an attraction may result in different experienced satisfaction levels between attractions of high contrast or low contrast of quality pair at the satisfaction level.
Flow of experiment
We obtained 16 screenshots of 16 different tourism destinations/attractions in the VE. The participants were instructed to look at the printed pictures together, and rate them based on the three dimensions of their satisfaction, namely, cultural, natural and entertainment. The participants were then asked to answer their overall subjective assessment of the place. The ratings were all made on a 7-point Likert scale, with scores ranging from 1 (least satisfied) to 7 (most satisfied).
Obtain the tourist original satisfaction assessment
Analyze the type and quality of the destinations/attractions to determine whether visiting one after another would be under a high contrast of type frame or a positive/negative contrast of quality frame
Compare them with the actual satisfaction assessment under a different frame and bias in the formal session
Data were processed in SPSS by cluster analysis. The semantic distance between each two of the 16 destinations/attractions was calculated based on their average score on the three dimensions (natural, cultural, and entertainment). Next, we defined the destination pairs as “high contrast of type” or “low contrast of type” when the semantic distances between them were significantly large or low, respectively. The average ratings of the assessment of tourists of destinations were also calculated. We defined the destination pairs with significantly different ratings as “high contrast of quality” and others as “low contrast of quality”. In addition, if the better destination was visited before the worse one, the rating of the latter was marked as “negative contrast of quality”. If the better destination was visited after the worse one, the former was marked as “positive contrast of quality”.
Experiment 1: frame and bias at the expectation level
Description of the artificial attractions for experiment at the expectation level
Brief descriptions of the attractions
A garden with various types of herbs and a lake
A mountain during winter with a beautiful snow view
A store in a shopping mall with different brands of shoes
Introductions about four different attractions with pictures and text were individually given to the participants.
Once the participants were given the introduction about one attraction, they were given 1 to 2 minutes to read and to imagine their travel experience at the place. They were asked to rate their expected satisfaction (subjective utility) with the attraction.
Once all four attractions were rated, the participants were asked to rate the overall expected satisfaction (subjective utility).
Finally, the participants were asked to rate their willingness to recommend the whole trip to their friends or family.
Based on the result from the pre-experiment session and the visiting sequence in Experiment 1, we can define the scores that each destination/attraction obtains from the tourists as “high contrast of type” or “low contrast of type”, and “negative contrast of quality” or “positive contrast of quality”.
Experiment 2: frame and bias at the experience level
Description of the artificial attractions for the experience level experiment
Brief descriptions of the attractions
An art gallery filled with paintings and abstract illustrations; Participants can “walk around” and enjoy the art displayed in the gallery
A high-rise mountain where participants can climb and enjoy the view along the way
A park with several shops and cable cars
Seaside where the participants can enjoy a spectacular sunset view
The participants were asked to tour in the VE.
Once the participants arrived at an attraction, they had 2 to 3 minutes to walk around the attraction and to rate their satisfaction (subjective utility) of the attraction.
Once all four attractions have been rated, the participants were asked to rate the overall satisfaction (subjective utility) of the trip.
Finally, the participants were asked to rate how much they were willing to recommend the whole trip to their friends or family.
Experiment and results
We invited 39 students from the University of Tokyo to participate in the experiment including pre-and after- experiment session. Out of the 39 students, 30 were Mainland Chinese (76.9%), 3 were Taiwanese (7.7%), 4 were Indonesians (10.3%), and 2 were Japanese (5.1%). The participants included 24 males (61.5%) and 15 females (38.5%). Their ages ranged from 20 to 30 (92.3%) years, and only 3 participants were over the age of 30 (7.7%). The experiments were conducted in 6 parts and lasted from 40 to 50 minutes. The participants were asked to participate in the survey to evaluate their satisfaction (subjective utility) as tourists in the virtual tourist attractions. They were paid 1500 yen for their participation. We also asked them to state their personal preferences about the different characteristics of tourism. Most participants reported frequent previous travel experience. For example, 17 out of the 39 participants said that they are very experienced travelers, in or out of Japan (43.6%), while 18 (46.2%) said that they frequently traveled in Japan. The remaining 4 (10.4%) reported that they were not frequent travelers.
Having four destinations/attractions in each experiment resulted in a 4 × 3 × 2 combination, which generated 24 different possibilities of visiting or reviewing sequence in the experiments at both levels. Each participant was assigned to one of the sequences at each level, and each sequence was followed by at least one participant. The participants finished the experiment in 30 to 40 minutes.
Analysis method and notations
In this study, the contrast bias was confirmed by comparing the satisfaction levels of two attractions that were successively visited. The following two distinctions of successive attractions were considered in the data analysis. However, the attractions at the beginning of visiting sequences were not considered in this analysis because they had no previous attractions.
During the pre-experiment examination, we explored the original preference of the participants and their ratings about the tourism destinations they visited in the formal test. We calculated the semantic distance of the virtual destinations based on their ratings on each characteristic, and grouped them based on their proximity to one another.
Based on the distance between a pair of destinations, we defined Everest-lake, beach-waterfall as the same type of destination/attraction; and shop-Everest, shop-lake, waterfall-gallery, park-gallery, and beach-gallery as different types of destinations/attractions. In the experiments, if the two destinations/attractions that the participants successively visited were of the same type, the rating of the latter was marked as “low contrast of type”. If the successfully visited destinations/ attractions were different, the latter rating was marked as “high contrast of type”. We also defined those destination pairs with significantly different ratings as “high contrast of quality” and others as “low contrast of quality”. In addition, if the better destination was previously visited before the worse one, the rating of the latter was marked as “negative contrast of quality”. If the better destination was visited after the worse one, the former was marked as “positive contrast of quality”.
Contrast bias at the expectation level
The following figures present the results obtained from statistical processing (error bar: 5% of the total scale).
For the contrast bias of quality, the effect on satisfaction is not very significant at the expectation level, except for spa and shop. Based on the independent t-test, the difference is significant between negative and positive contrast for shop (t = −2.575, p < 0.05) and spa (t=−3.617, p<0.01).
Contrast bias at the experience level
For the contrast bias of type on information learning at the experience level, the tourists reported high learning about the destination/attraction after they recently visited a different attraction more than after visiting a similar one. The independent t-test showed the difference is significant between high and low contrast for waterfalls (t=1.79, p<0.05) and beach (t=3.01, p<0.01).
The ability of the data obtained from the VE to reflect the tourist satisfaction assessment in the real world is another key issue in validating the result of the experiment. In the experiment, the participants were requested to evaluate the similarity of their decision/evaluation processes with those they would make in their actual travels. The results are as follows: The average score was 5.35 (SD=1.317) with the minimum score of 3 and the maximum of 7 on the 1 to 7 scale (with 1 indicating “fundamentally different” and 7 indicating “no differences at all”).
The difference between participants’ decision-making in the VE and in reality is marginal and not fundamental.
The experiment participants are students mainly from Mainland China. Therefore, the results can be bias based on nationality factors.
Although in our experiment we confirmed the ability of the data obtained from the VE to reflect the tourist satisfaction assessment in the real world, since the sample is not large, it is not sufficient to prove directly our findings or to validate fully the methodology of using VEs as a platform to study the assessment of tourists of their experience. We propose to perform a small-scale real-world experiment in the future.
The present study applied VEs and participatory simulation to examine the contrast bias in tourist decision-making and assessment. The results of the experiment support our hypothesis that the sequence of visiting, which results in different formation of tourist experience, significantly affects the judgment of tourists on the expected or experienced satisfaction. The results agree with some evidence from real world statistical data.
Generally, the contrast bias at the experience level is more apparent than at the expectation level. Moreover, the contrast bias of the perceived quality is more significant than the contrast bias of types at both levels. In previous studies in marketing, neither the expectation vs. experience level nor the contrast bias of perceived quality vs. contrast bias of types has been distinguished, and consumer products rather than tourism services have been considered. This result implies that the sequence of information on attractions provided to tourists influences their expected satisfaction and the organization of the actual trip affects their experience satisfaction with each destination/attraction.
This result will further assist tourism service providers in their decisions regarding marketing and pricing strategy. These providers can then compete well with others, obtain a competitive stance and establish a distinct “brand”. However, changes in the perceived variety seem to have minimal influence on the total satisfaction. This finding suggests that when the service provider intends to promote its tourism products (e.g., guided tour), adding various attractions or destinations alone, which comprise the whole trip cannot ensure increased satisfaction with the entire trip. Moreover, the quality of each attraction should be monitored.
This work showed that participatory simulation through VEs is a promising approach for studying tourist ratings on destinations or attractions. In the future, VE platforms, such as OpenSimulator, should be further utilized for the development of interactive experimental tools to study the assessment of tourists of their experience.
- Ariely D, Zauberman G: On the making of an experience: the E ects of breaking and combining experiences on their overall evaluation. J Behav Decis Mak 2000, 232: 219-232.View ArticleGoogle Scholar
- Bosque IR, Martín HS: Tourist satisfaction a cognitive-affective model. Ann Tour Res 2008, 35: 551-573. 10.1016/j.annals.2008.02.006 10.1016/j.annals.2008.02.006View ArticleGoogle Scholar
- Chernev A: Product assortment and consumer choice: an interdisciplinary review. Found Trends® Mark 2011, 6: 1-61. doi: 10.1561/1700000030View ArticleGoogle Scholar
- Diener E: Subjective well-being. The science of happiness and a proposal for a national index. Am Psychol 2000, 55: 34-43.View ArticleGoogle Scholar
- Fishwick P, Henderson J: Simulating culture: an experiment using a multi-user virtual environment. In Proc 2008 winter simul conf. : ; 2008:786-794.View ArticleGoogle Scholar
- Frederick S, Loewenstein G: Hedonic adaptation. In Wellbeing found hedonic psychol. Edited by: Kahneman D, Diener E, Schwarz N. New York: Russell Sage Foundation; 1999:302-329.Google Scholar
- Gretzel U: Intelligent systems in tourism. Ann Tour Res 2011, 38: 757-779. 10.1016/j.annals.2011.04.014 10.1016/j.annals.2011.04.014View ArticleGoogle Scholar
- Herr PM, Sherman SJ, Fazio RH: On the consequences of priming: assimilation and contrast effects. J Exp Soc Psychol 1983, 19: 323-340. 10.1016/0022-1031(83)90026-4 10.1016/0022-1031(83)90026-4View ArticleGoogle Scholar
- Jang H, Lee S, Lee S-W, Hong S: Expanding the individual choice-sets model to couples’ honeymoon destination selection process. Tour Manag 2007, 28: 1299-1314. 10.1016/j.tourman.2006.11.008 10.1016/j.tourman.2006.11.008View ArticleGoogle Scholar
- Johnson PA, Sieber RE: Negotiating constraints to the adoption of agent-based modeling in tourism planning. Environ Plan B Plan Des 2011, 38: 307-321. doi: 10.1068/b36109 10.1068/b36109View ArticleGoogle Scholar
- Kahn BE, Wansink B: The influence of assortment structure on perceived variety and consumption quantities. J Consum Res 2004, 30: 519-533. 10.1086/380286 10.1086/380286View ArticleGoogle Scholar
- Kahneman D: Experienced utility and objective happiness: a moment-based approach, Chapter 37. In Choices, Values and Frames. Edited by: Kahneman D, Tversky A. New York: Cambridge University Press and the Russell Sage Foundation; 2000a:673-692. 2000Google Scholar
- Kahneman D: Evaluation by moments: past and future, Chapter 38. In Choices, Values and Frames. Edited by: Kahneman D, Tversky A. New York: Cambridge University Press and the Russell Sage Foundation; 2000b:693-708.Google Scholar
- Kahneman D, Tversky A: Prospect theory: an analysis of decision under risk. Econom J Econom Soc 1979, 47: 263-292.Google Scholar
- Kemperman ADAM, Borgers AWJ, Oppewal H, Timmermans HJP: Consumer choice of theme parks: a conjoint choice model of seasonality effects and variety seeking behavior. Leis Sci 2000, 22: 1-18. doi: 10.1080/014904000272920 10.1080/014904000272920View ArticleGoogle Scholar
- Koutsabasis P, Vosinakis S, Malisova K, Paparounas N: On the value of virtual worlds for collaborative design. Des Stud 2012, 33: 357-390. 10.1016/j.destud.2011.11.004 10.1016/j.destud.2011.11.004View ArticleGoogle Scholar
- Kozak M: Repeaters’ behavior at two distinct destinations. Ann Tour Res 2001, 28: 784-807. 10.1016/S0160-7383(00)00078-5View ArticleGoogle Scholar
- Lancaster K: A new approach to consumer theory. J Polit Econ 1966, 74: 132-157. 10.1086/259131View ArticleGoogle Scholar
- Lindakellie http://zadaroo.com/
- Lyubomirsky S: Pursuing happiness: the architecture of sustainable change. Rev Gen Psychol 2005, 9(2):111-131.View ArticleGoogle Scholar
- Moschini E: The second life researcher toolkit – an exploration of inworld tools, methods and approaches for researching educational projects in second life. In Res learn virtual worlds SE - 3. Edited by: Peachey A, Gillen J, Livingstone D, Smith-Robbins S. London: Springer; 2010:31-51. LA – EnglishView ArticleGoogle Scholar
- Myers DG, Diener E: The pursuit of happiness. Sci Am 1996, 274: 70-72.View ArticleGoogle Scholar
- Oh J-S, Kim H, Jayakrishnan R: Tourist activity simulation model for assessing real-time tour information systems. J Intell Transp Syst 2012, 16: 118-131. 10.1080/15472450.2012.688388 10.1080/15472450.2012.688388View ArticleGoogle Scholar
- OpenSimulator http://opensimulator.org/
- Osti L, Disegna M, Brida JG: Repeat visits and intentions to revisit a sporting event and its nearby destinations. J Vacat Mark 2012, 18: 31-42. 10.1177/1356766711428803 10.1177/1356766711428803View ArticleGoogle Scholar
- Rebelo F, Noriega P, Duarte E, Soares M: Using virtual reality to assess user experience. Hum Factors J Hum Factors Ergon Soc 2012. 10.1177/0018720812465006Google Scholar
- Redden JP, Haws KL: Healthy satiation: the role of decreasing desire in effective self-control. J Consum Res 2012, 39: 000-000. 10.1086/667362Google Scholar
- Seddighi HR, Theocharous AL: A model of tourism destination choice: a theoretical and empirical analysis. Tour Manag 2002, 23: 475-487. doi: 10.1016/S0261-5177(02)00012-2 10.1016/S0261-5177(02)00012-2View ArticleGoogle Scholar
- Sheehy K: Virtual environments: issues and opportunities for researching inclusive educational practices. In Res learn virtual worlds SE - 1. Edited by: Peachey A, Gillen J, Livingstone D, Smith-Robbins S. London: Springer; 2010:1-15. LA – EnglishView ArticleGoogle Scholar
- Tussyadiah IP: A model of multidestination travel: implications for marketing strategies. J Travel Res 2006, 44: 407-417. 10.1177/0047287505282950 10.1177/0047287505282950View ArticleGoogle Scholar
- Wu C-L, Carson D: Spatial and temporal tourist dispersal analysis in multiple destination travel. J Travel Res 2008, 46: 311-317. 10.1177/0047287506304046 10.1177/0047287506304046View ArticleGoogle Scholar
- Yang O, Hui-Min G, Ryan C: Itinerary planning and structured travel—preferences by outbound Chinese holidaymakers. Anatolia 2009, 20(1):119-133. 10.1080/13032917.2009.10518899View ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.