Comparisons of interdisciplinary ballast water treatment systems and operational experiences from ships
© Bakalar. 2016
Received: 20 July 2015
Accepted: 18 February 2016
Published: 29 February 2016
There are high functioning and low functioning ballast water treatment systems on board ships. In this study, five systems were analysed so as to methodically examine the operational difficulties for ship crew members while giving important consideration to sustainable environment practices. Multi-criteria analysis, a questionnaire, survey and interviews were used as the research method so as to ascertain and corroborate existing problems on board ships, and the reliability of the systems was calculated. The co-insistency, maintenance and the efficiency of the systems, were shown as being the major problem as there are no systems for tracking ship ballast operations from land. The treatment system that used oxidants was, through multi criteria analysis, evaluated as being the best and was ranked first. However, the survey results showed that the ship’s crew had serious problems with this system which difficult to solve during the ship’s operations with cargo. The deoxygenation system was the most appropriate according to ballast water treatment criteria in the port or at sea. The treatment system which used electrolysis with oxidant was better in terms of efficacy and the treatment system electrolysis with ultra violet light was better in terms of the criterion environment pollution footprint. During further research, it was shown that 7 % of the surveyed crew members had major problems with operating ballast water treatment systems, including the system which was ranked first through multi criteria analysis. They by-passed these systems while continuing to ballast or de-ballast. It was calculated that of the total time needed for the ballast water treatment system operation, 9 % of this time was used for repairs or maintenance of the systems. Some examples are changing a used UV bulb, cleaning the filter or controlling the amount of oxidant which would be discharged into the sea. A conclusion was made and solution was suggested. The study results emphasised taking action in the interest of protecting the natural world, with particular attention being given to environmental protection to support human life.
KeywordsBallast water treatment Multi-criteria analysis Operational experience Comparison
When large ships offload their cargo, they flood ballast tanks with seawater for stability on the return trip. Ballast water is widely used on ships to ensure manoeuvrability and stability when cargoes are unloaded (La Carbona et al. 2010). Without proper ballast, the ship’s centre of gravity is too high and can result in their capsizing. At the cargo loading port, the ballast water is pumped into the harbour in order to load more cargo. When ballast water is pumped overboard it may carry with it aquatic nuisance species that can seriously harm indigenous species in ports and coastal waters. These nuisance species may include unwanted bacteria such as Escherichia coli or Vibrio cholerae and animals such as zebra mussels. In addition, the ballast tanks are often contaminated with invasive species of animals, plants, and bacteria from the previous port. The BWMC (Ballast Water Management Convention) 2004 protects the sea environment through regulations regarding future ballast water treatment. Regulations and standards established by the IMO (International Maritime Organization) require treatment limits to be met independently and calls for vessels to carry out monitoring themselves (Albert et al. 2013). Ballast water will have to be treated once this convention comes into effect (Gregg et al. 2009).
Many technologies have been developed for ballast water treatment and fall into two broad categories: in-line and in-tank. In-line systems operate so that water is pumped from the sea to the ballast tanks routed through a processing system which kills organisms before they reach the ballast tank. In-tank systems kill the organisms after the ballast tanks are filled with seawater from the port. These are reasonably considered batch process systems. These systems treat water in the ballast tanks rather than during intake or discharge. Treatment of the ballast water can occur en route between ballast water operations and this is the principal advantage of in-tank systems. Different technologies have been suggested for ballast water treatment, such as disinfection with chlorine (Simpson 2001), injecting chemicals (La Carbona et al. 2010), adding biocides to ballast water for the neutralisation of harmful microorganisms (Chelossi and Faimali 2006), sterilisation with ozone (Perrins et al. 2006), filtration with UV (ultraviolet) light (Sutherland et al. 2013), exposure to electrochemical charge or electro-ionization (Aliotta et al. 2001), exposure to heat (Mountfort et al. 2001), and sonication (Gavand et al. 2007). Some suggested systems use acids, while others sterilisation with hydrogen peroxide (Smit et al. 2008). The deoxygenation system (Browning 2001) kills organisms in the ballast tanks by creating a water environment (inert gas + CO2) which is low in oxygen, higher than normal in CO2, and with a lower than normal seawater pH. Some systems employ multiple methods to increase effectiveness. The 2 × filtration + peracetic acid system utilises the method of passing the ballast water through the filters and adding peracetic acid. The filtration + electrolysis + ultraviolet light system provides the method of killing plants, bacteria and animals passing the ballast water through the filter and exposing them to electrolysis and ultraviolet light (Sutherland et al. 2013). The electrolysis system conducts sterilisation passing the ballast water through the filter with electrolysis (Rigby and Taylor 2001). The filtration with electrolysis, electrochlorination and waste control system uses the electrolysis method, injecting chlorine to induct a electrochemical reaction and removing the waste depending on the water quality. For this system, current density is an important parameter effecting the production of total residual chlorine in ballast or brackish water. Low current densities can avoid the production of harmful chlorine species (Lacasa et al. 2013).
A complete listing of the companies, country of origin, type of treatment, current status of testing and comments are available (Lloyd’s 2014). Numerous BWTS (Ballast Water Treatment Systems) have been type approved by flag administrations to meet the requirements of the IMO ballast water convention (Lloyd’s 2014; EPA Environmental Protection Agency 2011). At the moment, many ships are already equipped with ballast water treatment systems. Not all of them have treatment systems with optimal operational performances. When shipping company owners plan to buy ballast water treatment systems, they can choose between similar treatment systems with regard to the needs of their fleet. Since there is no automatic performance control to alert port authorities, they can choose cheaper and smaller systems with lower treatment costs when considering the load rate of ballast water in m3/h.
The objective of this study is to assess the performance of various ballast water treatment systems from the point of view of ship crew members. Real, first-hand experience can verify the impact that individuals can have on the environment. The aim of this research is to reduce the negative impact that ship operations have on the environment. The overall aim of the study is to develop processes that will lead to complete environmental sustainability in the future.
The materials used in this research were different ballast water treatment systems and their operational processes. Methods used in this research were multi-criteria analysis, a questionnaire, survey and reliability study.
The predominant methods of killing plants, bacteria and animals in ballast water treatment systems require passing the ballast water through filters (Matheickal et al. 2001). Filters in the systems, the maintenance of the UV generator and efficacy were imperative for this research. Efficacy means whether the system performance met the IMO guidelines of not discharging the prescribed quantities of living phytoplankton, zooplankton, microbial organisms and residue of used oxidant into the water.
In PROMETHEE II complete ranking, the ranking criteria flow in opposite directions because of the different views which are not touching each other (that is presenting incomparable and different criteria which uses different measures: e.g. economic, environmental, and social); this means that:
The PROMETHEE II method was particularly well-fitted to this research as it could make decisions from incomparable criteria. PROMETHEE II has been used with success to solve many problems (Behzadian et al. 2009). It was suggested that the PROMETHEE II method be used in this paper since this method is based on partial aggregation and possible decisions are compared to each other in pairs and ranked. It was then possible to select the best decision. Possible decisions (solutions) in this research were different ballast water treatment systems with common criteria (parameters) as alternative criteria was not set as an option. Compared to the well-established ELECTRE decision making method (also based on partial aggregation), the PROMETHEE II method was easier to use and able to get more robust results (Al-Shemmeria et al. 1997; Thaillandier and Stinckwich 2011).
2 × filtration + peracetic acid.
Filtration + electrolysis + UV generator.
Filtration + electrolysis + electrochlorination + waste control.
Electrolysis + oxidant.
Parameters data (Lloyd’s 2014)
Ballast water treatment system
Environment pollution footprint 200/2000 m3/h
G8 or G9
Treatment in port or on the sea during the voyage
Number of methods
2 × filtration + peracetic acid
Filtration + electrolysis + UV
Filtration + electrolysis + electrochlorination + waste control
Electrolysis + oxidant
Environmental pollution in this research refers to the introduction of contaminants into the natural environment that could cause adverse change. The ecological footprint used for this criterion parameter was ascertained by measuring the ballast water treatment system operation demand on the Earth’s ecosystems, i.e. the amount of natural resource capital used per annum. Efficacy was a testing score parameter, i.e. data collected from the test performance results of ballast water treatment systems recorded via the United States Marine Invasive Species Program (Dobroski et al. 2007). Whether a ballast water treatment system belongs to the G8 or G9 group depends on the test results. Tests were done during the certification process. The Ballast Water Management Convention (BWMC) and the Guidelines for approval of ballast water management systems—G8 must be taken into consideration for the approval of a ballast water management system. If a certain ballast water technology uses an active substance, then, to comply with the Convention, it should be approved by the IMO in accordance with the Procedure for approval of ballast water management systems that make use of Active Substances—G9, adopted by the MEPC (Marine Environment Protection Committee) in session 53 (MEPC 2005; Tsolaki and Diamadopulos 2010). The degree of environmental friendliness of a particular ballast system determines whether it belongs to the G8 or G9 group parameter weighting. The G8 or G9 classification treatment systems and efficacy parameters are the most significant for ports and port ecology. The system that uses peracetic acid will arouse the attention of port staff more as this substance belongs to the G9 group. The number of treatment methods and whether treatment is done in the port or during the voyage is an important parameter from the ship crew members’ the point of view. Some systems employ multiple methods to increase effectiveness and some systems use just one method. If a certain ballast water technology uses one treatment method, then, it should be easier to maintain the system. If the system neutralizes the ballast water while the ship is in motion, crewmembers have more time to rest and to go ashore and visit the port during cargo operations. All these criteria parameters were weighted as per the research results collected in Table 1.
Environment pollution 20 %.
Efficacy 35 %.
Belonging to the group G8 or G9 20 %.
Treatment in the port or on the sea—during the voyage 15 %.
Number of the treatment methods 10 %.
Weighting of criteria is subjective and has a direct influence on the results of prioritizing strategy options. It is therefore critical that criteria weights are determined rationally and truthfully (Mutikanga et al. 2011). Efficacy was the most important criterion. Efficacy is the reason BWTS exist as it shows the amount of quality in terms of treating ballast water. This criterion was given a weighting of 35 % for ranking. The two next most important criteria were ecological: environment pollution and belonging to the group G8 or G9 and were given a ranking weight of 20 % each. The remaining 25 % was given to the two remaining criteria. As the most important criterion to the ship’s crew is treatment in port or at sea, it was given 15 %, while the number of methods of a particular BWTS was given the remaining 10 %.
Survey of experiences from ships
The objective of this survey was to ascertain difficulties regarding the operational process of ballast water treatment systems. This was based on ship crew members’ operational experience and their personal opinion. The survey raises considerable doubts as to the reliability of quick answers to research questions, whether of a quantitative or qualitative nature (Charmaz 1995). The aim was to collect qualitative information to meet the objectives of the research. A simple exploratory questionnaire was created with four questions. A questionnaire is a research instrument and basic scientific method whose purpose is to gather information from respondents. The discovery of reflexive progression in interviewing is very important for research (Miller and Glassner 1997). This study provides survey findings from a sample of 68 experienced ship captains and bridge officers, 51 of whom attended maritime courses and 18 from the maritime crewing agency. These courses were taught in Split, Sibenik and Rijeka, Croatia, at the Maritime School, and the students were interviewed in the period from 20/12/2014 to 1/3/2015. Interviews were carried out after the survey research data was collected. An on-board experience questionnaire was done for this research and a summary of the survey results are given and explained further in this paper.
The questionnaire was made up of the following:
- 1.How many years have you worked on board ships?
more than five years.
- 2.I work on ships as a:
- 3.There is a ballast water treatment system installed on the ship that I work on:
- 4.There were some functional problems while the ballast water treatment system was in operation:
The reliability and availability of the systems
Malfunction of the ballast water treatment systems on board ships is a criterion that has never been reported or included in any research, but could prove to be the most important factor in ballast water treatment system performance. Performance reliability of certain ballast water treatment systems on board ships have indicators which should be observed, followed and analysed over a longer period of system exploitation. Reliability is the ability of the system for operational work without interruption (Pham 2000). Predictions of potential failures caused by software or hardware errors, as well as potential failures in mechanical part performance, can only be predicted once findings from the experience in handling technologically-similar systems on board ships are found. External factors on ships are one of the most important factors, because the dynamics of movements are constantly under external influences. Likewise, operator reliability and exposure to high temperatures are also very important in assessing the reliability of the proposed system (Siewiorek and Swarz 1982).
Redundancy is a characteristic of the quality of the computing system that ensures failure avoidance when one part of the system fails. This is generally ensured through the use of additional software, through the reliability of the two redundant systems working in parallel and with a known malfunction index for these types of devices in predefined ship conditions.
It can be assumed that the computing part of the subsystem in the system with two parallel subsystems, one of which is redundant, will be regularly maintained by the operator and through the self-diagnosis function for error removal. In this way, the possibility of malfunction of some ballast water treatment systems on board ships is reduced.
Results and discussion
Multi-criteria analysis of the systems
The criteria parameters contribution to the solutions is shown in five different colours on the figure. The treatment system of electrolysis + oxidant technology was highly successful in this computational analysis with a percentile of 68.1 %. The value of the criteria parameter environmental pollution for the BWTS filtration with electrolysis and UV, was the most important criterion for ranking second with a percentile of 47.5 %. The system 2 × filtration with peracetic acid technology was ranked third with a percentile of 46.25 %. Crucial to its coming in third place was the high quality of its efficacy value, as well as environmental pollution, in terms of criteria parameters. As one of the analysis criteria was the treatment of ballast water in the port or at sea, the deoxygenation system received a percentile of 45 % as it is the only ballast water treatment system which can be used while at sea. The system which was ranked last was the filtration + electrolysis + electrochlorination + waste control system. It can be confirmed that this system has a high value in terms of the efficacy criteria parameter. However, because of its high environmental pollution footprint, as well as the highest number of treatment methods, received a percentile of 43.1 % and was ranked fifth in this multi criteria analysis.
Results of the survey
Three students from the courses (out of the 51 surveyed) responded to questions 3, 4 and 5 of the questionnaire affirmatively. In the maritime crewing agency, two experienced officers responded affirmatively to questions 3, 4 and 5. Of the 5 ship captains who were surveyed and during the interview confirmed that they had problems with the operating of the BWTS, one of the surveyed captains worked on a ship with an installed BWTS using the treatment method of electrolysis and oxidant.
BWTS on board
No BWTS on board
Total sample surveyed
Total % with operational problems (%)
Surveyed Crew members attending courses
Surveyed Crew members in the agency for employment
The reliability and availability of the systems
As such, the reliability of this subsystem has been proven according to the analysis of the results of the reliability of the computing system, which is a subsystem of a ballast water treatment system on board ships. The computing subsystem reliability with the possible use of the redundant software is 0.916 or 91.6 %.
This paper reviews ballast water treatment systems in three parts regarding data and methods: multi-criteria analysis, survey on real experience, reliability and availability study. According to the multi-criteria analysis results, the electrolysis + oxidant technology treatment system had a high success rate of 68.1 %. Many aspects were relevant and important. The electrolysis management system that uses oxidants was the most appropriate system from an ecological standpoint, while determining the quality of the treated ballast water was the most acceptable from an environmental point of view. The multi-criteria analysis parameters and scenarios did not consider the functional and operational problems of the systems. It can be clearly concluded from the survey result of 7.3 % from all participants and interviews that ship officers by-pass ballast water treatment systems due to lack of time for rectifying malfunctions, failures, maintenance or spare parts replacement in ballast water treatment systems. The survey results indicate that ballast water treatment systems can become faulty and shut down when operation sensors indicate improper function of the sub-systems. Even the system which utilises oxidant, which was successful in the multi criteria analysis, was shown to have many problems regarding controlling oxidants. This implies an unclear future for port environment protection management, where the ballast water is pumped into the harbour in order to load cargo. The research in this paper aids in understanding how important it is to learn more about ballast water treatment system experiences from crewmembers, since the survey of operational experiences from ships has proven that more time would be needed for the maintenance of ballast water management systems. The total calculated reliability of the entire computing subsystem as part of a particular ballast water treatment system on board ships which consists of the two units of which one is software redundant, was 0.916 or 91.6 %. This means that for 8.4 % of the operational time, any of the mentioned systems could be in failure or under repair. This is a significant risk for the operation of ballast water treatment systems. The results of this research are a warning to relevant stakeholders in the maritime industry. If the system does not operate well, or not at all, the price of treatment is higher, as is air and water pollution, and the active substances used, e.g. oxidant residue, become unmanageable and out of control. Environmental hazards need to be managed. One possibility would be a mechanism to monitor ballast water systems operation continually on board ships. A check-up system should be close as possible to real time. Sensors should report malfunctions to the port authorities immediately after any questionable or doubtful performance of ballast water treatment system occur.
I thank the participants of the research survey who provided important data while questioned, surveyed and interviewed by myself. This research did not receive any specific grant from any organization or funding agency in the public, commercial or not-for-profit sector.
The author has no financial interest in any company that makes a product of any method or technology discussed in this article. The author declares no conflict or competing interests, and no financial nor non-financial interests.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
- Albert RJ, Lishman JM, Saxena JR (2013) Ballast water regulations and the move toward concentration-based numeric discharge limits. Ecol Appl 23(2):289–300View ArticleGoogle Scholar
- Aliotta J, Rogerson A, Campbell CB, Yonge M (2001) Ballast water treatment by electro-ionization. In: 1st International ballast water treatment R&D symposium. Proceedings, pp 61–69. http://globallast.imo.org/wp-content/uploads/2014/11/Mono5.pdf. Accessed 10 Jan 2016
- Al-Shemmeria T, Al-Klouba B, Pearman A (1997) Model choice in multicriteria decision aid. Eur J Oper Res 97(3):550–560View ArticleGoogle Scholar
- Bakalar G (2013) Automatic control system for ship ballast water treatment by using flow cytometry and satellite communications technologies. Dissertation. Rijeka University CroatiaGoogle Scholar
- Bakalar G (2014) Review of interdisciplinary devices for detecting the quality of ship ballast water. SpringerPlus 1(3):468. doi:https://doi.org/10.1186/2193-1801-3-468 View ArticleGoogle Scholar
- Behzadian M, Kazemzadeh R, Albadvi A, Aghdasi M (2009) PROMETHEE: a comprehensive literature review on methodologies and applications. Eur J Oper Res 200(1):198–215View ArticleGoogle Scholar
- Browning WJ Jr, Browning WJ III (2001) Ballast water treatment by de-oxygenation-the AquaHabiStat system. In: 1st International ballast water treatment R&D symposium. Proceedings, pp 51–60. http://globallast.imo.org/wp-content/uploads/2014/11/Mono5.pdf. Accessed 10 Jan 2016
- Charmaz K (1995) Between positivism and postmodernism: implications for methods. Stud Symb Interact 17:43–72Google Scholar
- Chelossi E, Faimali M (2006) Comparative assessment of antimicrobial efficacy of new potential biocides for treatment of cooling and ballast waters. Sci Total Environ 356:1–10View ArticleGoogle Scholar
- Dobroski N, Takata L, Scianni C, Falkner M (2007) Assessment of the efficacy, availability and environmental impacts of ballast water treatment systems for use in California waters. California State Lands Commission Marine Facilities DivisionGoogle Scholar
- EPA Environmental Protection Agency (EPA) (2011) Efficacy of ballast water treatment systems: a report by the EPA science advisory board. http://www.EPA-SAB-11-009-unsigned.pdf. Accessed 10 Jan 2016
- Gavand MR, McClintock BM, Amsler CD, Peters RW, Angus RA (2007) Effects of sonication and advanced chemical oxidants on the unicellular green alga Dunaliella tertiolecta and cysts, larvae and adults of the brine shrimp Artemia salina: a prospective treatment to eradicate invasive organisms from ballast water. Mar Pollut Bull 54(11):1777–1778View ArticleGoogle Scholar
- Gregg M, Rigby G, Hallegraeff GM (2009) Review of two decades of progress in the development of management options for reducing or eradicating phytoplankton, zooplankton and bacteria in ship’s ballast water. Aquat Inv 4(3):521–565View ArticleGoogle Scholar
- Hajkowicz S, Collins K (2007) A review of multiple criteria analysis for water resource planning and management. Water Resour Manag 21(9):1553–1566View ArticleGoogle Scholar
- La Carbona S, Viitasalo-Frösen S, Masson D, Sassi J, Pineau S, Lehtiniemi M, Corroler D (2010) Efficacy and environmental acceptability of two ballast water treatment chemicals and an alkylamine based-biocide. Sci Total Environ 409(2):247–255View ArticleGoogle Scholar
- Lacasa E, Tsolaki E, Sbkou Z, Rodrigo MA, Mantzavinos D, Diamandopoulos E (2013) Electrochemical disinfection of simulated ballast water on conductive diamond electrodes. Chem Eng J 223:516–523View ArticleGoogle Scholar
- Lloyd’s (2014) Ballast water treatment technology—current status. http://www.lr.org/en/_images/213-35824_Understanding_Ballast_Water_Management_0314_tcm155-248816.pdf, 2014. Accessed 15 Jan 2016
- Lovric J (1989) Basics of ship’s terotechnology. Dubrovnik Maritime Faculty Croatia 44–57.http://www.unidu.hr/datoteke/172izb/osnove_brodske_terotehnologije_-_Josip_Lovric.pdf. Accessed 15 Jan 2016
- Matheickal JT, Waite TD, Mylvaganam ST (2001) Ballast water treatment by filtration. In: 1st International ballast water treatment R&D symposium. Proceedings, pp 7–20. http://globallast.imo.org/wp-content/uploads/2014/11/Mono5.pdf. Accessed 18 Nov 2015
- McLaughlin C, Falatko D, Danesi R, Albert R (2014) Characterizing shipboard bilgewater effluent before and after treatment. Environ Sci Pollut Res 21(8):5637–5652View ArticleGoogle Scholar
- MEPC: g/2012/Individual Guidelines for reference/G4.pdf, 2005. Accessed 12 Jan 2016Google Scholar
- Miller J, Glassner B (1997) The inside and outside funding realities in interviews. In: Silverman D (ed) Qualitative research: theory, method and practise. Sage Publications, Beverley Hills, pp 98–111Google Scholar
- Mountfort D, Dodgshun T, Taylor M (2001) Ballast water treatment by Heat—New Zealand Laboratory & Shipboard trials. In: 1st International ballast water treatment R&D symposium. Proceedings, pp 45–50. http://globallast.imo.org/wp-content/uploads/2014/11/Mono5.pdf. Accessed 14 Jan 2016
- Mutikanga HE, Sharma SK, Vairavamoorthy K (2011) Multi-criteria decision analysis: a strategic planning tool for water loss management. Water Resour Manag 25:3947–3969View ArticleGoogle Scholar
- Perrins JC, Cooper WJ, Van Leeuwen JH, Herwing RP (2006) Ozonation of seawater from different locations: formation and decay of total residual oxidant implications for ballast water treatment. Mar Pollut Bull 52:1023–1033View ArticleGoogle Scholar
- Pham H (2000) Software reliability. Springer Google Books, BerlinGoogle Scholar
- Rigby G, Taylor AH (2001) Ballast water management and treatment options. Int Marit Technol 113(3):79–99Google Scholar
- Shooman ML (2002) Reliability of computer systems and networks: fault tolerance, analysis, and design. Wiley, New YorkView ArticleGoogle Scholar
- Siewiorek DR, Swarz R (1982) The theory and practice of reliable system design. Digital Press Bedford, MaynardGoogle Scholar
- Simpson G (2001) Ballast water disinfection with ClO2. In: Proceedings of the 20th international conference on marine biology, pp 131Google Scholar
- Smit MGD, Ebbens E, Jak RG, Huijbregts MJA (2008) Time and concentration dependency in the potentially affected fraction of species: the case of hydrogen peroxide treatment of ballast water. Environ Toxicol Chem 27:746–753View ArticleGoogle Scholar
- Sutherland TF, Levings CD, Petersen S, Hesse WW (2013) Mortality of zooplankton and invertebrate larvae exposed to cyclonic pre-treatment and ultraviolet radiation. Mar Technol Soc J 37:3–12View ArticleGoogle Scholar
- Thaillandier P, Stinckwich S (2011) Using the PROMETHEE multi-criteria decision method to define new exploration strategies for rescue robots. In: IEEE international symposium on safety, security, and rescue robotics. Proceedings, pp 321–326. https://hal.archives-ouvertes.fr/hal-00688925v1. Accessed 14 Jan 2016
- Tsolaki E, Diamadopoulos E (2010) Technologies for ballast water treatment: a review. J Chem Technol Biot 85(1):19–32View ArticleGoogle Scholar
- Turban E, Rainer RK, Poter RE (2003) Introduction to information technology. Wiley, New YorkGoogle Scholar