Skip to main content

Pooled bioequivalence study database from Turkey: characterization of adverse events and determination of split points based on Gini Index as a promising method



Manufacturing of and medication with generic drugs is increasing around the world. Bioequivalence (BE) studies are being performed routinely by Contract Research Organisations (CROs) in Turkey. However, an overall evaluation for the attended volunteers, examined Active Pharmaceutical Ingredients (APIs) and the observed adverse events have not been studied in the field.


Our aim was to revisit and compile the BE studies carried out between the years 2000–2013 of a CRO (N-CRO) in Turkey.


A dataset of 261 BE studies has been created for the observed adverse events with regards to the frequency, type, and drug subgroups. As an advanced evaluation, the Gini Index method has been used in the 63 available BE studies to obtain split points for two pharmacokinetic parameters, area under the plasma/serum concentration (AUC) and maximum plasma/serum concentration (Cmax), in order to investigate their likely effect on the adverse events.


Thousand six hundred and forty two adverse events were found in the 261 BE studies involving 7828 volunteers with the frequency of 6.29 per study and 0.21 per volunteer. The most frequently observed adverse events were; headache, somnolence, nausea, dizziness and vomiting, respectively. Hundred and nine different APIs were observed. ‘Genitourinary system and sex hormones’ subgroup drugs had the highest frequency of the adverse events. Adverse event frequencies above the identified split points for Cmax and AUC values were higher than the frequencies below them.


The review of 13 years period of BE studies revealed that the demographic properties of the volunteers and the study designs were in compliance with national and international guidelines. The promising outcome could be showing the increase of the adverse event frequencies above the obtained split points as the reflection of the likely individual pharmacokinetic differences in the adverse event occurence.


Generic drugs could be seen in the market as the copies of ‘originator’ drugs short after the different kinds of commercial protections have been expired (Kopp and Badiane 2014). Manufacturing and using of generics are constantly increasing worldwide because of cost efficiency, new formulation, and different administration route possibilities. Encouragement on development of generic drug manufacturing could be assumed as innovation and investments (Kopp and Badiane 2014; OECD 2015). Generics should provide pharmaceutical quality similar to the originator drug framed by regulatory guidelines (USFDA 2003; EMA 2010). National and international health authorities stipulate that BE studies are mandatory for the registration of the generics (European Parliament 2001; Ucar 2009).

Bioavailability (BA) and BE terms started to be used in late 60s and in early 70s. In 1984, US Congress established the Drug Price Competition and Patent Term Restoration Act (Public Law 1984; Midha and McKey 2009). Under this Act, Food and Drug Administration (FDA) had a crucial role on statutory generic drug approval process. Since 2003 the BE studies in USA have been conducted according to the fundamental guide named “Bioavailability and BE Studies for Orally Administered Drug Products-General Considerations” which has been published by FDA (USFDA 2003; Midha and McKey 2009). When it comes to European Union, European Medicine Agency has revised the regulatory guideline for BE studies in the name of ‘Guideline on The Investigation of Bioequivalence’ in 2010 which was first published as ‘Investigation of Bioavailability and Bioequivalence’ in 1991 (Commission of the EC 1991; EMA 2010). In Turkey, the directive of “Investigation of Bioavailability and Bioequivalence of Pharmaceutical Preparations” has been in use in concordance with the European Union since 1994 (Investigation 1994).

Aronson and Ferner (2005) defined the adverse events as ‘any abnormal sign, symptom, laboratory test, syndromic combination of such abnormalities, untoward or unplanned occurrence (e.g. an accident or unplanned pregnancy), or any unexpected deterioration in a concurrent illness’. When the adverse event causes death, life threatens, requires inpatient hospitalization or prolongs the existing hospitalization, results in persistent or significant disability/incapacity, or is a congenital anomaly/birth defect, then it is called serious adverse event (ICH GCP 1996). If any untoward medical occurrence that at any dose: results in death, is life-threatening, requires inpatient hospitalization or prolongation of existing hospitalization, results in persistent or significant disability/incapacity, or is a congenital anomaly/birth defect, is named as serious adverse event. (ICH GCP 1996). According to the all regulatory guidelines mentioned, it is mandatory to collect and verificate the reports of adverse events/reactions in BE studies and submit them periodically to the health authorities (USFDA 2009; European Commission 2011).

Although BE studies are being frequently carried out under the well established guidelines by CROs all over the world, the authors could not find a study with regards to the overall detailed evaluation of the adverse events observed in the series of BE studies. All the available scientific publications on the drug adverse reactions were mostly focused on single BE studies, the Phase I clinical trials and marketed drug products (Lazarou et al. 1998; Sibille et al. 1998; Baker et al. 2004). Hence, the review of the adverse events of pooled BE studies could provide valuable scientific data.

Herewith, our aim was to revisit the registered BE studies of a CRO (N-CRO) in Turkey between the years 2000–2013 for an overall statistical evaluation regarding the type, frequency, drug subgroups, cut off (split points using Gini Index) values and probable causes of adverse events.


Procedure at the investigator’s site

Each BE data used in this study was carried out with the collaboration of N-CRO and Clinical Research Centers between 2000 and 2013 and conducted according to Clinical Study Protocol prepared by Clinical Research Department of N-CRO. Accordingly, N-CRO strictly complied and followed the national and international guidelines in the selection of the volunteers in terms of age and body mass index and in the BE study design. The guidelines mandate; subjects should be 18–55 years of age and preferably have a Body Mass Index (BMI) between 18.5 and 30 kg/m2 (Investigation 1994; EMA 2010). In the N-CRO, design of the BE studies were carried out as classical two periods, replicated three periods, or four periods design according to FDA (USFDA 2003). Recommendations of FDA have been followed for adequate washout period (more than five half-lives of the drug), amount of water for drug administration (240 ml), and water/food restriction/allowance of subjects (e.g. water is restricted for 1 h before and after drug administration, standard meals should be given no less than 4 h after drug administration). Each subject attended to the study signed Informed Consent Form. Information of the adverse events observed during the study was recorded to the “Adverse Event Form” or “Serious Adverse Event Form” by the investigator. The MedDRA dictionary based adverse event codification was not obligatory while the BE studies were carried out and we had used the classification methodology of investigators of Clinical Trial Centers. We acquired a written permission from N-CRO dated 26.06.2013 and numbered 165 which allows us to use database of the BE studies between the years 2000–2013. The authors had full access to the data of BE studies including the demographic data of the volunteers according to the informed consent forms those signed by each volunteer.

Dataset creation of the pooled BE studies

Dataset used in this paper included 261 BE studies with 7828 healthy subjects (i.e. volunteers). Each study had different number of subjects such as 24, 36, 48 and each subject had some features (i.e., variable) such as demographic information, existence/absence information of adverse event, types of adverse events, period (the process that starts with administration of test or reference drug and ends up with taking last biological sample) that adverse event was observed. The adverse event names were taken from the Adverse Event Forms as the investigator registered. In addition to these features, there were also two pharmacokinetic parameters named AUC and Maximum Plasma/Serum Concentration Time Curve From Zero up to the Last Quantifiable Concentration (Cmax) accessible for 63 studies done after 2005. All these features were extracted from the N-CRO Bioanalysis Laboratory Database and combined into a single data matrix. Drugs that were used in these BE studies and their subgroups that correlated to ATC were also added to the dataset. These codes were assigned based on World Health Organization Collaborating Center for Drug Statistics Methodology (WHO 2015). Preprocessing period which is essential before all the analysis was conducted in order to clean the raw data. During this essential phase, different units that belong to the same feature were converted to the same unit. Since there were no missing and duplicated values in the data set, no deletion has been carried out. Beside these, although there were extreme values detected by SPSS in the raw data, no extreme values observed after logarithmic transformation.

In the scope of this study, all analysis can be considered in twofold: statistical analysis and Gini Index approach. In the dataset, only 63 BE studies with 1992 subjects out of 261 BE studies had Cmax and AUC values with their reference and test values available. While all the demographic informations and descriptive statistical analysis has been carried out for the 261 BE studies, Gini Index calculations and other statistical analysis have been carried out with those 63 BE studies.

Statistical analysis

Besides the descriptive statistics (mean, variance, min–max values), hypothesis tests for the assumptions including normality and homogeneity of variance were performed using SPSS version 21. Kolmogorov–Smirnov test was utilized to check whether the variables Cmax (test and reference) and AUC (test and reference) follow a normal distribution at 5 % level of significance. As a result of this test, neither Cmax nor AUC distributed normally (significance level = 0.05). Since the distribution of the AUC and Cmax tend to be skewed and their variances increase with the means, log transformation was used. Therefore the variances became independent of the mean and the distributions tend to be more symmetric (Rani and Pargal 2004). All analyses were done by using logarithmically transformed Cmax and AUC values. According to experimental design, each subject takes both test and reference drugs in different periods for all studies. In order to compare these two related groups (test or reference) for each variable (Cmax or AUC), dependent t test called paired sample t-test were conducted at 5 % level of significance.

Gini Index

It should be noted that all calculations were done for both Cmax and also AUC values, but in order to save spaces only explanations related to Cmax will be given. It is aimed to obtain a split point which shows possible relationships between Cmax values and adverse event exist/not-exist knowledge. In the concept of this study, it is important to obtain a split point denoted v that divides dataset into homogenous subsets according to knowledge of “there is adverse effect” and “there is no adverse effect”. Once v is found, it is assumed that dataset is split into two homogenous, i.e. pure classes based on adverse event (exists/not exists) such that values lower than v (Cmax ≤ v) or values higher than v (Cmax > v). In order to find \(v\), Gini Index method was preferred, and used with Cmax values of 1992 subjects from 63 BE studies by combining their test and reference values. Gini Index is generally used with decision trees to calculate the impurity degrees of splitting (Hastie et al. 2001). Briefly, the method Gini Index would be used to find out a split point for any data to discriminate the outcomes below and above this split points in terms of homogeneity. Herewith the outcomes were the adverse events and the data were the AUC and Cmax.

Gini Index given in Eq. (1) should be calculated for every candidate v values which are generally original Cmax values. In our study, arithmetic mean was calculated for Cmax values of test and reference drugs for each BE study and each adverse event exists/not exists (1/0) class information was added correspondingly, then values were sorted in increasing order and candidate split positions were identified by taking the mid-points between two adjacent sorted Cmax values. For each candidate v value, the dataset was scanned once to count the number of records with Cmax lower than or higher than \(v\). The Gini Index for each candidate v was then computed and the one that gives the lowest Gini value, which indicated the best splitting position, was chosen (Hastie et al. 2001; Tan et al. 2006).

$$GINI(t) = 1 - \sum\limits_{j} {[p(j|t)]^{2} }$$

In this study, j is the index of class and it can be either adverse event exists or not exists, t is the value at the current split position, therefore p(j|t) denotes the fraction of records belonging to class j at a given split position t.

An example for the Gini Index method application to a single BE study

In order to explain the Gini Index calculation more clearly, detailed calculation steps of one of the BE studies can be given as an example. As stated earlier, there were 261 BE studies and only 63 of them had Cmax and also AUC values available. These studies were indexed from 1 to 261. BE study number 121 which included 48 volunteers was chosen as an example. BE study number 121 was an open-label, randomised, single oral dose, two-period, cross-over trial and conducted in order to assess the BE of two different tablet formulations of repaglinide 2 mg which is used as an antidiabetic. For this study, the arithmetic mean of the test and reference Cmax values were calculated for each volunteer and adverse event exists/not exists (1/0) class information was added correspondingly. After constructing a submatrix with 48 rows and two columns (one for the mean of the test and reference values, one for the adverse event class information 1 or 0) for the study 121, the subset was sorted in terms of the mean column in increasing order. To find candidate split positions, mid-points of two adjacent sorted mean Cmax values were calculated. Once the candidate split values were obtained, the Gini Index for each of them was computed using Eq. (1) given before. To get the highest information gain, the lowest Gini value should be chosen as the best splitting position. According to this rule, the lowest Gini is found at position 68.8225 for study 121. The number of adverse events which were corresponded to Cmax values lower than 68.8225 is 6 and higher than 68.8225 is 19. This process has been done for each BE study, therefore at the end of the calculations we had different split points.


Overall demographic information of subjects and design of the BE studies

The dataset consisted of 261 BE studies with 7828 volunteers who attended these studies between the years 2000 and 2013. After preprocessing and cleaning the data, 5498 volunteers with their demographic information such as age, height, weight and body mass index (BMI) were obtained. All these demographic information is summarized in the Table 1. Out of 261 BE studies 240 studies were carried out as classical two periods, one study was partial replicated three periods, one study was four periods crossover replicated one, and 19 of them were designed as four periods fasting-fed study.

Table 1 The demographic information of 5498 volunteers

APIs and drug subgroups in the pooled BE studies

In 261 BE studies, 109 different APIs were determined (Additional file 1). It was also observed that all drugs, classified as level 1 according to Anatomical Therapeutic Classification (ATC), can be divided into eight different subgroups based on the system they affected. The distribution of 261 studies according to the drug subgroups revealed that 66 studies were in the group of cardiovascular system drugs while each genito-urinary system and sex hormones subgroup, and antineoplastic and immunomodulating agent subgroup were represented with two studies (Table 2).

Table 2 Frequency of adverse events according to the drug subgroups

Adverse event classification according to the frequency, drug subgroups and type

Table 2 shows that there were 1642 adverse events (1638 adverse events and four serious adverse events) observed in the 261 studies. The frequency of the adverse events was calculated as 6.29 per study and 0.21 per volunteer (Table 2). Distribution of the adverse events was also examined in terms of the eight drug subgroups. In genito-urinary system and sex hormones subgroup 48 adverse events with the highest frequency (100 %) were found and in musculo-skeletal system drug subgroup 108 adverse events with the lowest frequency (6.8 %) were found. Thirty nine studies with 1121 volunteers were conducted for the nervous system drugs. 681 adverse events were observed. Frequency of adverse events with nervous system drugs was found as 60.8 % per volunteer (Table 2).

Following the classification of the adverse events, 104 different adverse event types were observed. According to the Table 3, the most frequently observed adverse events were headache with 32.1 %, somnolence with 15.8 %, nausea with 11.9 %, dizziness with 7.1 % and vomiting with 3.3 %, respectively (Table 3). Other adverse event types (99) had the frequency of 29.8 % (Additional file 2). Two hundred and forty out of 261 BE studies were conducted as two period design, while one of them designed as three period and 20 of them designed as four period. Thousand six hundred and twenty eight adverse events out of 1642 were seen in the period I and period II (Table 3).

Table 3 The distribution of the most frequent adverse events related to the BE study designs

In the pooled data there were four serious adverse events namely right foot fracture during entecavir BE study, laceration of achilles tendon while playing football match during tenofovir study, fall and traumatic scalp injury during quetiapine study, death in traffic accident during washout period of zafirlukast study.

Distribution of adverse events according to Cmax and AUC split points by Gini Index

The Gini Index evaluations revealed split point for each 63 BE studies in Cmax and also AUC values to display possible relationships between them and adverse event exist/not exist knowledge. As a result of the Gini Index approach, each BE study had its own split point for both Cmax and AUC, respectively. It can be generalized that split point that obtained by Gini calculation can be considered as a cut off for the frequency of the adverse events. Thus, the number of adverse events obtained below the split point is lower than the number of adverse events obtained above the split point. To avoid biased generalization, the number of subjects (volunteers) was also considered and summarized in the Table 4. The overall evaluation of the split point and related probabilities which are calculated by the number of adverse events/the number of volunteers ratio for both site (below and above) of the split point can be seen from Table 4. According to results given in this table, both numbers of adverse events and probabilities, which were obtained by considering number of subjects, supported the generalization mentioned above and given in italic font for both Cmax and AUC.

Table 4 Overall results observed above/below split points for Cmax and AUC values

Similar analyses were also done in terms of the ATC subgroups both for Cmax and AUC and the detailed results are shown in Tables 5 and 6. According to split point approach, the occurrence of the adverse events below the split point obtained by Gini Index was less probable than the occurrence of the adverse events above the split points. In order to make unbiased evaluation, probabilities were calculated for each ATC groups with respect to the number of adverse events and number of volunteers for both site of the split point obtained by Gini Index. It can be easily seen from Tables 5 and 6, most of the results obtained for ATC groups are supported our claim. In these tables, higher probability among the probabilities obtained for both sites of split point is given in italic font.

Table 5 Results observed above/below split points for Cmax values in terms of ATC subgroups
Table 6 Results observed above/below split points for AUC values in terms of ATC subgroups

Besides our generalization about split point is supported by overall results given in Table 4 for both Cmax and AUC, probabilities of the drugs from cardiovascular system, alimentary tract and metabolism, nervous system and genito-urinary system and sex hormones are also obtained above the split point as seen in Tables 5 and 6 and these results also support our generalization. Thus, corresponding split points can be used as the reference values for the future BE studies.

Among 261 BE studies only 63 studies with 1992 volunteers were available with the adverse event data of both test and reference drugs. Accordingly, 352 adverse events were observed after administration of reference drugs and 352 adverse events were seen after administration of test drugs.


Current study could be briefly described as the pooled analysis of BE studies with regards to the adverse events. Although the BE studies are widely being conducted all over the world, a research on overall adverse event specific evaluations were not found. Research on the adverse reactions as a post-marketing safety survelliance often takes place in the scientific literature (Lazarou et al. 1998; Sibille et al. 1998; Baker et al. 2004) while BE studies were mostly focused on the pharmacokinetics, assessing the relationship between genetic polymorphisms, and safety issues of the single test (generic) and reference (originator) drugs (Zhang et al. 2006; Zhang et al. 2007; Cho et al. 2009; Esseku et al. 2013; Gao et al. 2015; Mak et al. 2015). Therefore, our study has the originality by revisiting the BE studies of 13 years period belonging to one of the CRO’s database (N-CRO) in Turkey, regarding the frequency, type, drug subgroups, cut off (split points using Gini Index) values and probable causes of adverse events.

The pooled BE dataset also evaluated the age, BMI, and sex of the 5498 volunteers. The range of age showed that younger people (min. 21.12–max. 49.08) were more eager to be involved in the studies, which could be explained by the socioeconomical status. While it was possible for both of the sexes to be involved in the BE studies of N-CRO, all the volunteers were male. This could be related to the sociocultural properties of a developing country. Reluctance of females to attend bioequivalence studies in Turkey makes restrictor effect to number and representativeness of BE studies, especially for hormone containing drugs (e.g., oral contraceptives). Moreover, pharmacokinetic parameters like Cmax and AUC for some drugs, thereby adverse events are well-known to show differences between male and female individuals (Gandhi et al. 2004; Soldin and Mattison 2009). Even tough to involve only male volunteers to the BE studies is not against to the regulations framed by the national and international guidelines (Investigation 1994; EMA 2010), for a CRO it could be a limitation for evaluating pharmacodynamics and pharmacokinetic differences due to gender in BE studies. We could suggest raising public awareness with the use of media in order to involve both sexes to the BE studies.

In the pooled BE study database, the highest frequency of adverse effects was reported in genitourinary system and sex hormones involving tadalafil and sildenafile containing drugs among the eight drug subgroups. Likewise, drugs which contain tadalafil and sildenafile also attracted attention in the post-marketing adverse event reports. (Lowe and Costabile 2012). Genitourinary system and sex hormones’ were followed by nervous system, and antineoplastic drugs indicating relatively high adverse event frequencies when compared to the other subgroups (Leung et al. 2012; Pages et al. 2014).

The finding of no difference between test and reference drugs in terms of adverse events frequency is a valuable result for safety of generic drugs while investigating a population of 1992 volunteers.

The first five highest frequent adverse events (headache, somnolence, nausea, dizziness, vomiting) in the BE studies were related with nervous system and gastrointestinal system. Probably, those adverse events could be based on the drug itself. In the adverse event forms most of the adverse events were recorded as irrelevant to the drugs used in the BE studies. While it can be speculative, some of the adverse events could be assumed to be triggered with psychological stress (Mayer 2000; Mönnikes et al. 2001; Nash and Thebarge 2006; Leistad et al. 2006; Cathcart et al. 2010). Some studies suggested that headache and functional gastrointestinal disorders might have psychological stress origin (Mayer 2000; Mönnikes et al. 2001; Leistad et al. 2006; Nash and Thebarge 2006; Cathcart et al. 2010) while fatigue and somnolence might have psychosomatic origin (Shorter 1993; Loge et al. 1998; Taylor et al. 2003). It can be speculated that to be involved in a BE study, giving biological specimen such as blood all day long, and having no other activity could be unusual to the daily routine of a person and it is possible to trigger some adverse events based upon psychological stress (Shorter 1993; Loge et al. 1998; Mayer 2000; Mönnikes et al. 2001; Taylor et al. 2003; Nash and Thebarge 2006; Leistad et al. 2006; Cathcart et al. 2010). Thus, the physical and social environment should be examined, and if necessary, in order to reduce the psychological stress that leads to adverse events, the prevailing conditions in the centers could be improved.

The investigators recorded serious adverse events (right foot fracture, laceration of achilles tendon, fall and traumatic scalp injury, death in traffic accident) to serious adverse event forms, applied specified treatment protocol to the volunteer where available, and informed both Ethical Committee and Turkish Ministry of Health. The investigators noted that none of the serious adverse events observed were showed relationship with the administrated drug in the BE studies. Our study could provide more robust and effective data about adverse events if investigators of Clinical Trial Centers have used MedDRA dictionary while classifying adverse events.

Inter-individual differences as genetic polymorphism are known to affect the drug metabolism and pharmacokinetic parameters. For example, Cmax and AUC parameters could be significantly different between poor drug metabolisers and extensive drug metabolisers resulting in toxic responses or lack of therapeutic effectiveness (Karaźniewicz-Łada et al. 2014; Al-Gahtany et al. 2014; Fowler et al. 2015). Therefore, it is possible to claim the crucial role of the inter-individual differences in the adverse events reported in the BE studies.

As we dealed with a pooled dataset of single BE studies covering 13 years, it was an opportunity to use Cmax and AUC values in order to obtain split points (cut off levels) to estimate adverse event frequencies below and above them. Gini Index is adopted from finance, where it is used to measure the inequality of wealth (Cichosz 2015). It is commonly used with well-known classification method named decision trees which h as wide usage area including finance, medicine, social sciences etc. (Tan et al. 2006). Thus, our group utilized Gini Index approach for the first time in BE studies to show the likely individual pharmacokinetic differences in the adverse event occurence with promising results. Eventually, the frequency of adverse events of the volunteers whose Cmax and AUC values above the obtained split points was found to be higher than that of the ones below. Since there were no additional data available indicating volunteers’ inter-individual differences in the dataset, split point estimation according to the Cmax and AUC values could be offered as a promising tool. Also, this approach could provide valuable outcomes when combined with genetic polymorphism data. As the pharmacokinetic parameters were strongly influenced by interindividual differences, we suggest using Gini Index in overall pharmacokinetic and pharmacovigilance evaluations in order to assess the pharmacogenomic differences via adverse event outcome.

The Gini Index based split points, with regards to the AUC and Cmax values for adverse event distribution, could be suggested for the future BE studies carried out for similar drugs to predict the frequency of likely adverse events.

However it should be emphasized that it has been found as a limitation to have only 63 BE studies (1992 volunteers) out of 261 studies with reachable Cmax and AUC data in our overall evaluation. The reason was N-CRO started to use new recording system for pharmacokinetic parameters at 2006. Previously, Cmax/AUC and some other parameters were not transferrable from N-CRO’s database.


The retrospective review of 13 years period of pooled BE studies of N-CRO revealed that the design of the studies and the demographic properties of the volunteers were consistent with both national and international guidelines. However, in the BE studies only male volunteers were involved. It can be suggested to promote the involvement of females by raising the public awareness through media. The statistical approach named Gini Index used for the first time in order to determine the role of inter-individual differences in the adverse event occurrence and it is found to be a valuable tool to recommend for similar future studies. It could be more revealing to have the Cmax and AUC of all of the 261 BE studies. As a conclusion, our study proposed that centralized monitoring of pooled BE studies with regards to the adverse events could support drug safety studies and provide a basis for post-marketing pharmacovigilance studies.


  • Al-Gahtany M, Karunakaran G, Munisamy M (2014) Pharmacogenetics of CYP3A5 on Carbamazepine pharmacokinetics in epileptic patients developing toxicity. BMC Genom 15(Suppl 2):2

    Article  Google Scholar 

  • Aronson JK, Ferner RE (2005) Clarification of terminology in drug safety. Drug Saf 28(10):851–870

    Article  Google Scholar 

  • Baker GR, Norton PG, Flintoft V, Blais R, Brown A, Cox J, Etchells E, Ghali WA, Hébert P, Majumdar SR, O’Beirne M, Palacios-Derflingher L, Reid RJ, Sheps S, Tamblyn R (2004) The Canadian Adverse Events Study: the incidence of adverse events among hospital patients in Canada. CMAJ 170(11):1678–1686

    Article  Google Scholar 

  • Cathcart S, Petkov J, Winefield AH, Lushington K, Rolan P (2010) Central mechanisms of stress-induced headache. Cephalalgia 30(3):285–295

    Google Scholar 

  • Cho HY, Yoon H, Park GK, Lee YB (2009) Pharmacokinetics and bioequivalence of two formulations of rebamipide 100-mg tablets: a randomized, single-dose, two-period, two-sequence crossover study in healthy Korean male volunteers. Clin Ther 31(11):2712–2721

    Article  Google Scholar 

  • Cichosz P (2015) Data mining algorithms, explained using R. Wiley, Chichester

    Google Scholar 

  • Commission of the European Communities (1991) Note for guidance on the investigation of bioavailability and bioequivalence

  • Esseku F, Joshi A, Oyegbile Y, Edowhorhu G, Gbadero D, Adeyeye M (2013) A randomized pahse I bioequivalence clinincal trial of a paediatric fixed-dose combination antiretroviral reconstitutable suspension in healthy adult volunteers. Antivir Ther 18(2):205–212

    Article  Google Scholar 

  • European Commission (2011) Detailed guidance on the collection, verification and presentation of adverse reaction reports arising from clinical trials on medicinal products for human use. Accessed 15 Dec 2015

  • European Medicines Agency (2010) Guideline on the investigation of bioequivalence. Accessed 15 Oct 2015

  • European Parliament and of the Council (2001) Officially directive 2001/83/EC of 6 November 2001 on the community code relating to medicinal products for human use, Official Journal of the European Communities. Accessed 15 Dec 2015

  • Fowler S, Kletzl H, Finel M, Manevski N, Schmid P, Tuerck D, Norcross RD, Hoener MC, Spleiss O, Iglesias VA (2015) A UGT2B10 splicing polymorphism common in african populations may greatly increase drug exposure. J Pharmacol Exp Ther 352(2):358–367

    Article  Google Scholar 

  • Gandhi M, Aweeka F, Blaschke RM, Greenblatt TF (2004) Sex differences in pharmacokinetics and pharmacodynamics. Annu Rev Pharmacol Toxicol 44:499–523

    Article  Google Scholar 

  • Gao X, Ndongo MN, Checchio TM, Cook J, Duncan B, LaBadie RR (2015) A randomized, open-label 3-way crossover study to investigate the relative bioavailability and bioequivalence of crushed sildenafil 20 mg tablets mixed with apple sauce, extemporaneously prepared suspension (EP), and intact sildenafil 20 mg tablets in healthy volunteers under fasting conditions. CPDD 4(1):74–80

    Article  Google Scholar 

  • Hastie T, Tibshirani R, Friedman JH (2001) The elements of statistical learning: data mining, inference, prediction. Springer, New York

    Book  Google Scholar 

  • ICH Harmonised Tripartite Guideline (1996) Guideline for good clinical practice E6(R1). Accessed 19 Apr 2016

  • Investigation of Bioavailability and Bioequivalence of Pharmaceutical Preparations (1994) Official Gazette of the Republic of Turkey, Number 21942

  • Karaźniewicz-Łada M, Danielak D, Rubiś B, Burchardt P, Oszkinis G, Główka F (2014) The influence of genetic polymorphism of Cyp2c19 isoenzyme on the pharmacokinetics of clopidogrel and its metabolites in patients with cardiovascular diseases. J Clin Pharmacol 54(8):874–880

    Article  Google Scholar 

  • Kopp C, Badiane C (2014) Generics: keep a balanced view. Prescrire Int 23(146):52–55

    Google Scholar 

  • Lazarou J, Pomeranz BH, Corey PN (1998) Incidence of adverse drug reactions in hospitalized patients: a meta-analysis of prospective studies. JAMA 279(15):1200–1205

    Article  Google Scholar 

  • Leistad RB, Sand T, Westgaard RH, Nilsen KB, Stovner LJ (2006) Stress-induced pain and muscle activity in patients with migraine and tension-type headache. Cephalalgia 26(1):64–73

    Article  Google Scholar 

  • Leung JY, Barr AM, Procyshyn RM, Honer WG, Pang CC (2012) Cardiovascular side-effects of antipsychotic drugs: the role of the autonomic nervous system. Pharmacol Ther 135(2):113–122

    Article  Google Scholar 

  • Loge JH, Ekeberg O, Kaasa S (1998) Fatigue in the general Norwegian population: normative data and associations. J Psychosom Res 45(1):53–65

    Article  Google Scholar 

  • Lowe G, Costabile RA (2012) 10-year analysis of adverse event reports to the food and drug administration for phosphodiesterase type-5 inhibitors. J Sex Med 9(1):265–270

    Article  Google Scholar 

  • Mak WY, Tan SS, Wong JW, Chin SK, Looi I, Yuen KH (2015) Bioequivalence study of two IR metformin formulations: an open-label, randomised, two treatments, two-way crossover study in healthy volunteers. J Bioequiv Bioavailab 7(2):82–85

    Google Scholar 

  • Mayer E (2000) The neurobiology of stress and gastrointestinal disease. Gut 47(6):861–869

    Article  Google Scholar 

  • Midha KK, McKey G (2009) Bioequivalence; its history, practice, and future. AAPS 11(4):664–670

    Article  Google Scholar 

  • Mönnikes H, Tebbe JJ, Hildebrandt M, Arck P, Osmanoglou E, Rose M, Klapp B, Wiedenmann B, Heymann-Mönnikes I (2001) Role of stress in functional gastrointestinal disorders. Evidence for stress-induced alterations in gastrointestinal motility and sensitivity. Dig Dis 19(3):201–211

    Article  Google Scholar 

  • Nash JM, Thebarge RW (2006) Understanding psychological stress, its biological processes, and impact on primary headache. Headache 46(9):1377–1386

    Article  Google Scholar 

  • Organisation for Economic Co-operation and Development (2015) Share of generic market. Accessed 27 Dec 2015

  • Pages A, Bondon-Guitton E, Montastruc JL, Bagheri H (2014) Undesirable effects related to oral antineoplastic drugs: comparison between patients’ internet narratives and a national pharmacovigilance database. Drug Saf 37(8):629–637

    Article  Google Scholar 

  • Public Law 98-417 (1984) Drug price competition and patent term restoration act. Accessed 15 Dec 2015

  • Rani S, Pargal A (2004) Bioequivalence: an overview of statistical concepts. Indian J Pharmacol 36(4):209–216

    Google Scholar 

  • Shorter E (1993) From paralysis to fatigue: a history of psychosomatic illness in the modern era. The Free Press Publisher, New York

    Google Scholar 

  • Sibille M, Deigat N, Janin A, Kirkesseli S, Durand DV (1998) Adverse events in phase-I studies: a report in 1015 healthy volunteers. Eur J Clin Pharmacol 54(1):13–20

    Article  Google Scholar 

  • Soldin OP, Mattison DR (2009) Sex differences in pharmacokinetics and pharmacodynamics. Clin Pharmacokinet 48(3):143–157

    Article  Google Scholar 

  • Tan PN, Steinbach M, Kumar V (2006) Introduction to data mining. Pearson Education, Boston

    Google Scholar 

  • Taylor RR, Jason LA, Jahn SC (2003) Chronic fatigue and sociodemographic characteristics as predictors of psychiatric disorders in a community-based sample. Psychosom Med 65(5):896–901

    Article  Google Scholar 

  • Ucar T (2009) Biyoeşdeğerlik Çalışma Dosyası Hazırlanırken Dikkat Edilmesi Gereken Hususlar. İKU Dergisi 23:27–31

    Google Scholar 

  • United States Food and Drug Administration (2003) Guidance for Industry, Bioavailability and bioequivalence studies for orally administered drug products—General Considerations. Accessed 15 Nov 2015

  • United States Food and Drug Administration (2009) Guidance for Clinical Investigators, Sponsors, and IRBs, Adverse Event Reporting to IRBs- Improving Human Subject Protection. Accessed 15 Dec 2015

  • World Health Organization (2015) Collaborating Centre for Drug Statistics Methodology. Accessed 27 Dec 2015

  • Zhang W, He YJ, Han CT, Liu ZQ, Li Q, Fan L, Tan ZR, Zhang WX, Yu BN, Wang D, Hu DL, Zhou HH (2006) Effect of SLCO1B1 genetic polymorphism on the pharmacokinetics of nateglinide. Br J Clin Pharmacol 62(5):567–572

    Article  Google Scholar 

  • Zhang Y, Si D, Chen X, Lin N, Guo Y, Zhou H, Zhong D (2007) Influence of CYP2C9 and CYP2C19 genetic polymorphisms on pharmacokinetics of gliclazide MR in Chinese subjects. Br J Clin Pharmacol 64(1):67–74

    Article  Google Scholar 

Download references

Authors’ contributions

GCD developed the idea for the study. CG and GCD were responsible for the initial design of the study. GCD, CG and ACP were responsible for the acquisition of data and dataset creation. ACP and CG preprocessed the data. ACP was responsible for statistical analysis and interpretation of the data. GCD and CG prepared the first version of the manuscript. All authors (CG, ACP and GCD) were involved in revising the manuscript critically for important intellectual content and have given final approval of the version to be published. All authors read and approved the final manuscript.


The authors would like to thank Novagenix Bioanalytical R&D Center (N-CRO) for sharing their database and Seda Kuscu from Gazi University Academic Writing and Research Center for the proofreading of the paper.

Competing interests

The authors declare that they have no competing interests.

Author information

Authors and Affiliations


Corresponding author

Correspondence to Gonca Çakmak Demircigil.

Additional files

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gurer, Ç., Çakmak Pehlivanli, A. & Çakmak Demircigil, G. Pooled bioequivalence study database from Turkey: characterization of adverse events and determination of split points based on Gini Index as a promising method. SpringerPlus 5, 709 (2016).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: