- Open Access
Prognostic role of microRNA-203 in various carcinomas: evidence from a meta-analysis involving 13 studies
© The Author(s) 2016
- Received: 3 November 2015
- Accepted: 5 September 2016
- Published: 13 September 2016
Growing evidence from recent studies has revealed that microRNA-203 (miR-203) might be an attractive prognostic biomarker for cancer. But controversy still remains. The aim of this meta-analysis was to summarize available evidences and clarify the preliminary predictive value of miR-203 for prognosis in cancer patients. Eligible studies were identified through multiple research strategies in PubMed, EMBASE and Web of Science up to October 2015. Key statistics such as pooled hazard ratios (HR) with 95 % confidence intervals (CIs) were utilized to calculate patient survival. 13 eligible studies with 1600 patients were ultimately enrolled in this meta-analysis. Our results failed to show a significant relation between upregulated miR-203 expression and a favorable overall survival (OS) (HR 1.00, 95 % CI 0.65–1.36) in a random effect model. However, in subgroup analysis, we found that high expression of miR-203 was significantly associated with poor OS in Caucasian patients (HR 1.31, 95 % CI 1.06–1.55). In contrast, for Asian patients, over-expression of miR-203 was an independent prognostic factor for better and OS (HR 0.59, 95 % CI 0.22–0.96). It also suggested that cancer types and miRNA assay method were significant associated with prognosis. The over-expression of miR-203 was effectively predictive of worse prognosis in breast cancer (HR 6.35, 95 % CI 1.34–11.36), pancreatic cancer (HR 1.19, 95 % CI 1.08–1.30), ependymoma (HR 1.35, 95 % CI 1.10–1.61), but for glioma patients, elevated miR-203 is a potential biomarker for predicting better progression of cancer (HR 0.26, 95 % CI −0.02 to 0.54). Besides, for direct miRNA profiling studies, over-expression of miR-203 was an independent prognostic factor for worse OS (HR 6.35, 95 % CI 1.34–11.36). This meta-analysis indicated that ethnicity, tumor type and miRNA assay method mainly contributed to heterogeneity. Considering the insufficient evidence, further relevant studies are warranted.
- Overall survival
MicroRNAs (miRNAs) represent a class of non-coding, highly conserved single stranded RNAs of approximately 22 nucleotides (Fabian and Sonenberg 2012; Guo et al. 2016; Bartel 2004; Carthew and Sontheimer 2009). These tiny regulators mainly function via post-transcriptionally regulating gene expression at the posttranscriptional level (He and Hannon 2004; Garzon et al. 2006; Rolle et al. 2016). They are thought modulate protein production by binding to complementary sites of target messenger RNAs (mRNAs), leading to degradation or transcriptional gene silencing of mRNAs (Filipowicz et al. 2008). In light of previous reports that most human miRNAs are located at cancer associated regions of the genome, it can be speculated that miRNAs may be extensively involved in cancers (Calin et al. 2005; Macfarlane and Murphy 2010; Jonckheere et al. 2015). In recent years, profiling studies have confirmed that miRNAs are aberrantly expressed in various human cancers and are implicated in tumor progression and metastasis (Manikandan et al. 2008; Lu et al. 2005; Cheng 2015).
Mir-203, located at the chromosome 14q32.33, is one of the most frequently mentioned miRNAs. Previous studies have showed that miR-203 exhibited aberrant expression in multiple malignancies compared with their normal tissue, including gastric cancer (Imaoka et al. 2015), pancreatic adenocarcinoma (Ikenaga et al. 2010) and colon carcinoma (Schetter et al. 2008). Many studies have revealed that miR-203 plays an essential role during cell growth, migration, invasion (Viticchie et al. 2011; Wang et al. 2013a). Studies also demonstrate that miR-203 acts as a tumor suppressor in tumor progression (Wang et al. 2014). Therefore, it is hypothesized that miR-203 might be a potential prognostic markers in carcinoma.
Although various studies have focused on the prognostic role of miR-203 in cancer, the conclusion remained inconsistent. In the current study, we carried out a meta-analysis to evaluate and predict the overall risk of elevated miR-203 expression for survival in patients with cancer. In addition, we also explored the implications and feasibility of utilizing miRNA-203 as a prognostic marker in clinical practice.
We performed this meta-analysis following the guidelines of the Meta-analysis of Observational Studies in Epidemiology group (MOOSE) (Stroup et al. 2000).
Search strategy and study selection
We systematically searched online databases, including PubMed (http://www.ncbi.nlm.nih.gov/pubmed/), EMBASE (http://store.elsevier.com/embase) and Web of Science (www.isiknowledge.com), to identify relevant studies published before 6 October 2013. The search strategy included the following combinations of the keywords: ‘microRNA 203’, ‘cancer OR carcinoma OR tumor OR malignancy’ and ‘prognosis OR survival OR mortality OR death OR relapse OR recurrence OR outcome’. The titles, abstracts, full texts and reference lists of retrieved articles were carefully scanned to identify additional eligible studies.
Eligible studies had to meet the following criteria: (1) English publications; (2) a focus on patients with any type of carcinoma; (3) the association between miR-203 expression and survival outcome. Other exclusion criteria included studies were: (1) review articles or letters; (2) duplicate publications; (3) lacked sufficient data.
Data extraction and quality assessment
For each included study, the following data elements was collected: trial features (e.g., the first author and publication year); characteristics of the participants (e.g., ethnicity, pathological type, sample category, mean age and gender ratio); detection method; follow-up time and data needed for prognosis meta-analysis [e.g., hazard ratios (HR), overall survival (OS) along with their 95 % CIs and P values]. An HR of >1 was considered significant association with increasing risk of mortality or recurrence. If only Kaplan–Meier curves were reported, the data were extracted from graphical survival plots and HR was estimated using previously described methods (Williamson et al. 2002; Tierney et al. 2007). The methodological quality of all the studies included was assessed according a critical review checklist of the Dutch Cochrane Centre proposed by MOOSE (Stroup et al. 2000).
HR and 95 % confidence interval (CI) were conducted as Tierney’s method (Tierney et al. 2007). A test of heterogeneity for pooled HR was carried out by Cochran’s Q test and Higgins I-squared statistic. If heterogeneity was observed (P < 0.05), a random effect model (Der Simonian and Laird method) was adopted, while the fixed effect model was applied in the absence of between-study heterogeneity (P > 0.05) (Higgins et al. 2003). In addition, we also evaluated the publication bias by Egger linear regression test using the funnel plot (Egger et al. 1997). All analyses were conducted with STATA version 12.0 (StataCorp LP, College Station, Texas, USA).
Characteristics of studies included in the meta-analysis
Median age (years)
Source of HR
Maximum months of follow-up
<65 169; ≥ 65 176
<62 11; ≥ 62 13
<62 14; ≥ 62 19
Recent studies have demonstrated the aberrant expression of miRNAs in tumors, and specific miRNAs have been found to plays crucial roles in cell growth, migration, invasion and tumor progression (Viticchie et al. 2011; Wang et al. 2013a, 2014). Compare to proteins and mRNAs, miRNAs are more stable and degrade slower, which can be detected as stable markers in serum and even in both formalin-fixed and paraffin-embedded tissues. Therefore, miRNAs attract great attention to be an effective predictor for early diagnosis and accurate prognosis in cancers.
Among these miRNAs, miR-203 has been frequently studied to serve as a tumor suppressor or a tumor promoter in different human cancers. A lot of literatures have confirmed that miR-203 contributes to frequent tumor-specific CpG-island methylation and is closely related to various tumor-associated protein, such as ΔNp 63, Akt 2 and ABL 1 to regulate tumor cell proliferation (Furuta et al. 2010; Yuan et al. 2011; Bueno et al. 2008; Li et al. 2011; Liang et al. 2015). This indicates the important relationship between miR-203 expression and tumor patient survival. Recently, several studies have observed that significant relationship between elevated miR-203 expression and poor overall survival (Schetter et al. 2008; Bovell et al. 2013) in colorectal cancer. Greither et al. (2010) also reported that high expression of miR-203 predicted poor prognosis in pancreatic tumors. However, a recent study published by He’s et al. (2013) concluded that overall survival of patients with high miR-203 expression was significantly longer than those with low miR-203 expression. As we know, no meta-analysis has focused on the potential prognostic role of miR-203 in cancer prognosis. Thus, this meta-analysis was carried out to evaluate the prognostic value of miR-203 in various cancer.
The current meta-analysis has collected 13 articles of 1600 patients. In random effect model, the analysis results of forest plot showed that miR-203 might not have sufficient power to predict the overall survival of cancers, with the pooled HR being 1.00 (95 % CI 0.65–1.36). In order to explore potential sources of heterogeneity, subgroup analyses were performed according to ethnicity, cancer types and miRNA assay method. The subgroup analysis results suggested that high expression of miR-203 was significantly associated with poor OS of cancer patients among Caucasians people (HR 1.31, 95 % CI 1.06–1.55), but in Asians, a better OS associated with elevated miR-203 expression (HR 0.59, 95 % CI 0.22–0.96). Based on the analysis results, ethnicity seems to play a crucial role in association of miR-203 expression and cancer patient prognosis, which mainly due to the variations in genetic background, environmental factors. It was also summarized that cancer types have a considerable impact on the prognostic role of miR-203. High expression of miR-203 moderately predicted poor OS in breast cancer, pancreatic cancer and ependymoma patients, but for glioma patients, high miR-203 expression was significantly associated with better OS. Besides, over-expression of miR-203 was an independent prognostic factor for worse OS when direct miRNA profiling assay method was used. Generally speaking, our results show that miR-203 may not be sufficient to predict cancer prognosis and the ethnicity, cancer types and miRNA assay method may be the main source of discrepancies.
Nonetheless several limitations exist in the present meta-analysis study. First, more and more attention are focused on prognostic role of miR-203 in cancer, but the studies we included are all from Asians and Caucasians, the cancer styles are not comprehensive too; hence, further studies explored the prognostic value of miR-203 on various ethnicities and cancer styles may be needed. Secondly, the numerical value of pooled HR was not sufficiently strong to indicate the prognosis although we have demonstrated the correlation of high miR-203 expression with the overall survival in Caucasians and Asians. Thirdly, we extracted the data form survival curves if the studies didn’t provide HR, which might be of less credibility compared with direct analysis on HR. Despite of the limitations, our study is the first meta-analysis to evaluate the prognostic role of miR-203 in cancer.
In summary, our findings showed that miR-203 may not be sufficiently accurate as a prognosis for human cancer. But we explored that elevated miR-203 expression might potentially predict the poor survival in Caucasian people while was significantly correlated with good overall survivals in Asians. Besides, tumor type and miRNA assay method may be the potential sources of heterogeneity. More clinical investigations with larger sample size should be conducted to focus on the relationship between miR-203 expression and patient prognosis.
LY carried out the search strategy and participated in statistical analysis. WY performed the study selection and data extraction. YZ participated in quality assessment. YL conceived of the study and helped to draft the manuscript. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
- Bartel DP (2004) MicroRNAs: genomics, biogenesis, mechanism, and function. Cell 116(2):281–297View ArticlePubMedGoogle Scholar
- Bovell LC, Shanmugam C, Putcha BDK, Katkoori VR, Zhang B, Bae SJ, Singh KP, Grizzle WE, Manne U (2013) The prognostic value of MicroRNAs varies with patient race/ethnicity and stage of colorectal cancer. Clin Cancer Res 19(14):3955–3965. doi:10.1158/1078-0432.Ccr-12-3302 View ArticlePubMedPubMed CentralGoogle Scholar
- Bueno MJ, Perez de Castro I, de Cedron MG, Santos J, Calin GA, Cigudosa JC, Croce CM, Fernandez-Piqueras J, Malumbres M (2008) Genetic and epigenetic silencing of microRNA-203 enhances ABL1 and BCR-ABL1 oncogene expression. Cancer Cell 13(6):496–506. doi:10.1016/j.ccr.2008.04.018 View ArticlePubMedGoogle Scholar
- Calin GA, Ferracin M, Cimmino A, Di Leva G, Shimizu M, Wojcik SE, Iorio MV, Visone R, Sever NI, Fabbri M, Iuliano R, Palumbo T, Pichiorri F, Roldo C, Garzon R, Sevignani C, Rassenti L, Alder H, Volinia S, Liu CG, Kipps TJ, Negrini M, Croce CM (2005) A MicroRNA signature associated with prognosis and progression in chronic lymphocytic leukemia. N Engl J Med 353(17):1793–1801. doi:10.1056/NEJMoa050995 View ArticlePubMedGoogle Scholar
- Carthew RW, Sontheimer EJ (2009) Origins and mechanisms of miRNAs and siRNAs. Cell 136(4):642–655. doi:10.1016/j.cell.2009.01.035 View ArticlePubMedPubMed CentralGoogle Scholar
- Chen HY, Han ZB, Fan JW, Xia J, Wu JY, Qiu GQ, Tang HM, Peng ZH (2012) miR-203 expression predicts outcome after liver transplantation for hepatocellular carcinoma in cirrhotic liver. Med Oncol 29(3):1859–1865. doi:10.1007/s12032-011-0031-9 View ArticlePubMedGoogle Scholar
- Cheng G (2015) Circulating miRNAs: roles in cancer diagnosis, prognosis and therapy. Adv Drug Deliv Rev 81:75–93. doi:10.1016/j.addr.2014.09.001 View ArticlePubMedGoogle Scholar
- Costa FF, Bischof JM, Vanin EF, Lulla RR, Wang M, Sredni ST, Rajaram V, Bonaldo MD, Wang DL, Goldman S, Tomita T, Soares MB (2011) Identification of microRNAs as potential prognostic markers in ependymoma. PLoS One. doi:10.1371/journal.pone.0025114 Google Scholar
- Egger M, Davey Smith G, Schneider M, Minder C (1997) Bias in meta-analysis detected by a simple, graphical test. BMJ 315(7109):629–634View ArticlePubMedPubMed CentralGoogle Scholar
- Fabian MR, Sonenberg N (2012) The mechanics of miRNA-mediated gene silencing: a look under the hood of miRISC. Nat Struct Mol Biol 19(6):586–593. doi:10.1038/nsmb.2296 View ArticlePubMedGoogle Scholar
- Filipowicz W, Bhattacharyya SN, Sonenberg N (2008) Mechanisms of post-transcriptional regulation by microRNAs: are the answers in sight? Nat Rev Genet 9(2):102–114. doi:10.1038/nrg2290 View ArticlePubMedGoogle Scholar
- Furuta M, Kozaki KI, Tanaka S, Arii S, Imoto I, Inazawa J (2010) miR-124 and miR-203 are epigenetically silenced tumor-suppressive microRNAs in hepatocellular carcinoma. Carcinogenesis 31(5):766–776. doi:10.1093/carcin/bgp250 View ArticlePubMedGoogle Scholar
- Garzon R, Fabbri M, Cimmino A, Calin GA, Croce CM (2006) MicroRNA expression and function in cancer. Trends Mol Med 12(12):580–587. doi:10.1016/j.molmed.2006.10.006 View ArticlePubMedGoogle Scholar
- Greither T, Grochola LF, Udelnow A, Lautenschlager C, Wurl P, Taubert H (2010) Elevated expression of microRNAs 155, 203, 210 and 222 in pancreatic tumors is associated with poorer survival. Int J Cancer 126(1):73–80. doi:10.1002/ijc.24687 View ArticlePubMedGoogle Scholar
- Guo Y, Zhang X, Huang W, Miao X (2016) Recent advances of miRNAs in adipose tissues. Sheng Wu Gong Cheng Xue Bao 32(2):151–163PubMedGoogle Scholar
- He L, Hannon GJ (2004) MicroRNAs: small RNAs with a big role in gene regulation. Nat Rev Genet 5(7):522–531. doi:10.1038/nrg1379 View ArticlePubMedGoogle Scholar
- He JG, Deng YJ, Yang G, Xie WY (2013) MicroRNA-203 down-regulation is associated with unfavorable prognosis in human glioma. J Surg Oncol 108(2):121–125. doi:10.1002/jso.23315 View ArticlePubMedGoogle Scholar
- Higgins JP, Thompson SG, Deeks JJ, Altman DG (2003) Measuring inconsistency in meta-analyses. BMJ 327(7414):557–560. doi:10.1136/bmj.327.7414.557 View ArticlePubMedPubMed CentralGoogle Scholar
- Ikenaga N, Ohuchida K, Mizumoto K, Yu J, Kayashima T, Sakai H, Fujita H, Nakata K, Tanaka M (2010) MicroRNA-203 expression as a new prognostic marker of pancreatic adenocarcinoma. Ann Surg Oncol 17(12):3120–3128. doi:10.1245/s10434-010-1188-8 View ArticlePubMedGoogle Scholar
- Imaoka H, Toiyama Y, Okigami M, Yasuda H, Saigusa S, Ohi M, Tanaka K, Inoue Y, Mohri Y, Kusunoki M (2015) Circulating microRNA-203 predicts metastases, early recurrence, and poor prognosis in human gastric cancer. Gastric Cancer. doi:10.1007/s10120-015-0521-0 PubMedGoogle Scholar
- Jonckheere N, Lahdaoui F, Van Seuningen I (2015) Targeting MUC4 in pancreatic cancer: miRNAs. Oncoscience 2(10):799–800. doi:10.18632/oncoscience.249 PubMedPubMed CentralGoogle Scholar
- Li JA, Chen YX, Zhao JF, Kong FR, Zhang YD (2011) miR-203 reverses chemoresistance in p53-mutated colon cancer cells through downregulation of Akt2 expression. Cancer Lett 304(1):52–59. doi:10.1016/j.canlet.2011.02.003 View ArticlePubMedGoogle Scholar
- Liang M, Shi B, Liu J, He L, Yi G, Zhou L, Yu G, Zhou X (2015) Downregulation of miR203 induces overexpression of PIK3CA and predicts poor prognosis of gastric cancer patients. Drug Des Devel Ther 9:3607–3616. doi:10.2147/DDDT.S85525 PubMedPubMed CentralGoogle Scholar
- Liu YR, Ren FH, Rong MH, Luo YH, Dang YW, Chen G (2015) Association between underexpression of microrna-203 and clinicopathological significance in hepatocellular carcinoma tissues. Cancer Cell Int. doi:10.1186/s12935-015-0214-0 Google Scholar
- Lu J, Getz G, Miska EA, Alvarez-Saavedra E, Lamb J, Peck D, Sweet-Cordero A, Ebert BL, Mak RH, Ferrando AA, Downing JR, Jacks T, Horvitz HR, Golub TR (2005) MicroRNA expression profiles classify human cancers. Nature 435(7043):834–838. doi:10.1038/nature03702 ADSView ArticlePubMedGoogle Scholar
- Macfarlane LA, Murphy PR (2010) MicroRNA: biogenesis, function and role in cancer. Curr Genom 11(7):537–561. doi:10.2174/138920210793175895 View ArticleGoogle Scholar
- Madhavan D, Zucknick M, Wallwiener M, Cuk K, Modugno C, Scharpff M, Schott S, Heil J, Turchinovich A, Yang RX, Benner A, Riethdorf S, Trumpp A, Sohn C, Pantel K, Schneeweiss A, Burwinkel B (2012) Circulating miRNAs as surrogate markers for circulating tumor cells and prognostic markers in metastatic breast cancer. Clin Cancer Res 18(21):5972–5982. doi:10.1158/1078-0432.Ccr-12-1407 View ArticlePubMedGoogle Scholar
- Manikandan J, Aarthi JJ, Kumar SD, Pushparaj PN (2008) Oncomirs: the potential role of non-coding microRNAs in understanding cancer. Bioinformation 2(8):330–334View ArticlePubMedPubMed CentralGoogle Scholar
- Mathe EA, Nguyen GH, Bowman ED, Zhao YQ, Budhu A, Schetter AJ, Braun R, Reimers M, Kumamoto K, Hughes D, Altorki NK, Casson AG, Liu CG, Wang XW, Yanaihara N, Hagiwara N, Dannenberg AJ, Miyashita M, Croce CM, Harris CC (2009) MicroRNA expression in squamous cell carcinoma and adenocarcinoma of the esophagus: associations with survival. Clin Cancer Res 15(19):6192–6200. doi:10.1158/1078-0432.Ccr-09-1467 View ArticlePubMedPubMed CentralGoogle Scholar
- Rolle K, Piwecka M, Belter A, Wawrzyniak D, Jeleniewicz J, Barciszewska MZ, Barciszewski J (2016) The sequence and structure determine the function of mature human miRNAs. PLoS One 11(3):e0151246. doi:10.1371/journal.pone.0151246 View ArticlePubMedPubMed CentralGoogle Scholar
- Schetter AJ, Leung SY, Sohn JJ, Zanetti KA, Bowman ED, Yanaihara N, Yuen ST, Chan TL, Kwong DL, Au GK, Liu CG, Calin GA, Croce CM, Harris CC (2008) MicroRNA expression profiles associated with prognosis and therapeutic outcome in colon adenocarcinoma. JAMA 299(4):425–436. doi:10.1001/jama.299.4.425 View ArticlePubMedPubMed CentralGoogle Scholar
- Schultz NA, Andersen KK, Roslind A, Willenbrock H, Wojdemann M, Johansen JS (2012) Prognostic microRNAs in cancer tissue from patients operated for pancreatic cancer-five microRNAs in a prognostic index. World J Surg 36(11):2699–2707. doi:10.1007/s00268-012-1705-y View ArticlePubMedGoogle Scholar
- Stroup DF, Berlin JA, Morton SC, Olkin I, Williamson GD, Rennie D, Moher D, Becker BJ, Sipe TA, Thacker SB (2000) Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA 283(15):2008–2012View ArticlePubMedGoogle Scholar
- Tierney JF, Stewart LA, Ghersi D, Burdett S, Sydes MR (2007) Practical methods for incorporating summary time-to-event data into meta-analysis. Trials 8:16. doi:10.1186/1745-6215-8-16 View ArticlePubMedPubMed CentralGoogle Scholar
- Toiyama Y, Imaoka H, Okigami M, Yasuda H, Saigusa S, Ohi M, Kobayashi M, Araki T, Tanaka K, Inoue Y, Mohri Y, Kusunoki M (2015) Circulating microRNA-203 predicts metastases, early recurrence, and poor prognosis in human gastric cancer. Gastroenterology 148(4):S365View ArticleGoogle Scholar
- Viticchie G, Lena AM, Latina A, Formosa A, Gregersen LH, Lund AH, Bernardini S, Mauriello A, Miano R, Spagnoli LG, Knight RA, Candi E, Melino G (2011) MiR-203 controls proliferation, migration and invasive potential of prostate cancer cell lines. Cell Cycle 10(7):1121–1131View ArticlePubMedGoogle Scholar
- Wang C, Wang X, Liang H, Wang T, Yan X, Cao M, Wang N, Zhang S, Zen K, Zhang C, Chen X (2013a) miR-203 inhibits cell proliferation and migration of lung cancer cells by targeting PKCalpha. PLoS One 8(9):e73985. doi:10.1371/journal.pone.0073985 ADSView ArticlePubMedPubMed CentralGoogle Scholar
- Wang SS, Zhao XH, Wang J, Wen YM, Zhang LJ, Wang DZ, Chen HL, Chen QX, Xiang W (2013b) Upregulation of microRNA-203 is associated with advanced tumor progression and poor prognosis in epithelial ovarian cancer. Med Oncol. doi:10.1007/s12032-013-0681-x Google Scholar
- Wang N, Liang H, Zhou Y, Wang C, Zhang S, Pan Y, Wang Y, Yan X, Zhang J, Zhang CY, Zen K, Li D, Chen X (2014) miR-203 suppresses the proliferation and migration and promotes the apoptosis of lung cancer cells by targeting SRC. PLoS One 9(8):e105570. doi:10.1371/journal.pone.0105570 ADSView ArticlePubMedPubMed CentralGoogle Scholar
- Williamson PR, Smith CT, Hutton JL, Marson AG (2002) Aggregate data meta-analysis with time-to-event outcomes. Stat Med 21(22):3337–3351. doi:10.1002/sim.1303 View ArticlePubMedGoogle Scholar
- Yuan Y, Zeng ZY, Liu XH, Gong DJ, Tao J, Cheng HZ, Huang SD (2011) MicroRNA-203 inhibits cell proliferation by repressing Delta Np63 expression in human esophageal squamous cell carcinoma. BMC Cancer. doi:10.1186/1471-2407-11-57 Google Scholar