Piecewise modelling and parameter estimation of repairable system failure rate
- Chong Peng^{1}Email authorView ORCID ID profile,
- Guangpeng Liu^{1} and
- Lun Wang^{1}
Received: 8 May 2016
Accepted: 22 August 2016
Published: 2 September 2016
Abstract
Lifetime failure data usually presents a bathtub-shaped failure rate, and random failure phase dominates its life cycle. Relatively large errors always existed when single distribution model is used for analysis and modelling. Therefore, a bathtub-shaped reliability model based on piecewise intensity function was proposed for repairable system. Parameter estimation was studied by using maximum likelihood method in conjunction with two-stage Weibull process interval estimation and Artificial Bee Colony Algorithm. The proposed model and estimation approach fit the failure rate under bathtub curve very well, adequately reflect the duration of random failure phase, and guarantee the feasibility of quantitative analysis. Moreover, the estimated critical point of bathtub curve could be calculated. At last, the proposed model was applied in the reliability analysis of a repairable Computer Numerical Control system, and the validity of the proposed model and its parameter estimation method were verified.
Keywords
Background
Reliability modelling is a process in which the distribution curve of system failure rate is fitted based on lifetime failure data generated in system life cycle test or system operation (Myers 2010). The failure rate distribution curve can reveal system’s failure mechanism or the system-specific use phase, which may be conducive to the predication and control of failure, and carrying out an available predictive maintenance, reducing unexpected failures (Lin and Tseng 2005). Furthermore, the quantitative fitting of distribution curve is also the premise that reliability analysis, design, and test are effectively carried out. Therefore, it is important to analyze the variation trend of failure rate in a quantitative way for the purpose of reliability modelling.
At present, common distribution models for fitting failure rate include exponential distribution, normal distribution, lognormal distribution and Weibull distribution, etc. Among them, exponential distribution deals with the situation where failure rate remains unchanged, and its function is relatively simple. Weibull distribution is the most widely applied since it is able to fit the progressive increase or decrease of failure rate effectively by changing parameters. Some scholars improved exponential distribution, proposed the exponential geometric distribution (Adamidis and Loukas 1998), exponentiated exponential distribution (Gupta and Kundu 1999), the exponential-Poisson distribution (Kus 2007), the exponentiated exponential-poisson distribution (Barreto-Souza and Cribari-Neto 2009), those improved models also achieve description of the progressive increasing or decreasing of failure rate. All of which have been used monotonic function to model the failure patterns for the repairable system.
However, the lifetime failure data are often non-monotonic, and have a bathtub-shaped failure rate, which can be divided into three phases—early failure, random failure, and wear-out failure. For this reason, many scholars studied the phenomenon. Chen (2000) put forward a new two-parameter Weibull distribution model, in which the failure rate function followed the trend of bathtub curve when the shape parameter satisfied a certain condition. Later, Xie et al. (2002) and Zhang (2004) expanded the two-parameter model above by introducing the third parameter, and proposed the three-parameter Weibull distribution models independently. The results indicated that those models can reach high accuracy in fitting the trend of bathtub curve more easily than traditional models. Lai et al. (2003), based on Weibull distribution and Extreme Value Type I distribution, proposed an improved Weibull distribution model, which also described the trend of bathtub curve very well. They also completed the model’s parameter estimation by means of Weibull probability plot. El-Gohary et al. (2013) gave a new distribution known as the generalized Gompertz distribution by dealing with a new generalization of exponential. Generalized Gompertz distribution, and generalized exponential distributions, which had bathtub curve failure rate depending upon the shape parameter. And the maximum likelihood estimators of the parameters were derived using a simulations study.
Wang et al. (2015) proposed a new four parameter interval life model to describe the bathtub curve. Cordeiro et al. (2014) extended the modified Weibull distribution, and established a five-parameter Weibull distribution. Aiming at the failure censored data of industrial devices, Using Newton–Raphson type algorithm for parameter estimation, finding that the extended model fitted the bathtub curve very well.
The above models fitted the trend of bathtub-shaped failure rate well, but random failure phase was not described in detail, as well as only one critical point of early failure phase and random failure phase was included. In fact, random failure phase is the main part of life cycle for most repairable system. Single distribution model may be inadequate for analysis and modelling as well as relatively errors may occur. Parameter estimation of multi parameter model, because of the unknown parameters, is difficult to solve the problem directly by using the maximum likelihood estimation.
Therefore, a bathtub-shaped reliability model based on piecewise intensity function was proposed for repairable system. According to the characteristics of failure rate at three phases of bathtub curve, using non-homogeneous Poisson process (NHPP) and homogeneous Poisson process (HPP), the failure rate of different phases was fitted respectively. In view of the complexity of parameter estimation, relevant parameter estimation was studied by virtue of maximum likelihood method and artificial bee colony algorithm. At last, the approach was applied and verified by the reliability analysis of a repairable Computer Numerical Control (CNC) system. The remainder of the paper is organized as follows. "Set up piecewise model" section builds up a piecewise model under bathtub curve. "Parameter estimation" section studies the parameter estimation of the model. "Application" section gives an example application for verifying the proposed method. Finally, the paper is concluded.
Set up piecewise model
- 1.
Early failure phase
At early failure phase, intensity function presents a decline trend. Due to the defects in the process of selection, manufacture and assembly of components, failure rate of system is high in the initial phase, but decreases rapidly as the run time increases and maintenance is provided. Therefore, we assume that the repair process at early failure phase is minimal repair, NHPP is used for modelling, intensity function complies with the most common Weibull process, and b _{1} < 1, namely:$$\omega_{1} (t) = a_{1} b_{1} t^{{b_{1} - 1}}$$(1) - 2.
Random failure phase
At random failure phase, early defects of a system have been corrected, and failure intensity is tending towards stability. Thus, we assume that the repair process at random failure phase is perfect repair, HPP and exponential distribution are adopted for modelling, and intensity function remains unchanged (as a constant):where, t _{0} is the critical point between early failure phase and random failure phase.$$\omega_{2} (t) = \omega_{1} (t_{0} ) = a_{1} b_{1} t_{0}^{{b_{1} - 1}}$$(2) - 3.
Wear-out failure phase
As run time lapses, the system slowly enters wear-out failure phase due to loss of components and mechanical fatigue, and its intensity function is increasing. Just like early failure phase, we assume that the repair process at wear-out failure phase is minimal repair, NHPP is used for modelling, and intensity function complies with Weibull process. Thus, the system’s intensity function is:where, t _{1} is the critical point between random failure phase and wear-out failure phase.$$\omega_{3} (t) = a_{1} b_{1} t_{0}^{{b_{1} - 1}} + a_{2} b_{2} (t - t_{1} )^{{b_{2} - 1}}$$(3)
Parameter estimation
There are a lot of methods for parameter estimation of reliability model, such as maximum likelihood estimation, moment estimation, least square method, and Bayesian method. Among these methods, maximum likelihood estimation is the most widely used owing to its good theoretical basis and high estimation accuracy. Therefore, maximum likelihood estimation was applied for parameter estimation of the proposed reliability model.
Maximum likelihood estimation
In addition, the range of variable parameter shall be optimized to improve efficiency and accuracy of the model’s parameter optimization. First, the value range of t _{0} and t _{1} , i.e. k and l, shall be determined based on the system’s failure time data and trend estimation. Second, the first k time data at early failure phase and the last n–l time data at wear-out failure phase are adopted for interval estimation of Weibull process, and the extreme value of estimation interval is regarded as the optimization range of parameters a _{1} , b _{1} , a _{2}, and b _{2}.
Weibull process interval estimation
- 1.
Point estimation
Based on Literature (Ebeling 2004), the maximum likelihood point estimation of Weibull process parameters a and b is as follows:
When the failure time data is Type-II censored data:$$\left\{ {\begin{array}{*{20}l} {\hat{b} = \frac{n}{{\sum\nolimits_{i = 1}^{n} {\ln \frac{{S_{n} }}{{S_{i} }}} }}} \hfill \\ {\hat{a} = \frac{n}{{S_{n}^{{\hat{b}}} }}} \hfill \\ \end{array} } \right.$$(19)When the failure time data is Type-I censored data:$$\left\{ {\begin{array}{*{20}l} {\hat{b} = \frac{n}{{\sum\nolimits_{i = 1}^{n} {\ln \frac{{t_{s} }}{{S_{i} }}} }}} \hfill \\ {\hat{a} = \frac{n}{{t_{s}^{{\hat{b}}} }}} \hfill \\ \end{array} } \right.$$(20) - 2.
Margin of error
Generally, in the case of large sample (≥30), the maximum likelihood point estimation presents consistency and asymptotically normal distribution; In the case of small sample, the logarithm of point estimation of parameter is much closer to normal distribution. Specific equations are as follows:
In the case of large sample:$$\frac{{a - \hat{a}}}{{\sqrt {D(\hat{a})} }} \sim N(0,1);\quad \frac{{b - \hat{b}}}{{\sqrt {D(\hat{b})} }} \sim N(0,1)$$(21)In the case of small sample:where \(D(\hat{a})\) and \(D(\hat{b})\) are the variance of parameters a and b, respectively. Their value can be obtained using Fisher Information Matrix below (Kijima 1989; Ye 2003):$$\frac{{\ln a - \ln \hat{a}}}{{\sqrt {D(\hat{a})} }} \sim N(0,1);\quad \frac{{\ln b - \ln \hat{b}}}{{\sqrt {D(\hat{b})} }} \sim N(0,1)$$(22)$$\left( {\begin{array}{*{20}l} {D(\hat{a})} \hfill & \quad {\text{cov} (\hat{a},\hat{b})} \hfill \\ {\text{cov} (\hat{b},\hat{a})} \hfill & \quad {D(\hat{b})} \hfill \\ \end{array} } \right) = \left( {\begin{array}{*{20}l} { - \frac{{\partial^{2} \ln L}}{{\partial a^{2} }}} \hfill & \quad { - \frac{{\partial^{2} \ln L}}{\partial a\partial b}} \hfill \\ { - \frac{{\partial^{2} \ln L}}{\partial b\partial a}} \hfill & \quad { - \frac{{\partial^{2} \ln L}}{{\partial b^{2} }}} \hfill \\ \end{array} } \right)^{ - 1}$$(23)
According to normal distribution, the confidence interval under 1−α:
Solving Eq. (25) can obtain the confidence interval for a and b:
Parameter optimization based on artificial bee colony algorithm
With respect to the proposed model for parameter optimization and the range optimized by Weibull process interval estimation, artificial bee colony algorithm was used for solving optimization problem. Artificial bee colony algorithm is characterized by strong global optimization, rapid rate of convergence, and suitability in solving different problems, compared with other swarm intelligence optimization algorithms such as evolutionary algorithm, artificial immune algorithm, particle swarm optimization, and ant colony algorithm (Chen 2015).
Correspondence between bee’s behavior and optimization
Bee searches for nectar source | Optimization |
---|---|
Location of nectar source | Value of all θ = (a _{1}, b _{1}, t _{0}, a _{2}, b _{2}, t _{1}) |
Quality of nectar source | Fitness value corresponding to all θ, i.e. L(S_{1},S_{2},…,S_{n}|θ) |
Speed of gathering honey | Solving speed |
Maximum fitness | max L(S _{1},S _{2},…,S _{ n }|θ) |
- 1.
Initialization of parameter
First, the two basic parameters in artificial bee colony algorithm shall be initialized. One parameter is the quantity of nectar source (S _{ n }), which represents the number of solution. Besides, S _{ n } is also the number of leaders and followers; the other parameter is the limit value of gathering nectar source (limit). When the gathering times of a nectar source exceed the limit, the nectar source will be abandoned.
- 2.
Initialization of solution space
Random initialization produces the primary S _{ n } solutions. Let θ _{ i } = (a _{1i } , b _{1i } , t _{0i } , a _{2i } , b _{2i } , t _{1i } ) = (θ _{ i1} , θ _{ i2} , θ _{ i3} , θ _{ i4} , θ _{ i5} , θ _{ i6} ), which represents the location of the ith nectar source. The initialization formula for each value is as follows:where r is the random number between [0, 1], and LB _{ j } and UB _{ j } are the value range of θ _{ j }, i.e. minimum and maximum.$$\theta_{ij} = LB_{j} + (UB_{j} - LB_{j} ) \times r\quad j = 1,2, \ldots ,4\quad i = 1,2, \ldots ,Sn$$(28)Later, the leaders start to gather these nectar sources at random, and relevant fitness value is calculated.
- 3.
Stage of leaders
When the leaders decide to gather a nectar source at random, they will search new nectar sources at random around the nectar source. Their search is in line with the equation below:The fitness value corresponding to new nectar sources θ _{ new } is then calculated and compared with previous nectar sources to select the solution with higher fitness.$$\theta_{new(j)} = \theta_{ij} + (\theta_{kj} - \theta_{ij} ) \times r\quad k \in (1,2, \ldots ,Sn) \cap k \ne i\quad j = 1,2, \ldots ,4$$(29) - 4.
Stage of followers
In terms of followers, their follow probability is calculated based on normalization and fitness value of each nectar source. The equation is as follows:where, fit _{ i } represents the fitness value of nectar source at θ _{ i }. Larger fit _{ i } indicates greater probability that the followers select the nectar source. When the followers select a nectar source, they also search new nectar sources at random around the nectar source based on Eq. (29) just as the leaders do, and then choose a better nectar source by comparing with the nectar source they follow.$$P_{i} = \frac{{fit_{i} }}{{\sum\nolimits_{i = 1}^{Sn} {fit_{i} } }}$$(30) - 5.
Stage of scouters
At this stage, if a nectar source θ _{ i } is still not improved after being gathered limit times, it will be abandoned. The leaders here will become scouters, and search a new nectar source at random based on Eq. (28).
- 6.
Iterations
The nectar source with the maximum fitness is recorded. Whether iterations reach the maximum set point is judged. If the maximum set point is reached, the algorithm ends and the optimal nectar source, namely optimal solution, is output. Otherwise, return to (3) to continue the cycle.
Application
The proposed model was applied in reliability analysis of a repairable CNC system containing servo drive unit.
Data of total failure time
Number of failure | Total failure time (h) | Number of failure | Total failure time (h) | Number of failure | Total failure time (h) | Number of failure | Total failure time (h) |
---|---|---|---|---|---|---|---|
1 | 216 | 14 | 53,262 | 27 | 129,726 | 40 | 191,921 |
2 | 522 | 15 | 58,536 | 28 | 132,588 | 41 | 193,253 |
3 | 990 | 16 | 66,546 | 29 | 139,770 | 42 | 195,282 |
4 | 1368 | 17 | 68,310 | 30 | 145,314 | 43 | 197,686 |
5 | 4248 | 18 | 76,734 | 31 | 149,868 | 44 | 199,193 |
6 | 6354 | 19 | 80,406 | 32 | 153,054 | 45 | 199,901 |
7 | 10,728 | 20 | 85,842 | 33 | 162,036 | 46 | 200,671 |
8 | 17,046 | 21 | 95,400 | 34 | 168,666 | 47 | 201,244 |
9 | 23,652 | 22 | 97,578 | 35 | 174,137 | 48 | 201,739 |
10 | 29,862 | 23 | 107,010 | 36 | 179,169 | 49 | 202,810 |
11 | 35,730 | 24 | 111,492 | 37 | 183,413 | 50 | 202,978 |
12 | 39,276 | 25 | 116,892 | 38 | 186,045 | Type-I censored test time: ts = 203,115 | |
13 | 48,366 | 26 | 121,662 | 39 | 189,225 |
As can be seen in Fig. 3, the TTT scatter diagram is concave under the diagonal of unit square at the beginning, indicating that the failure rate presents a decline at early phase. Later, the diagram fluctuates slightly along a straight line. The failure rate remains unchanged, and the system is gradually stabilized. After a period of time, the diagram looks like a convex under the diagonal of unit square, indicating that the failure rate increases.
Results of statistical tests at the significance level α = 0.05
Test methods | Statistics | Critical value | Calculated value | Results |
---|---|---|---|---|
Laplace test | U | 1.96 | 1.35 | Show a non-monotonic trend |
Anderson–Darling test | V _{1} | 1.96 | 3.32 | Follow the trend of bathtub curve |
V _{2} | 1.96 | 4.08 | ||
V _{3} | 192.47 | 68.65 |
The results of trend test are consistent with the estimation output of TTT diagram. The system failure time data follows the trend of bathtub curve, and undergoes three phases—early failure, random failure and wear-out failure.
Then, the system reliability model was set up using the piecewise function above, and parameter estimation was performed.
First, the optimum ranges of t _{0} and t _{1} were processed in segment, and within the scope of (0, n) select the values of k and l in turn. But in order to improve calculation efficiency, by observing the total failure time data and the inflection point trend of TTT diagram, the range of values for k and l can be reduced and make a preliminary judgment. So, the value of k may be 6, 7, 8, and 9, while the value of l may be 33, 34, 35, and 36. And, the value range of t _{0} and t _{1} is S _{ k } < t _{0} < S _{ k+1} < S _{ l } < t _{1} < S _{ l+1}.
Artificial bee colony algorithm was then used for parameter optimization of the optimization model above. The algorithm’s iterations, size of bee colony, and limit were set. The optimal parameter in the case of k and l was θ = (a _{1} , b _{1} , t _{0} , a _{2} , b _{2} , t _{1} ).
At last, optimal parameters in the case of different k and l were compared. The parameter that maximizes likelihood was selected as the optimal parameter of overall model, i.e. k = 7, l = 33, a _{1} = 0.0427, b _{1} = 0.5066, t _{0} = 16,567, a _{2} = 5.0503 × 10–11, b _{2} = 2.4984, t _{1} = 168,242.
Results of test of goodness of fit at the significance level α = 0.05
Weibull process | Test methods | Statistics | Critical value | Calculated value | Results |
---|---|---|---|---|---|
Stage I | Cramer-Von Mises test | \(C_{M}^{2}\) | 0.208 | 0.079 | Verified |
Stage II | 0.217 | 0.151 | Verified |
Meanwhile, the results suggest that the critical point between early failure phase and random failure phase of a single system was located at about t _{0}/18 = 920 h, while the critical point between random failure phase and wear-out failure phase was located at about t _{1}/18 = 9347 h.
Based the instantaneous MTBF(t) = 1/ω(t), we found that the MTBF of the system at random failure phase was calculated as MTBF = 1/(1.7893 × 10^{−4}) = 5589 h.
Therefore, the example above proves that the proposed piecewise reliability model can fit the failure rate under bathtub curve very well and obtain two critical points of bathtub curve. It provides an important basis for reliability analysis, design and test.
Conclusions
- 1.
Considering the characteristics of failure rate at three phases of bathtub curve, and combining homogeneous Poisson process and non-homogeneous Poisson process during Counting Process, a bathtub-shaped reliability model based on piecewise intensity function was proposed. Moreover, with respect to the difficulty of common parameter estimation methods in solving equations, maximum likelihood estimation and artificial bee colony algorithm were combined to estimate the model-related parameters and guarantee the feasibility of the model in application.
- 2.
Given that extensive range and excessive time consumption of parameter optimization during parameter estimation, the interval estimation of two-stage Weibull process was studied, and the range of model optimization was improved. As a result, the efficiency of parameter optimization was substantially increased.
- 3.
The proposed model, as well as estimation approach, fits the failure rate under bathtub curve very well and adequately reflects the duration of random failure phase. Besides, two critical points of bathtub curve are obtained.
- 4.
At last, the practical use of the proposed model is demonstrated by a set of failure data of a repairable CNC system, and the validity of the proposed model and its parameter estimation method was verified. The study will be useful for reliability analysis of repairable systems and provide an important basis for relevant reliability research.
Declarations
Authors’ contributions
All authors contributed equally to this work. All authors read and approved the final manuscript.
Acknowledgements
The research was supported by the National Science and Technology Major Project “High-Grade CNC Machine Tools and Basic Manufacturing Equipments” (Grant No. 2016ZX04004-006).
Competing interests
The authors declare that they have no competing interests.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
Authors’ Affiliations
References
- Adamidis K, Loukas S (1998) A lifetime distribution with decreasing failure rate. Stat Prob Lett 39(98):35–42View ArticleGoogle Scholar
- Barlow RE, Campo RA (1975) Total time on test processes and applications to failure data analysis. California Univ Berkeley Operations Research CenterGoogle Scholar
- Barreto-Souza W, Cribari-Neto F (2009) A generalization of the exponential-poisson distribution. Stat Prob Lett 79(24):2493–2500View ArticleGoogle Scholar
- Bergman B (1979) On age replacement and the total time on test concept. Scand J Stat 6(4):161–168Google Scholar
- Chen Z (2000) A new two-parameter lifetime distribution with bathtub shape or increasing failure rate function. Stat Prob Lett 49(2):155–161View ArticleGoogle Scholar
- Chen W (2015) Artificial bee colony algorithm for constrained possibilistic portfolio optimization problem. Phys A 429:125–139View ArticleGoogle Scholar
- Cordeiro GM, Ortega EMM, Silva GO (2014) The Kumaraswamy modified Weibull distribution:theory and applications. J Stat Comput Simul 84(84):1387–1411View ArticleGoogle Scholar
- Ebeling CE (2004) An introduction to reliability and maintainability engineering. Tata McGraw-Hill Education, New York, pp 294–307Google Scholar
- El-Gohary A, Alshamrani A, Al-Otaibi AN (2013) The generalized Gompertz distribution. Appl Math Model 37(1–2):13–24View ArticleGoogle Scholar
- Gupta RD, Kundu D (1999). Generalized exponential distributions. Aust N Zeal J Stat 41(12):173-188(16)Google Scholar
- Kijima M (1989) Some results for repairable systems with general repair. J Appl Prob 26(1):89–102View ArticleGoogle Scholar
- Kus C (2007) A new lifetime distribution. Gen Inf 51(9):4497–4509Google Scholar
- Lai CD, Xie M, Murthy DNP (2003) A modified Weibull distribution. IEEE Trans Reliab 52(1):33–37View ArticleGoogle Scholar
- Lin Chang-Ching, Tseng Hsien-Yu (2005) A neural network application for reliability modelling and condition-based predictive maintenance. Int J Adv Manuf Technol 25:174–179View ArticleGoogle Scholar
- Louit DM, Pascual R, Jardine AKS (2009) A practical procedure for the selection of time-to-failure models based on the assessment of trends in maintenance data. Reliab Eng Syst Safety 94(10):1618–1628View ArticleGoogle Scholar
- Myers A (2010) Complex system reliability: multichannel systems with imperfect fault coverage. Springer, London, pp 7–9Google Scholar
- Pulcini G (2001) Modeling the failure data of a repairable equipment with bathtub type failure intensity. Reliab Eng Syst Safety 71(2):209–218View ArticleGoogle Scholar
- Rausand M, Høyland A (2004) System reliability theory: models, statistical methods, and applications. Wiley, New York, pp 127–171Google Scholar
- Wang X, Yu C, Li Y (2015) A new finite interval lifetime distribution model forfitting bathtub-shaped failure rate curve. Math Problems Eng 2015:1–6Google Scholar
- Xie M, Tang Y, Goh TN (2002) A modified Weibull extension with bathtub-shaped failure rate function. Reliab Eng Syst Safety 76(3):279–285View ArticleGoogle Scholar
- Ye CN (2003) Fisher information matrix of LBVW distribution. Acta Math Appl Sinica 26(4):715–725Google Scholar
- Zhang R (2004) A new three-parameter lifetime distribution with bathtub shape or increasing failure rate function and a flood data application. Concordia University, CanadaGoogle Scholar