 Research
 Open Access
 Published:
Memetic computing through bioinspired heuristics integration with sequential quadratic programming for nonlinear systems arising in different physical models
SpringerPlus volume 5, Article number: 2063 (2016)
Abstract
Background
In this study, bioinspired computing is exploited for solving system of nonlinear equations using variants of genetic algorithms (GAs) as a tool for global search method hybrid with sequential quadratic programming (SQP) for efficient local search. The fitness function is constructed by defining the error function for systems of nonlinear equations in mean square sense. The design parameters of mathematical models are trained by exploiting the competency of GAs and refinement are carried out by viable SQP algorithm.
Results
Twelve versions of the memetic approach GASQP are designed by taking a different set of reproduction routines in the optimization process. Performance of proposed variants is evaluated on six numerical problems comprising of system of nonlinear equations arising in the interval arithmetic benchmark model, kinematics, neurophysiology, combustion and chemical equilibrium. Comparative studies of the proposed results in terms of accuracy, convergence and complexity are performed with the help of statistical performance indices to establish the worth of the schemes.
Conclusions
Accuracy and convergence of the memetic computing GASQP is found better in each case of the simulation study and effectiveness of the scheme is further established through results of statistics based on different performance indices for accuracy and complexity.
Background
Introduction
Solving system of nonlinear equations in particular based on large set are generally considered to be the most difficult and a challenging problem for the research community in the field of numerical computation. These systems arise frequently in a spectrum of applied mathematics and engineering applications including trajectory planning, kinematics, combustion theory and neurophysiology etc. (Grosan and Abraham 2008a, b; Morgan 1987). Currently, number of numerical methods have been developed to deal with nonlinear equations effectively, however, one of the simplest, oldest and widely used solvers for these problems is the Newton–Raphson method (NRM) (Ortega and Rheinboldt 1970; Kelley 2003). Similar to most of the numerical methods for solving system of nonlinear equations, the performance of the NRM can be highly sensitive to the initial guess of the problem and generally fail with bad initial parameters. Therefore, normally, any global search methodology is used to determine the initial bias values which are then supplied to the NRM for solving viably the system of nonlinear equations. Besides NRM, many other iterative methods for solving linear and nonlinear equations are reported in the literature with their own strengths, limitations and applicability domain on specific scenarios or environments. For instance, Kelley, Campbell, and Broyden’s classically provide different solvers for these equations (Kelley 1999; Campbell et al. 1996; Darvishi and Barati 2007). Moreover, the Jacobianfree Newton–Krylov method is applied broadly for nonlinear equations arising in many applications in which an effective two sided bicolouring method is used to get the lower triangular half of the sparse Jacobian matrix via automatic differentiation (Broyden 1971; Knoll and Keyes 2004; Saad and van der Vorst 2000). Recently, many researchers, including Jaffari and Gejji, Abbasbandy, Sharma et al., Vahidi et al. have given an updated version of methods to solve the nonlinear system of equation reliably and efficiently (Jafari and Gejji 2006; Abbasbandy 2005; Vahidi et al. 2012; Sharma and Guha 2013; Sharma and Gupta 2013, 2014; Sharma and Arora 2014).
Most of the existing literature available for solving nonlinear system of equation is based on iterative and recursive procedure, and working on these methods is usually dependent on values of initial guess or start point of the algorithms. On the other hand, these systems of equations have been used in modelling of many physical problems arising in a wide spectrum of fields (Morgan 1987; de Soares 2013). Therefore, design of numerical procedures that are accurate, reliable, robust, and efficient, has attracted the research community significantly. The aim of this study is to step further in this domain by exploring and exploiting the strength of soft computing framework (SCF) to determine the solution of systems of nonlinear equation without prior knowledge of biased initial guess or weights. The soft computing techniques based on genetic algorithms and swarming intelligence has been used extensively for different applications such as VanderPol oscillatory systems (Khan et al. 2015), reliable feature selection for Arabic text summarization (AlZahrani et al. 2015), effective navigation of mobile robot in unknown environment(Algabri et al. 2014), robust feature selection and classification (Nekkaa and Boughaci 2015), fuel ignition model in combustion theory (Raja 2014), change detection mechanism in synthetic aperture radar images (Li et al. 2015), optimization of multirate quadrature mirror filter bank (Baicher 2012), integrated process planning and scheduling problems (Li et al. 2014), thin film flow of third grade fluids (Raja et al. 2014), Troesch’s problem (Raja 2014), second order system of boundary value problems (Arqub and AboHammour 2014; AbuArqub et al. 2014), prediction of linear dynamical systems (AboHammour et al. 2013), JefferyHamel Flow in the presence of high magnetic field (Raja and Samar 2014), Painlevé equations (Raja et al. 2015), modeling of electrical conducting solids (Raja et al. 2016), nanofludics problems (Raja et al. 2016), Riccati fractional differential equations (FrDEs) (Raja et al. 2015), real time cross layer optimization (Elias et al. 2012) and BagleyTorvik FrDEs (Raja et al. 2011). These are the motivating factors for the authors to explore in this domain. The objective of this study is to design memetic evolutionary techniques based on effective global search and efficient local search methodologies and then apply the proposed SCF for an accurate, effective and reliable solution of system of nonlinear equations.
The rest of the organization of the paper is as follows. In “Methods” section, proposed design methodology is presented for the solutions of nonlinear system of equation by formulation of fitness functions, stepwise working criteria and its learning mechanism. In “Results and discussion” section, the results of numerical experimentations of proposed schemes are presented for six benchmark problems, including application arising in combustion theory, neurophysiology and Kinetic modelling etc. along the comparison of the results in term of performance operators. In “Comparative studies” section, results of the proposed algorithms are compared using statistical performance indicators for both accuracy and complexity. Concluding remarks as well as future research directions are given in the last section.
Methods
In this section, design methodology is presented for finding the solution of a system of nonlinear equations. Our aim is to provide a platform for optimization of variables for the given system in order to find the accurate and precise solution. Genetic algorithms (GAs) is an optimization tool which can be used effectively for finding the solution of a given system of nonlinear equation without using the initial guess.
Formulation of fitness function
Generally, system of nonlinear equation is expressed as:
or
To find out the precise solution of (1), the first step is to formulate the fitness or objective function on the basis of absolute value of the function or mean square error as:
Fitness function (3) depends upon bounded or unbounded constraints on variables and these variables are used to define the given system of nonlinear equations.
The next step is to optimize the formulated fitness function (3) by using reliable optimization mechanisms such that for \(\varepsilon \to 0\) then \({\mathbf{F}}(t) \to 0\). Eventually the correspondingly values of the vector \(t = (t_{1} ,t_{2} ,t_{3} , \ldots ,t_{n} )\) are the solution set for the given system of nonlinear equation.
Learning methodology
From the last few decades’ mathematicians and researchers made serious efforts to produce quality of initial guesses to find the optimal final solutions. This was really tough, especially when the number of variables involving in the system of nonlinear equations exceeds a specific level. Genetic algorithms (GAs) are basically the modelling of the phenomenon of natural evolution (Miettinen 1999). The effectiveness and systematic operation of GA’s depends upon not only the selection of different constitutional operators, but also on the settings of algorithm, variable parameters and the design constraints.
GAs is considered to be one of the best optimization algorithm as compared to the others because of their multidimensionally operations to produce most feasible solutions. GAs are also effective for the problems for which the construction of fitness function is much complex (Johnson et al. 2014; Kociecki and Adeli 2014). In our daily life, most problems have a very large solution space, which is generally not dealt by the ordinary algorithms while GAs deals these situations efficiently and correctly. GAs is considered to be the most viable and accurate method for finding the numerical approximate solutions of the given system of nonlinear equations by determining the best fit from the extensive range of search space. In the present study, the memetic computing approach is developed based on variants of GAs (Raja et al. 2015) hybrid with sequential quadratic programming (SQP) technique to obtain unknown design variables of nonlinear system given in Eq. (1).
The different computing approaches based on variants of GA hybrid with SQP are evaluated for finding the solution of systems of nonlinear equations. The proposed hybrid computing schemes are listed in Table 1, while procedural overview is given graphically in Fig. 1. Necessary details of procedural steps for hybrid computing algorithms are given below:
 Step 1:

Initialization Initialize the chromosome with number of elements equal to the number of variable in nonlinear system of equations as:
$$c = (t_{1} ,t_{2} ,t_{3} , \ldots ,t_{n} ),$$where n represents variables in nonlinear system. Set of chromosome represents an initial population and it is given mathematically as:
$$P = (c_{1} ,c_{2} ,c_{3} , \ldots ,c_{m} ),$$here m is the total number of chromosomes in the population P.
Initial assignments and declarations of GAs program and are set using MATLAB builtin functions of the optimization toolbox based on ‘ga’ and ‘gaoptimset’ routines. The fix parameter settings of all twelve variants of GAs are used such as 200 generations. The choice of these settings is made with care, after a lot of experimentation, and experience of operating optimization solvers.
 Step 2:

Fitness calculation Evaluate the fitness values of each individual or chromosome of the population using a problem specific fitness function as defined in (3).
 Step 3:

Termination criteria Terminate the updating process of the algorithm, if any of the following predefined conditions are fulfilled.

Fitness ε values are less than or equal to 10^{−35}.

Generations, i.e., 400 times step increment are made in the program execution.

Limited values of any of the functions, tolerance (TolFun), constraints tolerance (TolCon) and stall generation limit (StallGenLimit) is achieved.
Go to step 5 in case of termination conditions are satisfied.

 Step 4:

Reproduction Create the next generation of each variant of GAs based on a different set of combination for the reproduction mechanism using selection, crossover, and mutation routines as listed in Table 1. Go to step 2
 Step 5:

Hybridization Global best individual of GAs variants is given to a local search method based on SQP algorithm, i.e., the memetic computing approach of learning, for further refinements in the results. SQP algorithm is implemented by invoking ‘fmincon’ function of MATLAB optimization toolbox for constraint problems as per following procedure:

(a)
Initialization Initial weights or start point of SQP algorithm is the global best chromosomes of GAs variants. The bounds, declarations and initial parameters are given in ‘optimset’ function such as number of iteration 500.

(b)
Fitness calculation Calculate the fitness value using the Eq. (3).

(c)
Termination criteria Terminate the cyclic process of updating in variables if any of the following predefine conditions fulfilled.

Total number of Iterations/cycles are executed.

Limited values for any TolFun, maximum function evaluations (MaxFunEvals), Xtolerance (TolX), and TolCon are achieved as given in ‘optimset’ function.
Go to the step 6 in case of termination conditions satisfied.


(d)
Updating of variables: Updating of weights is made on each step increment as per SQP procedure and continues from step 5(b).

(a)
 Step 6:

Storage Store the values of the weights, fitness, generations, MaxFunEvals and time taken for this run in case of all twelve hybrid schemes based on GASQP.
 Step 7:

Statistical analysis Repeat the procedure for a sufficient large number of times from step 1 to step 6 to generate large data set for reliable and effective analysis of the performance of the algorithms.
Results and discussion
In this section, results of proposed schemes for solving system of nonlinear equations are presented. Six different problems are taken for the study and proposed methods base on twelve variants of memetic computing using GAs and SQP algorithms are applied for these equations. Six different models of system of nonlinear equation are taken for numerical experimentation to check the effectiveness of the proposed design schemes. These models with governing mathematical relations are described in six problems.
Problem 1: generic nonlinear system of equations
In this case, a generic system of nonlinear equations based on four equations with four unknowns is taken and it is represented by the following mathematical relations (Grosan and Abraham 2008b)
The exact solution for system (4) is (1, −1, 0, 2) for (t _{1}, t _{2}, t _{3}, t _{4}), respectively, and these solutions are used to verify the applicability of the proposed methods. The design approaches are applied to solve the system (4) as per procedure and settings given in “Results and discussion” section, however, the fitness function formulated in this case is given as:
Optimization of fitness function (5) is carried out with twelve variants of memetic computing algorithms and one set of solution obtained by GAs and GASQP algorithm is shown in Fig. 2 for each variant. While these adaptive parameters along with their fitness values are tabulated in Table 2.
The optimized variables given in Table 2 and Fig. 2 are used Eq. (4) in order to determine the values of \(f_{1} ({\mathbf{t}})\), \(f_{2} ({\mathbf{t}})\), \(f_{3} ({\mathbf{t}})\) and, \(f_{4} ({\mathbf{t}})\) and results are given in Table 3. The smaller is the values of fitness then better is the performance of the algorithm
It is seen from Table 2 that the values of fitness ε for variants of GAs are around 10^{−04} to 10^{−10} while these values for the hybrid approach GASQP variants are around 10^{−17}. Moreover, it is seen from Table 3 that the values of, \(f_{i} ({\mathbf{t}})\), i = 1–4, for GAs and GASQP algorithms lie 10^{−02} to 10^{−05}, and 10^{−09}, respectively. There is no noticeable difference between the performances of the memetic computing approaches; however, the best results are obtained with GASQP8 algorithm. It is observed that generally highly accurate results are determined by memetic computing techniques than variants of GAs.
Problem 2: interval arithmetic benchmark model
In this case, the performance of the proposed methods is evaluated by taking a renewed problem of nonlinear systems named as an interval arithmetic benchmark model (IABM). The governing mathematical relations for IABM is given in the form of following nonlinear system of equations (Grosan and Abraham 2008b; Van Hentenryck et al. 1997; Hong and Stahl 1994):
where \({\mathbf{t}} = \left( {t_{1} , \, t_{2} , \ldots ,t_{10} } \right)\). The design memetic computing approaches are applied to solve the system (5) on a similar pattern as adopted in last problem; however, the fitness function formulated in this case is given as follows:
Optimization of fitness function (7) is carried out with the proposed scheme and results are shown graphically in Fig. 3 for variants of GAs and GASQP algorithms. The absolute values of constitutional equations are calculated and results are tabulated in Table 4 for each variant. It is seen that the maximum values of \(f_{i} ({\mathbf{t}})\), i = 1–10, for GA and GASQP algorithms are 1.13 × 10^{−02} and 1.46 × 10^{−16}, respectively. It is observed that generally the hybrid computing approaches give the results with higher precision from the rest.
Problem 3: chemical equilibrium applications
Consider another potential example of a system of nonlinear equations arises in chemical equilibrium applications (CEA) (Grosan and Abraham 2008b; Meintjes and Morgan 1990) to evaluate the performance of the proposed schemes. Mathematical model of CEA is given below:
where \(c = 10,\) \(\,c_{5} = 0.193,\) \(\,c_{6} = 0.000410,\,\) \(c_{7} = 0.000545,\) \(\,c_{8} = 0.000000449,\) \(c_{9} = 0.0000340,\) and \(c_{10} = 0.000000961\). The designed computing approaches are applied to solve the system (8) on a similar pattern as adopted in last problems, but the fitness function is formulated for this case as:
An optimization problem based on a fitness function (9) is solved with twelve variants of memetic computing. The trained design variables are given in Table 5. These parameters are used to calculate the values of functions \(f_{1} ({\mathbf{t}})\), \(f_{2} ({\mathbf{t}})\), \(f_{3} ({\mathbf{t}})\), \(f_{4} ({\mathbf{t}})\) and \(f_{5} ({\mathbf{t}})\). The results are given in Table 6. It is seen from Table 5 that the values of fitness ε for variants of GAs are of the order 10^{−04} to 10^{−05} while these values for variants of hybrid approach GASQPs are around 10^{−17}. Additionally, it is seen from Table 6 that the values of \(f_{i} ({\mathbf{t}})\), i = 1–5, for GA and GASQP algorithms lie around 10^{−02} to 10^{−06}, and 10^{−10}, respectively. It is observed that the best results are obtained with GASQP8 algorithm from the rest.
Problem 4: neurophysiology applications
In this case, the performance of the design scheme is examined on Bioinformatics problem based on neurophysiology applications (NPAs). Following a system of nonlinear equations representing NPA as (Grosan and Abraham 2008b; Verschelde et al. 1994):
where the values of constant c_{1} to c_{4} are chosen arbitrarily and \({\mathbf{t}} = \left( {t_{1} , \, t_{2} , \ldots ,t_{6} } \right)\). In model (10) the values of constant are taken zero. The design memetic computing approaches are applied to solve (10) by formulation of the fitness function in this case as:
Optimization of fitness function (11) is carried out with design variants of hybrid computing algorithms and results are tabulated in Table 7 along with the value of fitness and also in Table 8 for constitutional equations. It is seen that the values of fitness in case of GAs are around 10^{−09} to 10^{−15} while these values for the hybrid approach GASQP variants are around 10^{−24}. Generally, observed that highly accurate results are determined by hybrid methodologies for this problem also.
Problem 5: combustion theory applications
Wellknown problem of combustion theory with temperature around 3000 °C is taken in this case (Morgan 1987; Grosan and Abraham 2008b). Governing mathematical relations for the problem in term of system of nonlinear equations is given as follows:
Here, the input vector \({\mathbf{t}} = \left( {t_{1} , \, t_{2} , \ldots ,t_{10} } \right)\). The design computing approaches are applied to this case by constructing a fitness function as given below:
Optimization of fitness function (13) is carried out with the designed schemes and results are represented graphically in Fig. 4 for variants of GAs and GASQP algorithms. The absolute values of constitutional equations are calculated and results are tabulated in Table 9 for each variant. It is seen that the maximum values of \(f_{i} ({\mathbf{t}})\), i = 1–10, for GA and GASQP algorithms are 1.00 × 10^{−09} and 1.15 × 10^{−08}, respectively. It is observed that generally hybrid computing approaches outperformed the rest of techniques.
Problem 6: economics modelling application
Another problem is selected for the study arising in econometric modelling applications (EMAs) extensively based on system of nonlinear equation of arbitrary dimensions (Morgan 1987; Grosan and Abraham 2008b). These problems are generally considered to be stiff to solve numerically and given in terms of mathematical relations as:
here the value of “c_{k}” can be randomly chosen. A special case of the problem (14) is taken using n = 5 and k = 1 to 4 for evaluation of the proposed algorithms and its governing nonlinear system of the equations are written as:
where \({\mathbf{t}} = \left( {t_{1} , \, t_{2} , \ldots ,t_{5} } \right)\). The design approaches are applied to solve the system (15) with the help of optimization of the fitness function as defined below:
Results of proposed adaptive algorithms are tabulated in Tables 10 and 11 and these results show that values of fitness ε for GAs lie around 10^{−07} to 10^{−10} while these values for GASQP variants are around 10^{−33}. Generally, it is observed that the most accurate results are determined by hybrid computing platforms.
Comparative studies
In this section, comparative studies based on the results of statistical analysis are presented for variants of GA and GASQP for all the six systems of nonlinear equations. These analyses are used to draw reliable and constructive inferences on the performance of designed algorithms.
Statistical performance indicators
Statistical performance indicator base on mean and standard deviation (STD) are used to analyze the performance for each variant of hybrid technique GASQP for 100 independent runs of the algorithm to solve all six nonlinear equations. Results based on the data generated from these simulations are used to draw a constructive and effective inference for the performance of each algorithm.
Hundred independent runs for all 12 proposed schemes are performed to determine the solution of six problems based on nonlinear equations using the similar procedure as adopted in the last section. Results based on values of statistical indices are given in Table 12, while the values based on truncated data for 75 best runs, i.e., the run with minimum fitness values. Analysis based on truncated runs is given due to the fact that one single bad run of the algorithm spoiled all the results. It is observed that the values of mean for GA, GASQP variants lie in the range of 1.1 × 10^{−02} to 4.4 × 10^{−07} and 1.2 × 10^{−02} to 1.9 × 10^{−32} respectively, while from Table 12 these respective values lie in the range of 1.0 × 10^{−03} to 1.1 × 10^{−09} and 1.2 × 10^{−08} to 9.1 × 10^{−32}. Small values of the mean along with its STD are generally observed from each hybrid computing mechanism.
The accuracy and convergence of the proposed design hybrid schemes are analyzed based on 100 independent executions of algorithms. Results on the basis of value of fitness ε against number of independent runs on semilogarithmic scale are plotted for GA1 and GASQP1 for all six problems in Figs. 5 and 6, respectively, while the results for the variants of hybrid computing approaches in case of problem 2 are plotted in Fig. 7. Moreover, graphical illustrations of results in cases of different algorithms on different problems are given in Fig. 8. It is seen that the performance of magnetic versions is much superior to a variant of GAs. For first five problems, almost 100% convergent and accurate solutions are found by the hybrid schemes, however, very few, i.e., less than 5% runs, are observed to trap in premature convergence in case of problem 6. The most accurate results are found for problem 2, 4 and 6 by the design hybrid computing techniques.
Results of proposed variants of GASQP are compared with simulated annealing (SA), patternsearch (PS), Nelder–Mead (NM) and Levenberg–Marquardt (LM) algorithm. Results of SA, PS, NM and LM methods are determined using builtin functions in Matlab environment for all six problems of nonlinear system of equations. The mean fitness values based on 20 runs of the SA, PS, NM and LM approaches lies in the range 10^{−02} to 10^{−04}, 10^{−02} to 10^{−05}, 10^{−03} to 10^{−17} and 10^{−02} to 10^{−03}, respectively. It is clearly inferred that results of proposed GASQP algorithm is much superior from all four algorithm based on SA, PS, NM and LM methods in case of each problem.
Complexity analyses are conducted based on the values of three operators, i.e., mean execution time (MET), mean generations (MGENs), mean number of function evaluations (MFEs). Complexity operator MET, MGENs, and MFEs are defined as the average time consumed for training of weights, average generations executed and average number of functions executed for the algorithms, respectively. The values of MET MGENs, and MFEs based on 100 independent runs of each technique for all six case studies are tabulated in Table 13. It is seen from the results given in tables that there is no significant difference in value of complexity operators in case of all six problems., i.e., all the variant of GA the values of MET, MGEN and MFE operator are around 2.75 ± 0.75 s(s), 198 ± 2 and 6000 ± 30, respectively, while the memetic versions, the respective values three operators are around 25 ± 10 s(s), 600 ± 100 and 30,000 ± 9000. The shortest time taken from GA variants in GA6, while in case of hybrid computing approach GASQP12 take smallest time for learning of weights. All the calculations for the simulation studies are conducted on a Dell Inspiron mini laptop with a 1.33 GHz processor, 1.00 GB RAM, and running MATLAB version 2012b in Microsoft Windows XP environment.
To elaborate the performance of proposed schemes the analyses continues by defining the global operators based on mean fitness (MFit), truncated MFit (TMFit) global MET (GMET), global MGens (GMGens), and global MFEs (GMFEs). The term global stands for the average values calculated for a number of independent executions of algorithms. The values of global operators obtained from 100 independent runs of each algorithm are listed in Table 14 and these values are based on the overall performance of algorithms in case of all six problems. Small variations in the results are generally observed, however, on the basis of MFit values the performance of GA1 is the best, while in memetic versions, the performance of GASQP10 is superior from the rest. The values of global complexity operators GMET, GMGens and GMFEs are the best for GAQSP12, GASQP06, and GAQSP01 respectively. The complexity of the memetic computing approaches is a bit more than that of GAs variants but this aspect can be overshadowed due to their dominance of the performance in terms of accuracy and convergence.
Conclusions and future research directions
Conclusions are listed as follows:

Design of stochastic computational intelligence algorithms based on memetic computing using variants of GAs hybrid with SQP algorithm are developed in this study for solving systems of nonlinear equations arising in arithmetic benchmark, chemical equilibrium, neurophysiology, combustion theory, and economics models and proposed results established the accuracy, reliability and effectiveness.

Accuracy and convergence of the memetic computing GASQP are found better than that of GAs in case of simulation studies performed for all six problems.

Validation and verification of the performance of memetic algorithms are evaluated on the basis of statistical indicators in terms of the mean and standard deviations; which are calculated for 100 independent runs for all six nonlinear systems and small values of these indices show that proposed algorithms are consistent.

The correctness of the proposed schemes are examined further based on values of global performance indices, i.e., MFit, GMET, GMGens and GMFEs, and results show that all given schemes provide viable but the performance of GASQP4 is relatively better from the rest.

Computational complexity analyses of the proposed design scheme GASQP in terms of MET, MGens and MFEs values show that there is no prominent variation found in complexity operators. However, the complexity of the memetic computing approaches is on the higher side as compared with GAs but this factor can be overshadowed due to the superior performance of hybrid algorithms from the rest.

Beside the provision of reliable and viable solutions of nonlinear systems of equations other valuable advantages of the proposed schemes are simplicity of the approach, easily understandable methodologies, implementation ease, readily extendable to different applications and availability of the solutions without prior known initial bias guess.
Future research opening bases on present study are listed below:

Modern optimization solvers may play their significant role to enhance accuracy and convergence in solving nonlinear system of equations. Few recently introduced such schemes include fractional particle swarm optimization (PSO) algorithm, fractional Darwinian PSO, chaotic PSO, genetic programming, differential evolution, chaos optimization algorithms and gravitational search algorithms etc.

One should explore to extend the application of these variants of memetic algorithms to solve stiff nonlinear differential equation, differential–algebraic systems and integral equations by transforming into a system of nonlinear equations with the help of discretization process.
References
Abbasbandy S (2005) Extended Newton method for a system on non linear equations by modified domain decomposition method. J Appl Math Comput 170(648):656
AboHammour ZE, Alsmadi O, Momani S, Abu Arqub O (2013) A genetic algorithm approach for prediction of linear dynamical systems. Math Probl Eng 2013:12. doi:10.1155/2013/831657
AbuArqub O, AboHammour Z, Momani S (2014) Application of continuous genetic algorithm for nonlinear system of secondorder boundary value problems. Appl Math 8(1):235–248
Algabri M, Mathkour H, Hedjar R, Alsulaiman M, Al Mutib K (2014) Selflearning mobile robot navigation in unknown environment using evolutionary learning. J. UCS 20(10):1459–1468
AlZahrani AM, Mathkour H, Abdalla H (2015) PSObased feature selection for arabic text summarization. J Univ Comput Sci 21(11):1454–1469
Arqub OA, AboHammour Z (2014) Numerical solution of systems of secondorder boundary value problems using continuous genetic algorithm. Inf Sci 279:396–415
Baicher GS (2012) Realtime implementation of a class of optimised multirate quadrature mirror filter bank using genetic algorithms. J UCS 18(13):1871–1887
Broyden CG (1971) The convergence of an algorithm for solving sparse non linear systems. Math Comput 25:285–294
Campbell SL et al (1996) GMRES and the minimal polynomial. BIT Numer Math 36(4):664–675
Darvishi MT, Barati A (2007) A forth order method from quadrature formulae to solve the system of nonlinear equations. Appl Math Comput 188:257–261
de Soares RP (2013) Finding all real solutions of nonlinear systems of equations with discontinuities by a modified affine arithmetic. Comput Chem Eng 48:48–57
Elias S, Gokul V, Krithivasan K, Gheorghe M, Zhang G (2012) A variant of distributed p systems for real time cross layer optimization. J. UCS 18(13):1760–1781
Grosan C, Abraham A (2008a) Multiple solutions for a system of nonlinear equations. Int J Innov Comput Inf Control 4(9):2161–2170
Grosan C, Abraham A (2008b) A new approach for solving nonlinear equations systems. IEEE Trans Syst Man Cybern A Syst Hum 38(3):698–714
Hong H, Stahl V (1994) Safe starting regions by fixed points and tightening. Comput Sep 53(¾):323–335
Jafari H, Gejji VD (2006) Revised Adomian decomposition method for solving a system of nonlinear equation. J Appl Math Comput 175:1–7
Johnson P et al (2014) Genetic algorithm with logistic regression for prediction of progression to Alzheimer’s disease. BMC Bioinform 15(16):S11
Kelley CT (1999) Iterative methods for optimization, vol 18. SIAM, Philadelphia, USA
Kelley CT (2003) Solving nonlinear equations with Newton’s method, vol 1. SIAM, Philadelphia, USA
Khan JA, Raja MAZ, Syam MI, Tanoli SAK, Awan SE (2015) Design and application of nature inspired computing approach for nonlinear stiff oscillatory problems. Neural Comput Appl. doi:10.1007/s005210151841z
Knoll DA, Keyes DE (2004) Jacobian free Newton Krylov methods: a survey of approaches and applications. J Comput Phys 193:357–397
Kociecki M, Adeli H (2014) Twophase genetic algorithm for topology optimization of freeform steel spaceframe roof structures with complex curvatures. Eng Appl Artif Intell 32:218–227
Li X, Wen X, Gao L (2014) An effective genetic algorithm for multiobjective integrated process planning and scheduling with various flexibilities in process planning. J UCS 20(14):1926–1950
Li H, Ma J, Gong M, Jiang Q, Jiao L (2015) Change detection in synthetic aperture radar images based on evolutionary multiobjective optimization with ensemble learning. Memet Comput 7(4):275–289
Meintjes K, Morgan AP (1990) Chemical equilibrium systems as numerical test problems. ACM Trans Math Softw 16(2):143–151
Miettinen KP (1999) Preface ByNeittaanmaki. Evolutionary algorithms in engineering and computer science: recent advances in genetic algorithms, evolution strategies, evolutionary programming. Wiley, New York
Morgan AP (1987) Solving polynomial system using continuation for scientific and engineering problems. PrenticeHall, Englewood Cliffs
Nekkaa M, Boughaci D (2015) A memetic algorithm with support vector machine for feature selection and classification. Memet Comput 7(1):59–73
Ortega JM, Rheinboldt WC (1970) Iterative solution of nonlinear equations in several variables, vol 30. SIAM, Academic Press, New York, USA
Raja MAZ (2014a) Solution of the onedimensional Bratu equation arising in the fuel ignition model using ANN optimised with PSO and SQP. Connect Sci 26(3):195–214. doi:10.1080/09540091.2014.907555
Raja MAZ (2014b) Stochastic numerical techniques for solving Troesch’s Problem. Inf Sci 279:860–873. doi:10.1016/j.ins.2014.04.036
Raja MAZ, Samar R (2014) Numerical treatment for nonlinear MHD Jeffery–Hamel problem using neural networks optimized with interior point algorithm. Neurocomputing 124:178–193. doi:10.1016/j.neucom.2013.07.013
Raja MAZ, Khan JA, Qureshi IM (2011) Solution of fractional order system of BagleyTorvik equation using evolutionary computational intelligence. Math Probl Eng 2011:18. doi:10.1155/2011/675075
Raja MAZ, Khan JA, Haroon T (2014) Stochastic numerical treatment for thin film flow of third grade fluid using unsupervised neural networks. J Chem Inst Taiwan. doi:10.1016/j.jtice.2014.10.018
Raja MAZ, Khan JA, Behloul D, Haroon T, Siddiqui AM, Samar R (2015a) Exactly satisfying initial conditions neural network models for numerical treatment of first Painlevé equation. Appl Soft Comput 26:244–256. doi:10.1016/j.asoc.2014.10.009
Raja MAZ, Manzar MA, Samar R (2015b) An efficient computational intelligence approach for solving fractional order Riccati equations using ANN and SQP. Appl Math Model 39(10):3075–3093
Raja MAZ, Sabir Z, Mahmood N, Alaidarous ES, Khan JA (2015c) Design of stochastic solvers based on variants of genetic algorithms for solving nonlinear equations. Neural Comput Appl 26(1):1–23. doi:10.1007/s005210141676z
Raja MAZ, Samar R, Alaidarous ES, Shivanian E (2016) Bioinspired computing platform for reliable solution of Bratutype equations arising in the modeling of electrically conducting solids. Appl Math Model 40(11):5964–5977
Raja MAZ, Khan MAR, Mahmood T, Farooq U, Chaudhary NI (2016b) Design of bioinspired computing technique for nanofluidics based on nonlinear Jeffery–Hamel flow equations. Can J Phys 94(999):1–16
Saad Y, van der Vorst HA (2000) Iterative solution of non linear system in the 20th century. J Comput Appl Math 123:1–33
Sharma JR, Arora H (2014) An efficient family of weightedNewton methods with optimal eighth order convergence. Appl Math Lett 29:1–6
Sharma JR, Gupta P (2013) On some efficient techniques for solving systems of nonlinear equations. Adv Numer Anal 2013:11. doi:10.1155/2013/252798
Sharma JR, Gupta P (2014) An efficient fifth order method for solving systems of nonlinear equations. Comput Math Appl 67(3):591–601
Sharma JR, Guha RK, Gupta P (2013) Improved King’s methods with optimal order of convergence based on rational approximations. Appl Math Lett 26(4):473–480
Vahidi AR, Javadi Sh, Khorasani SM (2012) Solving system of nonlinear equations by restarted Adomain’s method. J Appl Math Comput 6:509–516
Van Hentenryck P, McAllester D, Kapur D (1997) Solving polynomial systems using a branch and prune approach. SIAM J Numer Anal 34(2):797–827
Verschelde J, Verlinden P, Cools R (1994) Homotopies exploiting Newton polytopes for solving sparse polynomial systems. SIAM J Numer Anal 31(3):915–930
Authors’ contributions
MAZR, AKK, AS, and AZ contributed towards the main idea, structure, organization of the article. The simulation works in Mathematica and Matlab software’s is carried out by MAZR and AS. MAZR, AKK, AS, and AZ contributed equally in the writeup of the paper and combining examples of their fields, while necessary reviews been carried out by AZ. All authors read and approved the final manuscript.
Acknowledgements
None.
Competing interests
The authors declare that they have no competing interests.
Availability of data and materials
The data and material is presented in the manuscript.
Consent for publication
All the authors agreed for publication.
Author information
Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Raja, M.A.Z., Kiani, A.K., Shehzad, A. et al. Memetic computing through bioinspired heuristics integration with sequential quadratic programming for nonlinear systems arising in different physical models. SpringerPlus 5, 2063 (2016). https://doi.org/10.1186/s4006401637508
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s4006401637508
Keywords
 Nonlinear systems
 Hybrid computing
 Genetic algorithms
 Sequential quadratic programming
 Nonlinear equations