Non-monotone Trust Region Method Combined with Wolfe Line Search Strategy for Unconstrained Optimization
International Journal of Recent Engineering Science (IJRES) | |
|
© 2015 by IJRES Journal | ||
Volume-2 Issue-5 |
||
Year of Publication : 2015 | ||
Authors : Changyuan Li, Qinghua Zhou, Xiao Wu |
||
DOI : 10.14445/23497157/IJRES-V2I5P101 |
How to Cite?
Changyuan Li, Qinghua Zhou, Xiao Wu, "Non-monotone Trust Region Method Combined with Wolfe Line Search Strategy for Unconstrained Optimization," International Journal of Recent Engineering Science, vol. 2, no. 5, pp. 1-7, 2015. Crossref, https://doi.org/10.14445/23497157/IJRES-V2I5P101
Abstract
In this paper, we propose and analyze a new trust region algorithm for unconstrained optimization problems which is combining a new non-monotone trust region method with non-monotone Wolfe line search technique. The new algorithm solves the trust region sub-problem only once at each iteration. The global convergence of the new algorithm is proved under some mild conditions.
Keywords
unconstrained optimization, non-monotone trust region method, non-monotone Wolfe line search, global convergence
Reference
[1] J. Nocedal, Y.X. Yuan, Combining trust region and line search techniques, in: Y. Yuan (Ed.), Advanced in nonlinear programming, Kluwer Academic Publishers, Dordrecht, 1998, pp. 153-175.
[2] E. Michael Gertz, A quasi-Newton trust region method, Math programming, 2004, 100(3): 447-470.
[3] R.M. Chamberlain, M.J.D. Powell, The watchdog technique for forcing convergence in algorithm for constrained optimization, Mathematical Programming Study 16 (1982) 1-17.
[4] L. Grippo, F. Lampariello, S. Lucidi, A nonmonotone line search technique for Newton's method, Society for Industrial and Applied Mathematics 23 (1986) 707-716.
[5] N.Y. Deng, Y. Xiao and F.J. Zhou, Nonmonotone trust region algorithm, Journal of Optimization Theory and Application 76 (1993) 259-285.
[6] L. Grippo, F. Lampariello, S. Lucidi, A truncated Newton method with nonmonotone line search technique for unconstrained optimization, J. Optim, Theory Appl.60(1989)401-419.
[7] Ph.L. Toint, An assessment of nonmonotone linesearch technique for unconstrained optimization, Society for Industrial and Applied Mathematics, 17 (1996) 725-739.
[8] Ph. L. Toint, Non-monotone trust-region algorithm for nonlinear optimization subject to convex constraints, Mathmatical Programming 77 (1997) 69-94.
[9] W.Y. Sun, Nonmonotone trust region method for solving optimization problems, Applied Mathematics and Computation 156 (2004) 159-174.
[10] J.T. Mo, K.C. Zhang, Z.X. Wei, A nonmonotone trust region method for unconstrained optimization, Applied Mathematics and Computation 171(2005) 371-384.
[11] M. Ahookhosh, K. Amini, An efficient nonmonotone trust-region method for unconstrained optimization, Numer Algor(2012) 59: 523-540.
[12] S. Huang, Z. Wan, X.H. Chen, A new nonmonotone line search technique for unconstrained optimization, Numer Algor (2015) 68: 671–689.
[13] H.C. Zhang, W.W. Hager, A nonmonotone line search technique and its application to unconstrained optimization, SIAM J. Optim. 14 (4) (2004) 1043-1056.
[14] N.Z. Gu, J.T. Mo, Incorporating nonmonotone strategies into the trust region for unconstrained optimization, Computers and Mathematics with Applications 55 (2008) 2158–2172.
[15] J.T. Mo, C. L, S.C. Yan, A nonmonotone trust region method with fixed stepsize, Journal of Qufu Normal University Vol. 32, No. 3 (2006) 30-34.
[16] C.Y. Li, Q.H. Zhou, A new non-monotone trust region method with fixed step-size for unconstrained optimization, Scholars Journal of Engineering and Technology(2015) 3(5A): 529-534.