Title: Implicit extra-update multi-step quasi-Newton methods

Authors: Issam A.R. Moghrabi

Addresses: M.I.S. Department, College of Business Administration, Gulf University for Science and Technology (GUST), P.O. Box 7207, Hawally 32093, Kuwait

Abstract: A new approach to the implicit update multi-step methods, introduced earlier by Ford and Tharmlikit (2003) and Moghrabi (2009), is addressed in this paper. Two algorithms are developed. One of the algorithms proposes a method that uses exact quantities in doing the update that are computed cheaply rather than relying on crude approximations, as is the case in the work of Ford (2001), Ford and Tharmlikit (2003) and Moghrabi (2009). The other method introduced here exploits El-Baali's (1999) extra update technique and is motivated by the improvements achieved by the application of such methods to the minimisation of nonlinear unconstrained problems. The implicit extra updates idea performs, on iterative basis, implicit updates to the Hessian approximation multiple times at each iteration. The updates are intended to be performed cheaply prior to updating the actual Hessian approximation at each iteration. The implicitly updated matrix serves as a metric for measuring distances among recent iterates, as required in the multistep Methods developed by Ford and Moghrabi (1993, 1994). The method displays numerical merits and motivates promising further investigation.

Keywords: unconstrained optimisation: quasi-Newton methods; multi-step updates; extra updates; Hessian approximation; implicit update.

DOI: 10.1504/IJOR.2017.081472

International Journal of Operational Research, 2017 Vol.28 No.2, pp.216 - 228

Received: 01 Aug 2014
Accepted: 23 Mar 2015
Published online: 10 Jan 2017 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article