ROL
|
Provides an interface to run the trust-region algorithm. More...
#include <ROL_TypeB_TrustRegionSPGAlgorithm.hpp>
Public Member Functions | |
TrustRegionSPGAlgorithm (ParameterList &list, const Ptr< Secant< Real >> &secant=nullPtr) | |
void | run (Vector< Real > &x, const Vector< Real > &g, Objective< Real > &obj, BoundConstraint< Real > &bnd, std::ostream &outStream=std::cout) override |
Run algorithm on bound constrained problems (Type-B). This general interface supports the use of dual optimization vector spaces, where the user does not define the dual() method. More... | |
void | writeHeader (std::ostream &os) const override |
Print iterate header. More... | |
void | writeName (std::ostream &os) const override |
Print step name. More... | |
void | writeOutput (std::ostream &os, const bool write_header=false) const override |
Print iterate status. More... | |
Public Member Functions inherited from ROL::TypeB::Algorithm< Real > | |
virtual | ~Algorithm () |
Algorithm () | |
Constructor, given a step and a status test. More... | |
void | setStatusTest (const Ptr< StatusTest< Real >> &status, const bool combineStatus=false) |
virtual void | run (Problem< Real > &problem, std::ostream &outStream=std::cout) |
Run algorithm on bound constrained problems (Type-B). This is the primary Type-B interface. More... | |
virtual void | run (Vector< Real > &x, Objective< Real > &obj, BoundConstraint< Real > &bnd, std::ostream &outStream=std::cout) |
Run algorithm on bound constrained problems (Type-B). This is the primary Type-B interface. More... | |
virtual void | run (Vector< Real > &x, Objective< Real > &obj, BoundConstraint< Real > &bnd, Constraint< Real > &linear_econ, Vector< Real > &linear_emul, std::ostream &outStream=std::cout) |
Run algorithm on bound constrained problems with explicit linear constraints (Type-B). This is the primary Type-B with explicit linear constraints interface. More... | |
virtual void | run (Vector< Real > &x, const Vector< Real > &g, Objective< Real > &obj, BoundConstraint< Real > &bnd, Constraint< Real > &linear_econ, Vector< Real > &linear_emul, const Vector< Real > &linear_eres, std::ostream &outStream=std::cout) |
Run algorithm on bound constrained problems with explicit linear constraints (Type-B). This general interface supports the use of dual optimization vector spaces, where the user does not define the dual() method. More... | |
virtual void | run (Vector< Real > &x, Objective< Real > &obj, BoundConstraint< Real > &bnd, Constraint< Real > &linear_icon, Vector< Real > &linear_imul, BoundConstraint< Real > &linear_ibnd, std::ostream &outStream=std::cout) |
Run algorithm on bound constrained problems with explicit linear constraints (Type-B). This is the primary Type-B with explicit linear constraints interface. More... | |
virtual void | run (Vector< Real > &x, const Vector< Real > &g, Objective< Real > &obj, BoundConstraint< Real > &bnd, Constraint< Real > &linear_icon, Vector< Real > &linear_imul, BoundConstraint< Real > &linear_ibnd, const Vector< Real > &linear_ires, std::ostream &outStream=std::cout) |
Run algorithm on bound constrained problems with explicit linear constraints (Type-B). This general interface supports the use of dual optimization vector spaces, where the user does not define the dual() method. More... | |
virtual void | run (Vector< Real > &x, Objective< Real > &obj, BoundConstraint< Real > &bnd, Constraint< Real > &linear_econ, Vector< Real > &linear_emul, Constraint< Real > &linear_icon, Vector< Real > &linear_imul, BoundConstraint< Real > &linear_ibnd, std::ostream &outStream=std::cout) |
Run algorithm on bound constrained problems with explicit linear constraints (Type-B). This is the primary Type-B with explicit linear constraints interface. More... | |
virtual void | run (Vector< Real > &x, const Vector< Real > &g, Objective< Real > &obj, BoundConstraint< Real > &bnd, Constraint< Real > &linear_econ, Vector< Real > &linear_emul, const Vector< Real > &linear_eres, Constraint< Real > &linear_icon, Vector< Real > &linear_imul, BoundConstraint< Real > &linear_ibnd, const Vector< Real > &linear_ires, std::ostream &outStream=std::cout) |
Run algorithm on bound constrained problems with explicit linear constraints (Type-B). This general interface supports the use of dual optimization vector spaces, where the user does not define the dual() method. More... | |
virtual void | writeExitStatus (std::ostream &os) const |
Ptr< const AlgorithmState< Real > > | getState () const |
void | reset () |
Private Member Functions | |
void | initialize (Vector< Real > &x, const Vector< Real > &g, Real ftol, Objective< Real > &obj, BoundConstraint< Real > &bnd, std::ostream &outStream=std::cout) |
Real | computeValue (Real inTol, Real &outTol, Real pRed, Real &fold, int iter, const Vector< Real > &x, const Vector< Real > &xold, Objective< Real > &obj) |
void | computeGradient (const Vector< Real > &x, Vector< Real > &g, Vector< Real > &pwa, Real del, Objective< Real > &obj, bool accept, Real >ol, Real &gnorm, std::ostream &outStream=std::cout) const |
Real | dgpstep (Vector< Real > &s, const Vector< Real > &w, const Vector< Real > &x, const Real alpha, std::ostream &outStream=std::cout) const |
Real | dcauchy (Vector< Real > &s, Real &alpha, Real &q, const Vector< Real > &x, const Vector< Real > &g, const Real del, TrustRegionModel_U< Real > &model, Vector< Real > &dwa, Vector< Real > &dwa1, std::ostream &outStream=std::cout) |
void | dpsg_simple (Vector< Real > &y, Real &q, Vector< Real > &gmod, const Vector< Real > &x, Real del, TrustRegionModel_U< Real > &model, Vector< Real > &pwa, Vector< Real > &pwa1, Vector< Real > &dwa, std::ostream &outStream=std::cout) |
void | dpsg (Vector< Real > &y, Real &q, Vector< Real > &gmod, const Vector< Real > &x, Real del, TrustRegionModel_U< Real > &model, Vector< Real > &ymin, Vector< Real > &pwa, Vector< Real > &pwa1, Vector< Real > &pwa2, Vector< Real > &pwa3, Vector< Real > &pwa4, Vector< Real > &pwa5, Vector< Real > &dwa, std::ostream &outStream=std::cout) |
void | dproj (Vector< Real > &x, const Vector< Real > &x0, Real del, Vector< Real > &y0, Vector< Real > &y1, Vector< Real > &yc, Vector< Real > &pwa, std::ostream &outStream=std::cout) const |
Private Attributes | |
Ptr< TrustRegionModel_U< Real > > | model_ |
Container for trust-region model. More... | |
Real | delMax_ |
Maximum trust-region radius (default: ROL_INF) More... | |
Real | eta0_ |
Step acceptance threshold (default: 0.05) More... | |
Real | eta1_ |
Radius decrease threshold (default: 0.05) More... | |
Real | eta2_ |
Radius increase threshold (default: 0.9) More... | |
Real | gamma0_ |
Radius decrease rate (negative rho) (default: 0.0625) More... | |
Real | gamma1_ |
Radius decrease rate (positive rho) (default: 0.25) More... | |
Real | gamma2_ |
Radius increase rate (default: 2.5) More... | |
Real | TRsafe_ |
Safeguard size for numerically evaluating ratio (default: 1e2) More... | |
Real | eps_ |
Safeguard for numerically evaluating ratio. More... | |
bool | interpRad_ |
Interpolate the trust-region radius if ratio is negative (default: false) More... | |
TRUtils::ETRFlag | TRflag_ |
Trust-region exit flag. More... | |
int | SPflag_ |
Subproblem solver termination flag. More... | |
int | SPiter_ |
Subproblem solver iteration count. More... | |
ESecant | esec_ |
Secant type (default: Limited-Memory BFGS) More... | |
bool | useSecantPrecond_ |
Flag to use secant as a preconditioner (default: false) More... | |
bool | useSecantHessVec_ |
Flag to use secant as Hessian (default: false) More... | |
Real | tol1_ |
Absolute tolerance for truncated CG (default: 1e-4) More... | |
Real | tol2_ |
Relative tolerance for truncated CG (default: 1e-2) More... | |
int | maxit_ |
Maximum number of CG iterations (default: 25) More... | |
bool | useNM_ |
int | storageNM_ |
Real | mu0_ |
Sufficient decrease parameter (default: 1e-2) More... | |
Real | spexp_ |
Relative tolerance exponent for subproblem solve (default: 1, range: [1,2]) More... | |
int | redlim_ |
Maximum number of Cauchy point reduction steps (default: 10) More... | |
int | explim_ |
Maximum number of Cauchy point expansion steps (default: 10) More... | |
Real | alpha_ |
Initial Cauchy point step length (default: 1.0) More... | |
bool | normAlpha_ |
Normalize initial Cauchy point step length (default: false) More... | |
Real | interpf_ |
Backtracking rate for Cauchy point computation (default: 1e-1) More... | |
Real | extrapf_ |
Extrapolation rate for Cauchy point computation (default: 1e1) More... | |
Real | qtol_ |
Relative tolerance for computed decrease in Cauchy point computation (default: 1-8) More... | |
Real | lambdaMin_ |
Real | lambdaMax_ |
Real | gamma_ |
int | maxSize_ |
bool | useMin_ |
bool | useNMSP_ |
bool | useSimpleSPG_ |
std::vector< bool > | useInexact_ |
Real | scale0_ |
Real | scale1_ |
Real | scale_ |
Real | omega_ |
Real | force_ |
int | updateIter_ |
Real | forceFactor_ |
Real | gtol_ |
int | nhess_ |
Number of Hessian applications. More... | |
unsigned | verbosity_ |
Output level (default: 0) More... | |
bool | writeHeader_ |
Flag to write header at every iteration. More... | |
Additional Inherited Members | |
Protected Member Functions inherited from ROL::TypeB::Algorithm< Real > | |
void | initialize (const Vector< Real > &x, const Vector< Real > &g) |
Real | optimalityCriterion (const Vector< Real > &x, const Vector< Real > &g, Vector< Real > &primal, std::ostream &outStream=std::cout) const |
Protected Attributes inherited from ROL::TypeB::Algorithm< Real > | |
const Ptr< CombinedStatusTest < Real > > | status_ |
const Ptr< AlgorithmState< Real > > | state_ |
Ptr< PolyhedralProjection< Real > > | proj_ |
Provides an interface to run the trust-region algorithm.
Definition at line 59 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
ROL::TypeB::TrustRegionSPGAlgorithm< Real >::TrustRegionSPGAlgorithm | ( | ParameterList & | list, |
const Ptr< Secant< Real >> & | secant = nullPtr |
||
) |
Definition at line 53 of file ROL_TypeB_TrustRegionSPGAlgorithm_Def.hpp.
References ROL::SECANTMODE_BOTH, ROL::SECANTMODE_FORWARD, ROL::SECANTMODE_INVERSE, and ROL::StringToESecant().
|
overridevirtual |
Run algorithm on bound constrained problems (Type-B). This general interface supports the use of dual optimization vector spaces, where the user does not define the dual() method.
Implements ROL::TypeB::Algorithm< Real >.
Definition at line 222 of file ROL_TypeB_TrustRegionSPGAlgorithm_Def.hpp.
References ROL::Accept, ROL::Vector< Real >::clone(), ROL::TRUtils::NPOSPREDNEG, ROL::Vector< Real >::plus(), ROL::TRUtils::POSPREDNEG, ROL::Revert, ROL::Vector< Real >::set(), ROL::TRUtils::SUCCESS, ROL::TRUtils::TRNAN, ROL::Objective< Real >::update(), ROL::TypeB::Algorithm< Real >::writeExitStatus(), and zero.
|
overridevirtual |
Print iterate header.
Reimplemented from ROL::TypeB::Algorithm< Real >.
Definition at line 921 of file ROL_TypeB_TrustRegionSPGAlgorithm_Def.hpp.
References ROL::TRUtils::ETRFlagToString(), ROL::NumberToString(), ROL::TRUtils::SUCCESS, and ROL::TRUtils::UNDEFINED.
|
overridevirtual |
Print step name.
Reimplemented from ROL::TypeB::Algorithm< Real >.
Definition at line 966 of file ROL_TypeB_TrustRegionSPGAlgorithm_Def.hpp.
|
overridevirtual |
Print iterate status.
Reimplemented from ROL::TypeB::Algorithm< Real >.
Definition at line 973 of file ROL_TypeB_TrustRegionSPGAlgorithm_Def.hpp.
|
private |
Definition at line 133 of file ROL_TypeB_TrustRegionSPGAlgorithm_Def.hpp.
References ROL::Initial, ROL::TypeB::Algorithm< Real >::initialize(), ROL::Objective< Real >::update(), and ROL::Objective< Real >::value().
|
private |
Definition at line 168 of file ROL_TypeB_TrustRegionSPGAlgorithm_Def.hpp.
References ROL::Trial, ROL::Objective< Real >::update(), and ROL::Objective< Real >::value().
|
private |
Definition at line 191 of file ROL_TypeB_TrustRegionSPGAlgorithm_Def.hpp.
References ROL::Objective< Real >::gradient(), and ROL::TypeB::Algorithm< Real >::optimalityCriterion().
|
private |
Definition at line 342 of file ROL_TypeB_TrustRegionSPGAlgorithm_Def.hpp.
References ROL::Vector< Real >::axpy(), ROL::Vector< Real >::norm(), and ROL::Vector< Real >::set().
|
private |
Definition at line 352 of file ROL_TypeB_TrustRegionSPGAlgorithm_Def.hpp.
References ROL::Vector< Real >::apply(), ROL::Vector< Real >::dot(), ROL::TrustRegionModel_U< Real >::hessVec(), and ROL::Vector< Real >::set().
|
private |
Definition at line 441 of file ROL_TypeB_TrustRegionSPGAlgorithm_Def.hpp.
References ROL::Vector< Real >::apply(), ROL::Vector< Real >::axpy(), ROL::Vector< Real >::dot(), ROL::Vector< Real >::dual(), ROL::TrustRegionModel_U< Real >::hessVec(), ROL::Vector< Real >::norm(), ROL::Vector< Real >::set(), and ROL::Vector< Real >::zero().
|
private |
Definition at line 540 of file ROL_TypeB_TrustRegionSPGAlgorithm_Def.hpp.
References ROL::Vector< Real >::apply(), ROL::Vector< Real >::axpy(), ROL::Vector< Real >::dot(), ROL::Vector< Real >::dual(), ROL::TrustRegionModel_U< Real >::hessVec(), ROL::Vector< Real >::norm(), ROL::Vector< Real >::set(), and zero.
|
private |
Definition at line 652 of file ROL_TypeB_TrustRegionSPGAlgorithm_Def.hpp.
References ROL::Vector< Real >::axpy(), ROL::Vector< Real >::norm(), ROL::Vector< Real >::scale(), ROL::Vector< Real >::set(), and zero.
|
private |
Container for trust-region model.
Definition at line 61 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Maximum trust-region radius (default: ROL_INF)
Definition at line 64 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Step acceptance threshold (default: 0.05)
Definition at line 65 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Radius decrease threshold (default: 0.05)
Definition at line 66 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Radius increase threshold (default: 0.9)
Definition at line 67 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Radius decrease rate (negative rho) (default: 0.0625)
Definition at line 68 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Radius decrease rate (positive rho) (default: 0.25)
Definition at line 69 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Radius increase rate (default: 2.5)
Definition at line 70 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Safeguard size for numerically evaluating ratio (default: 1e2)
Definition at line 71 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Safeguard for numerically evaluating ratio.
Definition at line 72 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Interpolate the trust-region radius if ratio is negative (default: false)
Definition at line 73 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Trust-region exit flag.
Definition at line 76 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Subproblem solver termination flag.
Definition at line 77 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Subproblem solver iteration count.
Definition at line 78 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Secant type (default: Limited-Memory BFGS)
Definition at line 81 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Flag to use secant as a preconditioner (default: false)
Definition at line 82 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Flag to use secant as Hessian (default: false)
Definition at line 83 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Absolute tolerance for truncated CG (default: 1e-4)
Definition at line 86 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Relative tolerance for truncated CG (default: 1e-2)
Definition at line 87 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Maximum number of CG iterations (default: 25)
Definition at line 88 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Definition at line 91 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Definition at line 92 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Sufficient decrease parameter (default: 1e-2)
Definition at line 93 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Relative tolerance exponent for subproblem solve (default: 1, range: [1,2])
Definition at line 94 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Maximum number of Cauchy point reduction steps (default: 10)
Definition at line 95 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Maximum number of Cauchy point expansion steps (default: 10)
Definition at line 96 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Initial Cauchy point step length (default: 1.0)
Definition at line 97 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Normalize initial Cauchy point step length (default: false)
Definition at line 98 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Backtracking rate for Cauchy point computation (default: 1e-1)
Definition at line 99 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Extrapolation rate for Cauchy point computation (default: 1e1)
Definition at line 100 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Relative tolerance for computed decrease in Cauchy point computation (default: 1-8)
Definition at line 101 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Definition at line 102 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Definition at line 103 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Definition at line 104 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Definition at line 105 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Definition at line 106 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Definition at line 107 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Definition at line 108 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Definition at line 111 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Definition at line 112 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Definition at line 113 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Definition at line 114 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Definition at line 115 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Definition at line 116 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Definition at line 117 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Definition at line 118 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Definition at line 119 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
mutableprivate |
Number of Hessian applications.
Definition at line 121 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Output level (default: 0)
Definition at line 122 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.
|
private |
Flag to write header at every iteration.
Definition at line 123 of file ROL_TypeB_TrustRegionSPGAlgorithm.hpp.