LearningRateType enum

A type of learning rate strategies

Inheritance

Constructors

LearningRateType()
const

Values

decreasingAdaptive → const LearningRateType
constant → const LearningRateType

Learning rate value will be constant throughout the whole fitting process

timeBased → const LearningRateType

Learning rate value will be calculated according to the formula:

[\bg_white \eta_{n + 1}= \frac{\eta _{n}}{1+dn}]

where:

[\bg_white \eta_{n + 1}] is the learning rate value for a new iteration

[\bg_white \eta_{n}] is the learning rate value from a previous iteration

[\bg_white d] is the decay parameter

[\bg_white n] is the iteration step

stepBased → const LearningRateType

Learning rate value will be calculated according to the formula:

[\bg_white \eta_{n}= \eta {0}d^{floor(\frac{1 + n}{r})} \eta{n}]

where:

[\bg_white \eta_{n}] is the new learning rate value

[\bg_white \eta_{0}] is the initial learning rate value

[\bg_white d] is the decay parameter (in the context of step-based strategy, it describes, how much the learning rate should change at each drop, e.g. 0.5 means a halving)

[\bg_white n] is the iteration step

[\bg_white r] is the drop rate (how often the learning rate value should be dropped, r=5 means the rate will be dropped every 5 iterations)

exponential → const LearningRateType

Learning rate value will be calculated according to the formula:

[\bg_white \eta_{n}=\eta_{0}e^{-dn}]

where:

[\bg_white \eta_{n}] is the new learning rate value

[\bg_white \eta_{0}] is the initial learning rate value

[\bg_white d] is the decay parameter

[\bg_white n] is the iteration step

Properties

hashCode → int
The hash code for this object.
no setterinherited
index → int
A numeric identifier for the enumerated value.
no setterinherited
runtimeType → Type
A representation of the runtime type of the object.
no setterinherited

Methods

noSuchMethod(Invocation invocation) → dynamic
Invoked when a nonexistent method or property is accessed.
inherited
toString() → String
A string representation of this object.
inherited

Operators

operator ==(Object other) → bool
The equality operator.
inherited

Constants

values → const List<LearningRateType>
A constant List of the values in this enum, in order of their declaration.