Package deepnetts.net.train.opt

Class AdamOptimizer

java.lang.Object

deepnetts.net.train.opt.AdamOptimizer

All Implemented Interfaces:

Optimizer, TrainingListener, Serializable, EventListener

public final class AdamOptimizer
extends Object
implements Serializable, Optimizer, TrainingListener

Implementation of Adam optimizer which is a variation of RmsProp which includes momentum-like factor.

Author:

Zoran Sevarac

See Also:

• Serialized Form

Field Summary

Fields inherited from interface deepnetts.net.train.opt.Optimizer

COL_IDX, DEPTH_IDX, EPS, FOURTH_DIM_IDX, ROW_IDX

Constructor Summary

Constructors

Constructor	Description
AdamOptimizer(AbstractLayer layer)

Method Summary

Modifier and Type	Method	Description
float	calculateDeltaBias(float grad, int idx)
float	calculateDeltaWeight(float grad, int... idxs)
void	handleEvent(TrainingEvent event)	Invoked when a training event occurs.
void	setLearningRate(float learningRate)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

AdamOptimizer

public AdamOptimizer(AbstractLayer layer)

Method Details

calculateDeltaWeight

public float calculateDeltaWeight(float grad,
 int... idxs)

Specified by:

calculateDeltaWeight in interface Optimizer

calculateDeltaBias

public float calculateDeltaBias(float grad,
 int idx)

Specified by:

calculateDeltaBias in interface Optimizer

handleEvent

public void handleEvent(TrainingEvent event)

Description copied from interface: TrainingListener

Invoked when a training event occurs.

Specified by:

handleEvent in interface TrainingListener

Parameters:

event - the training event

setLearningRate

public void setLearningRate(float learningRate)

Specified by:

setLearningRate in interface Optimizer