deepnetts.net.train.opt

Class AdaDeltaOptimizer

java.lang.Object

deepnetts.net.train.opt.AdaDeltaOptimizer

All Implemented Interfaces:

Optimizer, TrainingListener, EventListener

public final class AdaDeltaOptimizer
extends Object
implements Optimizer, TrainingListener

Implementation of ADADELTA Optimizer which is a modification od AdaGrad that uses only a limited window or previous gradients.

Field Summary

Fields inherited from interface deepnetts.net.train.opt.Optimizer

COL_IDX, DEPTH_IDX, EPS, FOURTH_DIM_IDX, ROW_IDX

Constructor Summary

Constructors

Constructor and Description
AdaDeltaOptimizer(AbstractLayer layer)

Method Summary

Modifier and Type	Method and Description
float	calculateDeltaBias(float grad, int idx)
float	calculateDeltaWeight(float grad, int... idxs)
void	handleEvent(TrainingEvent event) Invoked when a training event occurs.
void	setLearningRate(float learningRate)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface deepnetts.net.train.opt.Optimizer

create

Constructor Detail

AdaDeltaOptimizer

public AdaDeltaOptimizer(AbstractLayer layer)

Method Detail

calculateDeltaWeight

public float calculateDeltaWeight(float grad,
                                  int... idxs)

Specified by:

calculateDeltaWeight in interface Optimizer

calculateDeltaBias

public float calculateDeltaBias(float grad,
                                int idx)

Specified by:

calculateDeltaBias in interface Optimizer

handleEvent

public void handleEvent(TrainingEvent event)

Description copied from interface: TrainingListener

Invoked when a training event occurs.

Specified by:

handleEvent in interface TrainingListener

Parameters:

event - the training event

setLearningRate

public void setLearningRate(float learningRate)

Specified by:

setLearningRate in interface Optimizer