deepnetts.net.layers

Class SoftmaxOutputLayer

java.lang.Object

deepnetts.net.layers.AbstractLayer

deepnetts.net.layers.OutputLayer

deepnetts.net.layers.SoftmaxOutputLayer

All Implemented Interfaces:

Layer, Serializable

public class SoftmaxOutputLayer
extends OutputLayer

Output layer with softmax activation function.

Author:

Zoran Sevarac

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
SoftmaxOutputLayer(int width)

Method Summary

Modifier and Type	Method and Description
void	backward() This method implements backward pass for the output layer.
void	forward() This method implements forward pass for the output layer.
void	init() This method should implement layer initialization in subclasses, when a layer is added to the network (create weights, outputs, deltas, randomization etc.).
void	initTransientFields()

Methods inherited from class deepnetts.net.layers.OutputLayer

applyWeightChanges, getLossType, getOutputErrors, getSingleOutInput, setLossType, setOutputErrors, toString

Methods inherited from class deepnetts.net.layers.AbstractLayer

getActivation, getActivationType, getBatchSize, getBiases, getDeltaBiases, getDeltas, getDeltaWeights, getDepth, getGradients, getHeight, getL1Regularization, getL1WeightSum, getL2Regularization, getL2WeightSum, getLearningRate, getMomentum, getNextLayer, getOptimizer, getOptimizerType, getOutputs, getPrevDeltaBiases, getPrevDeltaWeights, getPrevlayer, getWeights, getWidth, isBatchMode, isTrainable, setBatchMode, setBatchSize, setBiases, setDeltas, setL1Regularization, setL2Regularization, setLearningRate, setMomentum, setNextlayer, setOptimizerType, setOutputs, setPrevDeltaWeights, setPrevLayer, setTrainable, setWeights, setWeights

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

SoftmaxOutputLayer

public SoftmaxOutputLayer(int width)

Method Detail

init

public void init()

Description copied from class: AbstractLayer

This method should implement layer initialization in subclasses, when a layer is added to the network (create weights, outputs, deltas, randomization etc.).

Overrides:

init in class OutputLayer

initTransientFields

public void initTransientFields()

Overrides:

initTransientFields in class AbstractLayer

forward

public void forward()

This method implements forward pass for the output layer. Calculates layer outputs using softmax function

Specified by:

forward in interface Layer

Overrides:

forward in class OutputLayer

backward

public void backward()

Description copied from class: OutputLayer

This method implements backward pass for the output layer. http://peterroelants.github.io/posts/neural_network_implementation_intermezzo01/ http://neuralnetworksanddeeplearning.com/chap3.html#introducing_the_cross-entropy_cost_function

Specified by:

backward in interface Layer

Overrides:

backward in class OutputLayer