Class ConvolutionalLayer

java.lang.Object

deepnetts.net.layers.AbstractLayer<TensorBase, TensorBase, Tensor4D>

deepnetts.net.layers.ConvolutionalLayer

All Implemented Interfaces:

Backward, Forward, Layer<TensorBase>, Serializable

public final class ConvolutionalLayer
extends AbstractLayer<TensorBase, TensorBase, Tensor4D>

Convolutional layer performs image convolution operation on outputs of a previous layer using filters. This filtering operation is similar like applying image filters in photoshop, but this filters can also be trained to learn image features of interest. Layer include parameters: filter's width, heigh Number of filters / depth Step when applying filters : stride Padding, which is an image border to keep the size of image and avoid information loss padding Stride defaults to 1

See Also:

• Serialized Form

Field Summary

Fields inherited from class AbstractLayer

activation, activationType, backwardImpl, batchMode, batchSize, biases, cudaHandles, deltaBiases, deltas, deltaWeights, depth, forwardImpl, gradients, height, inputs, learningRate, mode, momentum, networkType, nextLayer, numThreads, optimizer, optimizerType, outputs, prevDeltaBiases, prevDeltaWeights, prevLayer, randomWeightsType, regL1, regL2, threadPool, trainable, weights, width

Constructor Summary

Constructors

Constructor	Description
ConvolutionalLayer(int channels, int filterWidth, int filterHeight)	Create a new instance of convolutional layer with specified number of channels filter size, default padding (filter-1)/2, and default stride stride value 1, and specified number of channels.
ConvolutionalLayer(int channels, int filterWidth, int filterHeight, int stride, ActivationType activationType)
ConvolutionalLayer(int channels, Filter filter)
ConvolutionalLayer(int channels, Filter filter, ActivationType activationType)

Method Summary

Modifier and Type	Method	Description
void	applyWeightChanges()	Apply weight changes calculated in backward pass
void	backward()	Backward pass for convolutional layer tweaks the weights in filters.
void	createFilterCache()
void	forward()	Forward pass for convolutional layer.
TensorBase	getFilterDeltaWeights()
int	getFilterDepth()
int	getFilterHeight()
TensorBase	getFilters()
int	getFilterWidth()
float	getL1WeightSum()
float	getL2WeightSum()
int	getPadding()
int	getStride()
Tensor4D	getWeights()
void	init()	Initialize dimensions, create output tensors, filters/weights, biases and all internal structures etc.
void	initTransientFields()
void	setFilters(Tensor4D filters)
void	setFilters(String filtersStr)
void	setWeights(Tensor4D weights)
String	toString()

Methods inherited from class AbstractLayer

getActivation, getActivationType, getBackwardAcc, getBatchSize, getBiases, getDeltaBiases, getDeltas, getDeltaWeights, getDepth, getForwardAcc, getGradients, getHeight, getL1Regularization, getL2Regularization, getLearningRate, getMode, getMomentum, getNetworkType, getNextLayer, getNumThreads, getOptimizer, getOptimizerType, getOutputs, getPrevDeltaBiases, getPrevDeltaWeights, getPrevlayer, getWidth, isBatchMode, isTrainable, setActivationType, setBatchMode, setBatchSize, setBiases, setCudaHandles, setDeltas, setL1Regularization, setL2Regularization, setLearningRate, setMode, setMomentum, setNetworkType, setNextlayer, setOptimizerType, setOutputs, setPrevDeltaWeights, setPrevLayer, setThreadPool, setTrainable, setWeights

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Details

ConvolutionalLayer

public ConvolutionalLayer(int channels,
 int filterWidth,
 int filterHeight)

Create a new instance of convolutional layer with specified number of channels filter size, default padding (filter-1)/2, and default stride stride value 1, and specified number of channels. Uses Linear activation function by default.

Parameters:

channels - number of channels which corresponds to the number of image pixel feature that you want to learn and detect

filterWidth -

filterHeight -

ConvolutionalLayer

public ConvolutionalLayer(int channels,
 Filter filter)

ConvolutionalLayer

public ConvolutionalLayer(int channels,
 Filter filter,
 ActivationType activationType)

ConvolutionalLayer

public ConvolutionalLayer(int channels,
 int filterWidth,
 int filterHeight,
 int stride,
 ActivationType activationType)

Method Details

init

public void init()

Initialize dimensions, create output tensors, filters/weights, biases and all internal structures etc. Assumes that prevLayer is set in network builder

Specified by:

init in class AbstractLayer<TensorBase, TensorBase, Tensor4D>

initTransientFields

public void initTransientFields()

Overrides:

initTransientFields in class AbstractLayer<TensorBase, TensorBase, Tensor4D>

forward

public void forward()

Forward pass for convolutional layer. Performs convolution operation on inputs (output from previous layer) using filters in this layer, on all channels. Each channel from prev layer has its own filter (3D filter), and every channel in this layer has its 3D filter used to scan all channels in prev layer. Previous layers can be: Input, MaxPooling or Convolutional. For more about convolution see http://www.songho.ca/dsp/convolution/convolution.html

Specified by:

forward in interface Forward

Specified by:

forward in interface Layer<TensorBase>

Specified by:

forward in class AbstractLayer<TensorBase, TensorBase, Tensor4D>

createFilterCache

public void createFilterCache()

backward

public void backward()

Backward pass for convolutional layer tweaks the weights in filters. Next layer can be: FC, MaxPooling, Conv, (output same as FC), 1D or 3D Prev layer can: Input, pool, conv, all 2D or 3D - all can be as generalized 3D U 2 koraka: 1. povuci delte iz sledeceg lejera, i izracunaj tezinsku sumu delta za sve neurone/outpute u ovom sloju 2. izracunaj promene tezina za sve veze iz prethodnog lejera za svaki neuron/output u ovom sloju

Specified by:

backward in interface Backward

Specified by:

backward in interface Layer<TensorBase>

Specified by:

backward in class AbstractLayer<TensorBase, TensorBase, Tensor4D>

applyWeightChanges

public void applyWeightChanges()

Apply weight changes calculated in backward pass

Specified by:

applyWeightChanges in class AbstractLayer<TensorBase, TensorBase, Tensor4D>

getFilters

public TensorBase getFilters()

getWeights

public Tensor4D getWeights()

Overrides:

getWeights in class AbstractLayer<TensorBase, TensorBase, Tensor4D>

setWeights

public void setWeights(Tensor4D weights)

Overrides:

setWeights in class AbstractLayer<TensorBase, TensorBase, Tensor4D>

setFilters

public void setFilters(Tensor4D filters)

setFilters

public void setFilters(String filtersStr)

getFilterWidth

public int getFilterWidth()

getFilterHeight

public int getFilterHeight()

getFilterDepth

public int getFilterDepth()

getStride

public int getStride()

getPadding

public int getPadding()

getFilterDeltaWeights

public TensorBase getFilterDeltaWeights()

getL1WeightSum

public float getL1WeightSum()

Overrides:

getL1WeightSum in class AbstractLayer<TensorBase, TensorBase, Tensor4D>

getL2WeightSum

public float getL2WeightSum()

Overrides:

getL2WeightSum in class AbstractLayer<TensorBase, TensorBase, Tensor4D>

toString

public String toString()

Overrides:

toString in class Object