attention.py File Reference

contain attention mechanisms More...

Classes
class	nabu.neuralnetworks.components.attention.BahdanauAttention
	normal Bahdanau Style attention More...
class	nabu.neuralnetworks.components.attention.LocationAwareAttention
	attention mechanism that is location aware More...
class	nabu.neuralnetworks.components.attention.WindowedAttention
	attention mechanism that is location aware More...

Functions
def	nabu.neuralnetworks.components.attention.factory (conf, num_units, encoded, encoded_seq_length)
	create the attention mechanism
def	nabu.neuralnetworks.components.attention.normalized_sigmoid (x, axis=-1)
	the normalized sigmoid probability function More...

Detailed Description

contain attention mechanisms

Function Documentation

normalized_sigmoid()

def nabu.neuralnetworks.components.attention.normalized_sigmoid	(		x,
			axis = -1
	)

the normalized sigmoid probability function

Parameters

x	the input tensor
axis	the axis to normalize

Returns

the normalize sigmoid output