Activation Functions¶

Activation layer modules.

class taktiny.nn.ActivationBase[source]¶

Bases: Module

Base class for activation functions.

class taktiny.nn.ELU[source]¶

Bases: ActivationBase

ELU activation function.

class taktiny.nn.GELU[source]¶

Bases: ActivationBase

GELU activation function.

class taktiny.nn.SELU[source]¶

Bases: ActivationBase

SELU activation function.

class taktiny.nn.HardSigmoid[source]¶

Bases: ActivationBase

HardSigmoid activation function.

class taktiny.nn.HardSwish[source]¶

Bases: ActivationBase

HardSwish activation function.

class taktiny.nn.HardTanh[source]¶

Bases: ActivationBase

HardTanh activation function.

class taktiny.nn.Mish[source]¶

Bases: ActivationBase

Mish activation function.

class taktiny.nn.ReLU[source]¶

Bases: ActivationBase

ReLU activation function.

class taktiny.nn.SiLU[source]¶

Bases: ActivationBase

SiLU (Swish) activation function.

class taktiny.nn.Sigmoid[source]¶

Bases: ActivationBase

Sigmoid activation function.

class taktiny.nn.SoftPlus[source]¶

Bases: ActivationBase

SoftPlus activation function.

class taktiny.nn.SoftSign[source]¶

Bases: ActivationBase

SoftSign activation function.

class taktiny.nn.Swish[source]¶

Bases: ActivationBase

Swish activation function.

class taktiny.nn.Tanh[source]¶

Bases: ActivationBase

Tanh activation function.