Leaky ReLU Activation Function — mlr_pipeops_nn_leaky

Applies element-wise, $LeakyReLU(x) = max(0, x) + negative_slope * min(0, x)$

nn_module

Calls torch::nn_leaky_relu() when trained.

Parameters

negative_slope :: numeric(1)
Controls the angle of the negative slope. Default: 1e-2.
inplace :: logical(1)
Can optionally do the operation in-place. Default: FALSE.

Input and Output Channels

One input channel called "input" and one output channel called "output". For an explanation see PipeOpTorch.

State

The state is the value calculated by the public method $shapes_out().

Super classes

mlr3pipelines::PipeOp -> PipeOpTorch -> PipeOpTorchLeakyReLU

Methods

Inherited methods

`PipeOpTorchLeakyReLU$new()`

Creates a new instance of this R6 class.

Usage

PipeOpTorchLeakyReLU$new(id = "nn_leaky_relu", param_vals = list())

Arguments

id: (character(1))
Identifier of the resulting object.
param_vals: (list())
List of hyperparameter settings, overwriting the hyperparameter settings that would otherwise be set during construction.

`PipeOpTorchLeakyReLU$clone()`

The objects of this class are cloneable with this method.

Usage

PipeOpTorchLeakyReLU$clone(deep = FALSE)

Arguments

deep: Whether to make a deep clone.

Examples

# Construct the PipeOp
pipeop = nn("leaky_relu")
pipeop
#> 
#> ── PipeOp <leaky_relu>: not trained ────────────────────────────────────────────
#> Values: list()
#> 
#> ── Input channels: 
#>    name           train predict
#>  <char>          <char>  <char>
#>   input ModelDescriptor    Task
#> 
#> ── Output channels: 
#>    name           train predict
#>  <char>          <char>  <char>
#>  output ModelDescriptor    Task
# The available parameters
pipeop$param_set
#> <ParamSet(2)>
#>                id    class lower upper nlevels default  value
#>            <char>   <char> <num> <num>   <num>  <list> <list>
#> 1: negative_slope ParamDbl  -Inf   Inf     Inf    0.01 [NULL]
#> 2:        inplace ParamLgl    NA    NA       2   FALSE [NULL]