flax.linen.activation.PReLU#
- class flax.linen.activation.PReLU(param_dtype=<class 'jax.numpy.float32'>, negative_slope_init=0.01, parent=<flax.linen.module._Sentinel object>, name=None)[source]#
Parametric Rectified Linear Unit (PReLU) activation function.
Note that PReLU is a Flax layer and not a simple activation function, so it needs to be initialized before being called.
- Example usage::
>>> import flax.linen as nn
>>> class MLP(nn.Module): ... @nn.compact ... def __call__(self, x): ... x = nn.Dense(2)(x) ... x = nn.PReLU()(x) # initialized ... return x
- param_dtype#
the dtype passed to parameter initializers (default: float32).
- Type
Any
- negative_slope_init#
the value to initialize the negative slope (default 0.01).
- Type
float
- __init__(param_dtype=<class 'jax.numpy.float32'>, negative_slope_init=0.01, parent=<flax.linen.module._Sentinel object>, name=None)#
Methods
__init__
([param_dtype, negative_slope_init, ...])apply
(variables, *args[, rngs, method, ...])Applies a module method to variables and returns output and modified variables.
bind
(variables, *args[, rngs, mutable])Creates an interactive Module instance by binding variables and RNGs.
clone
(*[, parent, _deep_clone, _reset_names])Creates a clone of this Module, with optionally updated arguments.
copy
(*[, parent, name])Creates a copy of this Module, with optionally updated arguments.
get_variable
(col, name[, default])Retrieves the value of a Variable.
has_rng
(name)Returns true if a PRNGSequence with name name exists.
has_variable
(col, name)Checks if a variable of given collection and name exists in this Module.
init
(rngs, *args[, method, mutable, ...])Initializes a module method with variables and returns modified variables.
init_with_output
(rngs, *args[, method, ...])Initializes a module method with variables and returns output and modified variables.
is_initializing
()Returns True if running under self.init(...) or nn.init(...)().
is_mutable_collection
(col)Returns true if the collection col is mutable.
lazy_init
(rngs, *args[, method, mutable])Initializes a module without computing on an actual input.
make_rng
(name)Returns a new RNG key from a given RNG sequence for this Module.
param
(name, init_fn, *init_args[, unbox])Declares and returns a parameter in this Module.
perturb
(name, value[, collection])Add an zero-value variable ('perturbation') to the intermediate value.
put_variable
(col, name, value)Updates the value of the given variable if it is mutable, or an error otherwise.
setup
()Initializes a Module lazily (similar to a lazy
__init__
).sow
(col, name, value[, reduce_fn, init_fn])Stores a value in a collection.
tabulate
(rngs, *args[, depth, ...])Creates a summary of the Module represented as a table.
unbind
()Returns an unbound copy of a Module and its variables.
variable
(col, name[, init_fn, unbox])Declares and returns a variable in this Module.
Attributes
name
parent
path
scope
variables
Returns the variables in this module.