AdamState#

class vulkpy.nn.AdamState#

Bases: OptimizerState

Optimizer State for Adam

Methods Summary

grad2diff(grad)

Compute diff from gradient

Methods Documentation

grad2diff(grad: Array) Array#

Compute diff from gradient

Parameters:

grad (vulkpy.Array) – Gradient

Returns:

diff – Update diff

Return type:

vulkpy.Array

__init__(opt: Adam, shape: Iterable[int])#

Initialize Adam state

Parameters:
  • opt (vulkpy.Adam) – Adam Optimizer

  • shape (iterable of ints) – Value shape