v0.1.0: First release
This release includes:
- Basic module system:
pax.Module
. - Basic leaf node: Only two supported nodes:
pax.State
andpax.Parameter
which are subtypes ofpax.tree.Leaf
. - Basic random state: a global
rng_key
is stored atpax.rng.state._rng_key
. Callpax.next_rng_key()
to generate a newrng_key
. - Basic optimizer:
pax.Optimizer
. - nn modules:
nn.Linear
,nn.BatchNorm
,nn.LayerNorm
.nn.Conv1d
,nn.Conv2d
. - Convert dm-haiku module to
pax.Module
withpax.haiku.from_haiku
. - Convert optax optimizer to
pax.Optimizer
withpax.optim.from_optax
. - An example training RNN language model on TPU.
- An example training a MNIST classifier with checkpoint.