Skip to content

Vision Transformer implemented with JAX and dm-haiku

License

Notifications You must be signed in to change notification settings

dogeplusplus/haiku-transformer

Repository files navigation

haiku-transformer

  • Implementation of the basic Vision Transformer using jax and dm-haiku
  • Model and optimizer serialization/deserialization with pickle
  • Uses tensor manipulation operations using einops
  • Re-implementation of Attention Rollout with percentile based filtering from https://github.com/jacobgil/vit-explain (WIP)
  • Inference script with attention rollout (WIP)

About

Vision Transformer implemented with JAX and dm-haiku

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published