Benchmarks for entire models

[danthe3rd]

Stack from ghstack (oldest at bottom):

• Address nits from previous PR stack + bump version #518
• Include git hash and install date in version #511
• MemEff: Raise if wrong bias #510
• Raise if kernel not supported on device #509
• -> Benchmarks for entire models #505
• Update mypy to 0.982 #508
• SwiGLU: Support for no bias #504
• MemEff: Set CUDA stream properly #491
• SwiGLU further optimization in MLP bw #502
• SwiGLU optimized fw/bw #490
• unbind: Add 'stack_or_none' #498
• Should fix OOMs in CI #488
• ops.swiglu: Tests, baseline, benchmarks #487
• Split xformers.ops #486

[fmassa]

LGTM, thanks!

[codecov-commenter]

Codecov Report

Base: 88.01% // Head: 88.01% // No change to project coverage 👍

Coverage data is based on head (59970ef) compared to base (59970ef).
Patch has no changes to coverable lines.

❗ Current head 59970ef differs from pull request most recent head f06f1d9. Consider uploading reports for the commit f06f1d9 to get more accurate results

Additional details and impacted files

@@                  Coverage Diff                  @@
##           gh/danthe3rd/59/base     #505   +/-   ##
=====================================================
  Coverage                 88.01%   88.01%           
=====================================================
  Files                        80       80           
  Lines                      4822     4822           
=====================================================
  Hits                       4244     4244           
  Misses                      578      578           

Flag	Coverage Δ
Python	88.01% <0.00%> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.