Split xformers.ops

[danthe3rd]

Stack from ghstack (oldest at bottom):

• Address nits from previous PR stack + bump version #518
• Include git hash and install date in version #511
• MemEff: Raise if wrong bias #510
• Raise if kernel not supported on device #509
• Benchmarks for entire models #505
• Update mypy to 0.982 #508
• SwiGLU: Support for no bias #504
• MemEff: Set CUDA stream properly #491
• SwiGLU further optimization in MLP bw #502
• SwiGLU optimized fw/bw #490
• unbind: Add 'stack_or_none' #498
• Should fix OOMs in CI #488
• ops.swiglu: Tests, baseline, benchmarks #487
• -> Split xformers.ops #486

SUMMARY
As discussed offline with @fmassa , will make extending new operators clearner

[fmassa]

Great, thanks Daniel!

[codecov-commenter]

Codecov Report

Base: 90.56% // Head: 90.56% // No change to project coverage 👍

Coverage data is based on head (8407de3) compared to base (8407de3).
Patch has no changes to coverable lines.

❗ Current head 8407de3 differs from pull request most recent head 9a0d544. Consider uploading reports for the commit 9a0d544 to get more accurate results

Additional details and impacted files

@@                  Coverage Diff                  @@
##           gh/danthe3rd/49/base     #486   +/-   ##
=====================================================
  Coverage                 90.56%   90.56%           
=====================================================
  Files                        76       76           
  Lines                      4580     4580           
=====================================================
  Hits                       4148     4148           
  Misses                      432      432           

Flag	Coverage Δ
Python	90.56% <0.00%> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.