Skip to content

Commit

Permalink
Kkabilar tt single card perf (#17231)
Browse files Browse the repository at this point in the history
### Ticket
Link to Github Issue
Due to recent failures of Single-card Model-perf and Device-perf
workflows in main branch

### Problem description and What's changed
Single-card Model-perf: was flaky and the range has been updated
Single-card Device-perf: executed higher samples/s so the range was
updated to reflect the new speed

### Checklist
- [ ] Post commit CI passes
- [ ] Blackhole Post commit (if applicable)
- [Y] Model regression CI testing passes (if applicable)
- [Y] Device performance regression CI testing passes (if applicable)
- [ ] **(For models and ops writers)** Full [new
models](https://github.com/tenstorrent/tt-metal/actions/workflows/full-new-models-suite.yaml)
tests passes
- [ ] New/Existing tests provide coverage for changes
  • Loading branch information
kkabilarTT authored and yieldthought committed Jan 31, 2025
1 parent ba09eed commit eb8a316
Show file tree
Hide file tree
Showing 3 changed files with 3 additions and 3 deletions.
2 changes: 1 addition & 1 deletion models/demos/wormhole/bert_tiny/tests/test_performance.py
Original file line number Diff line number Diff line change
Expand Up @@ -122,7 +122,7 @@ def test_perf_bert_tiny(
@pytest.mark.parametrize(
"batch_size, expected_perf",
[
(16, 6500),
(16, 6600),
],
)
def test_perf_device_bare_metal(batch_size, expected_perf):
Expand Down
2 changes: 1 addition & 1 deletion tests/ttnn/integration_tests/bert/test_performance.py
Original file line number Diff line number Diff line change
Expand Up @@ -59,7 +59,7 @@ def preprocess_inputs(
def get_expected_times(bert):
return {
ttnn_bert: (0.1, 0.1),
ttnn_optimized_bert: (5.55, 0.11),
ttnn_optimized_bert: (5.71, 0.11),
ttnn_optimized_sharded_bert: (5.7, 0.07),
}[bert]

Expand Down
2 changes: 1 addition & 1 deletion tests/ttnn/integration_tests/whisper/test_performance.py
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
def get_expected_times(functional_whisper):
return {
ttnn_functional_whisper: (11.7, 4.16),
ttnn_optimized_functional_whisper: (1.65, 1.35),
ttnn_optimized_functional_whisper: (1.7, 1.35),
}[functional_whisper]


Expand Down

0 comments on commit eb8a316

Please sign in to comment.