Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Update deploy test tools #553

Merged
merged 6 commits into from
May 25, 2021

Conversation

grimoire
Copy link
Member

Hi
This PR adds TensorRT deploy test tools and rename ort_test.py to deploy_test.py
Result below:

Model Config Dataset Metric PyTorch ONNXRuntime TensorRT-fp32 TensorRT-fp16
FCN fcn_r50-d8_512x1024_40k_cityscapes.py cityscapes mIoU 72.2 72.2 72.2 72.2
PSPNet pspnet_r50-d8_512x1024_40k_cityscapes.py cityscapes mIoU 77.8 77.8 77.8 77.8
deeplabv3 deeplabv3_r50-d8_512x1024_40k_cityscapes.py cityscapes mIoU 79.0 79.0 79.0 79.0
deeplabv3+ deeplabv3plus_r50-d8_512x1024_40k_cityscapes.py cityscapes mIoU 79.6 79.5 79.5 79.5

@codecov
Copy link

codecov bot commented May 14, 2021

Codecov Report

Merging #553 (3a5c277) into master (805eda8) will decrease coverage by 0.34%.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #553      +/-   ##
==========================================
- Coverage   86.76%   86.41%   -0.35%     
==========================================
  Files         101      101              
  Lines        5250     5279      +29     
  Branches      849      851       +2     
==========================================
+ Hits         4555     4562       +7     
- Misses        535      557      +22     
  Partials      160      160              
Flag Coverage Δ
unittests 86.41% <ø> (-0.35%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
mmseg/datasets/ade.py 40.54% <0.00%> (-59.46%) ⬇️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 805eda8...3a5c277. Read the comment docs.

tools/deploy_test.py Outdated Show resolved Hide resolved
tools/deploy_test.py Outdated Show resolved Hide resolved
tools/deploy_test.py Outdated Show resolved Hide resolved
tools/deploy_test.py Outdated Show resolved Hide resolved
docs/useful_tools.md Outdated Show resolved Hide resolved
docs/useful_tools.md Outdated Show resolved Hide resolved
docs/useful_tools.md Outdated Show resolved Hide resolved
Copy link
Collaborator

@RunningLeon RunningLeon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@RunningLeon RunningLeon requested a review from xiexinch May 25, 2021 03:28
@xvjiarui xvjiarui merged commit dc5d53b into open-mmlab:master May 25, 2021
@xvjiarui
Copy link
Collaborator

I suggest open a new documentation page for deployment, so users could easily find the exporting guide.

bowenroom pushed a commit to bowenroom/mmsegmentation that referenced this pull request Feb 25, 2022
* add trt test tool

* create deploy_test, update document

* fix with isort

* move import inside __init__

* remove comment, fix doc

* update document
sibozhang pushed a commit to sibozhang/mmsegmentation that referenced this pull request Mar 22, 2024
* add baseline

* modify mmdet import

* add lfb_infer_bank

* finish lfb draft

* add comments for mmaction/models/common/lfb.py

* update lfb infer head

* update comment

* support lmdb to load lfb

* add config of lmdb

* add lfb_avg lfb_max config

* add README

* add unittest

* remove auto_fp16 in fbononlocal

* add url

* update README and changelog

* fix typo
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants