Getting a lot of warnings when testing YOLOX-s with MMDeploy

[lzhangzz]

What are the problems?(screenshots or detailed error messages)

Getting a lot of warnings when testing YOLOX-s with MMDeploy

[WARNING][2022-06-14 22:01:55.894][kernel.cc:111] Cannot execute Gather_593
[WARNING][2022-06-14 22:01:55.894][kernel.cc:111] Cannot execute Mul_603
[WARNING][2022-06-14 22:01:55.894][kernel.cc:111] Cannot execute Gather_595
[WARNING][2022-06-14 22:01:55.894][kernel.cc:111] Cannot execute Add_604
[WARNING][2022-06-14 22:01:55.894][kernel.cc:111] Cannot execute Gather_591
[WARNING][2022-06-14 22:01:55.894][kernel.cc:111] Cannot execute Mul_606
[WARNING][2022-06-14 22:01:55.894][kernel.cc:111] Cannot execute Add_607
[WARNING][2022-06-14 22:01:55.894][kernel.cc:111] Cannot execute Gather_608
[WARNING][2022-06-14 22:01:55.894][kernel.cc:111] Cannot execute Reshape_610
[WARNING][2022-06-14 22:01:55.894][kernel.cc:111] Cannot execute Reshape_612
[WARNING][2022-06-14 22:01:55.894][kernel.cc:111] Cannot execute Unsqueeze_613
[WARNING][2022-06-14 22:01:55.894][kernel.cc:111] Cannot execute Bridge_Node_Concat_629_1233
[WARNING][2022-06-14 22:01:55.894][kernel.cc:111] Cannot execute Mul_620
[WARNING][2022-06-14 22:01:55.894][kernel.cc:111] Cannot execute Add_621
[WARNING][2022-06-14 22:01:55.894][kernel.cc:111] Cannot execute Gather_622
[WARNING][2022-06-14 22:01:55.894][kernel.cc:111] Cannot execute Reshape_626
[WARNING][2022-06-14 22:01:55.894][kernel.cc:111] Cannot execute Reshape_628
[WARNING][2022-06-14 22:01:55.894][kernel.cc:111] Cannot execute Unsqueeze_630
[WARNING][2022-06-14 22:01:55.894][kernel.cc:111] Cannot execute Tile_638
[WARNING][2022-06-14 22:01:55.894][kernel.cc:111] Cannot execute Equal_642
[WARNING][2022-06-14 22:01:55.894][kernel.cc:111] Cannot execute Unsqueeze_643
[WARNING][2022-06-14 22:01:55.894][kernel.cc:111] Cannot execute Where_645
[WARNING][2022-06-14 22:01:55.894][kernel.cc:111] Cannot execute Unsqueeze_646
[WARNING][2022-06-14 22:01:55.894][kernel.cc:111] Cannot execute Tile_654
[WARNING][2022-06-14 22:01:55.894][kernel.cc:111] Cannot execute Equal_656
[WARNING][2022-06-14 22:01:55.894][kernel.cc:111] Cannot execute Where_658

However, the infernece results seems to be correct.

Which version(commit id or tag) of ppl.nn is used?

ee73c3a

What's the operating system ppl.nn runs on?

Ubuntu 18.04

What's the compiler and its version?

GCC-7.5, CUDA-11.1

What are the commands used to build ppl.nn?

cmake .. \
    -DCMAKE_INSTALL_PREFIX=/workspace/ppl.nn/install \
    -DPPLNN_ENABLE_PYTHON_API=ON \
    -DPPLNN_USE_X86_64=ON \
    -DPPLNN_USE_CUDA=ON \
    -DPPL_USE_X86_AVX512=OFF \
    -DPPLNN_ENABLE_CUDA_JIT=OFF \
    -DCMAKE_BUILD_TYPE=Release \
    -DCMAKE_CUDA_ARCHITECTURES=75

What are the execution commands?

using open-mmlab/mmdeploy#564

Convert to ONNX with

python tools/deploy.py --device cuda --dump-info --work-dir tmp_model ./configs/mmdet/detection/detection_pplnn_dynamic-800x1344.py ../mmdetection/configs/yolox/yolox_s_8x8_300e_coco.py benchmark/yolox_s_8x8_300e_coco_20211121_095711-4592a793.pth ../mmdetection/demo/demo.jpg

Test with

python tools/test.py --device cuda ./configs/mmdet/detection/detection_pplnn_dynamic-800x1344.py ../mmdetection/configs/yolox/yolox_s_8x8_300e_coco.py --model tmp_model/end2end.onnx --metrics bbox --speed-test

[Si-XU]

Warning is fine.
"Cannot execute kernel" usually means one input dim is zero.
An empty input means onnx model can not detect any box based on your input.
You can avoid this problem by using a real input.

[lzhangzz]

I see, thanks for answering.