[dockers] install nvidia-dali-cudaXXX

[ydcjeff]

What does this PR do?

Fixes dali installation for #3721

Before submitting

• Was this discussed/approved via a Github issue? (no need for typos and docs improvements)
• Did you read the contributor guideline, Pull Request section?
• Did you make sure your PR does only one thing, instead of bundling different changes together? Otherwise, we ask you to create a separate PR for every change.

PR review

• Is this pull request ready for review? (if not, please submit in draft mode)

Anyone in the community is free to review the PR once the tests have passed.
If we didn't discuss your PR in Github issues there's a high chance it will not be merged.

Did you have fun?

Make sure you had fun coding 🙃

[codecov]

Codecov Report

Merging #4532 (5227529) into master (4a6721a) will not change coverage.
The diff coverage is n/a.

@@          Coverage Diff           @@
##           master   #4532   +/-   ##
======================================
  Coverage      93%     93%           
======================================
  Files         116     116           
  Lines        8833    8833           
======================================
  Hits         8232    8232           
  Misses        601     601           

[Borda]

can we install it from source rather?

[Borda]

ok, I have tried to install specific versions according to CUDA version, but it seems to fail as they have 100 or 110 only...
then I am nor sure about compatibility as we use CUDA 10.1 or 10.2...
lets check installation from source

[SeanNaren]

ok, I have tried to install specific versions according to CUDA version, but it seems to fail as they have 100 or 110 only...
then I am nor sure about compatibility as we use CUDA 10.1 or 10.2...
lets check installation from source

@Borda I've tested their cuda 100 version with cuda 10.2, does it make a difference? I think dali-cuda100 should work for both

[Borda]

@Borda I've tested their cuda 100 version with cuda 10.2, does it make a difference? I think dali-cuda100 should work for both

I would use the compiled one in Drone config and here rather build for a specific version as we also do for APEx now
https://docs.nvidia.com/deeplearning/dali/user-guide/docs/compilation.html

[SeanNaren]

Ok cool, let's see how this works!

[Borda]

@ydcjeff I got it up to some strange errors with parsing, mind have a look?

CMake Error at cmake/Utils.cmake:345 (string):
  string sub-command REPLACE requires at least four arguments.
Call Stack (most recent call first):
  dali/operators/python_function/CMakeLists.txt:19 (build_per_python_lib)

CMake Error at cmake/Utils.cmake:351 (string):
  string sub-command REPLACE requires at least four arguments.
Call Stack (most recent call first):
  dali/operators/python_function/CMakeLists.txt:19 (build_per_python_lib)

CMake Error at cmake/Utils.cmake:352 (string):
  string sub-command REPLACE requires at least four arguments.
Call Stack (most recent call first):
  dali/operators/python_function/CMakeLists.txt:19 (build_per_python_lib)

-- Adding dependencies to target `dali`: '/usr/local/cuda/targets/x86_64-linux/lib/libnvjpeg_static.a;/usr/local/cuda/targets/x86_64-linux/lib/libnppicc_static.a;/usr/local/cuda/targets/x86_64-linux/lib/libnppc_static.a;/usr/local/cuda/targets/x86_64-linux/lib/libculibos.a;opencv_core;opencv_imgproc;opencv_imgcodecs;/usr/lib/x86_64-linux-gnu/libjpeg.so;/usr/lib/x86_64-linux-gnu/libtiff.so;/usr/lib/x86_64-linux-gnu/libsndfile.so;avformat;avformat;avcodec;avfilter;avutil;ffts;CUTLASS;cocoapi;/usr/lib/x86_64-linux-gnu/libprotobuf.a;/usr/local/cuda/targets/x86_64-linux/lib/libcudart_static.a;rt;pthread;m;dl'
CMake Error at cmake/Utils.cmake:345 (string):
  string sub-command REPLACE requires at least four arguments.
Call Stack (most recent call first):
  dali/python/CMakeLists.txt:19 (build_per_python_lib)

CMake Error at cmake/Utils.cmake:351 (string):
  string sub-command REPLACE requires at least four arguments.
Call Stack (most recent call first):
  dali/python/CMakeLists.txt:19 (build_per_python_lib)

CMake Error at cmake/Utils.cmake:352 (string):
  string sub-command REPLACE requires at least four arguments.
Call Stack (most recent call first):
  dali/python/CMakeLists.txt:19 (build_per_python_lib)

[ydcjeff]

@Borda @SeanNaren does dali only run with gpu, right?
I would like to install binary if there is no major difference.
also we are testing the examples only on gpu
and i thought most end users won't compile from source to use dali except from big cooperates.

Not sure what you think?

[Borda]

I spend some time yesterday a few hours trying to compile it...
I would give it a little more to try - fix the cmake issue above or open issue on DALI project
the ultimate solution would be using the binary and hope that it be compatible with the particular CUDAs

[SeanNaren]

I agree with binaries, I even think that this is something that should be rigorously tested as it is a third party library required for users. I wouldn't spend too much time thinking about building from source and just either moving with the binary, or just skipping the test.

[Borda]

@SeanNaren @ydcjeff reverted to binaries :]