Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Lack of cuDNN 5 and WINOGRAD algorithm support #2

Open
wenwei202 opened this issue Apr 16, 2017 · 1 comment
Open

Lack of cuDNN 5 and WINOGRAD algorithm support #2

wenwei202 opened this issue Apr 16, 2017 · 1 comment

Comments

@wenwei202
Copy link

I tried to run
./scripts/exp_case_alexnet_scalability.sh
and raised a butch of Warning and got no profiling results:

WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
INFO build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:393] Tile FFT: 1 (32x32) 1D: False
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
INFO build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:393] Tile FFT: 1 (32x32) 1D: False
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
INFO build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:393] Tile FFT: 1 (32x32) 1D: False
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
INFO build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:393] Tile FFT: 1 (32x32) 1D: False
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
INFO build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:393] Tile FFT: 1 (32x32) 1D: False
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
INFO build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:393] Tile FFT: 1 (32x32) 1D: False
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
INFO build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:393] Tile FFT: 1 (32x32) 1D: False
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
INFO build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:393] Tile FFT: 1 (32x32) 1D: False
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
INFO build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:393] Tile FFT: 1 (32x32) 1D: False
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
INFO build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:393] Tile FFT: 1 (32x32) 1D: False
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD

What might be the problem? Thanks
@hang-qi
Copy link
Collaborator

hang-qi commented Apr 16, 2017

@wenwei202, thanks for reporting this issue. This is because of the new convolution algorithm WINOGRAD in cuDNN 5. Paleo does not support cuDNN 5 yet, but it is part of the TODOs for upcoming releases.

@hang-qi hang-qi changed the title Raise lots of Warnings and get no profiled results Lack of cuDNN 5 and WINOGRAD algorithm support Apr 16, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@hang-qi @wenwei202