top of page

Optimize Deep Neural Network applications using cuDNN

What is cuDNN ?

  • NVIDIA CUDA Deep Neural Network (cuDNN) is a GPU-accelerated library of primitives for deep neural networks.

  • It provides highly tuned implementations of routines arising frequently in DNN applications.

  • Added support for FP8 fused-multi-head attention training and inference support targeting BERT on NVIDIA Hopper GPUs.

  • Added support for transformer models training and inference using Flash Attention in cuDNN runtime fusion engine

Benefits - Performance Improvement

How to enable cuDNN in the code ?

Additional Reading

  1. https://docs.nvidia.com/deeplearning/cudnn/index.html

4 Comments

Rated 0 out of 5 stars.
No ratings yet

Add a rating

Useful Information to get better computing environment for complex AI based applications, is given with sample case study.

Like

Rated 5 out of 5 stars.

Very Informative. Benefits of cuDNN beautifully highlighted with a quick snapshot.

Like

Guest
Jun 23, 2023

Very Informative. Benefits of cuDNN beautifully highlighted with a quick snapshot.

Like

Good Optimization tip

Like
bottom of page