安裝 TensorRT

參考 NVIDIA TensorRT Documention

到網址 https://developer.nvidia.com/tensorrt 按下 Download

輸入帳號密碼

選擇 TensorRT 7.2.1

選擇 TensorRT 7.2.1 for Linux and CUDA 10.2

選擇 TensorRT 7.2.1 for Ubuntu 18.04 and CUDA 10.2 DEB local repo package

$ os="ubuntu1804"

$ tag="cuda10.2-trt7.2.1.6-ga-20201006"

$ sudo dpkg -i nv-tensorrt-repo-${os}-${tag}_1-1_amd64.deb

$ sudo apt-key add /var/nv-tensorrt-repo-${tag}/7fa2af80.pub

$ sudo apt-get update

$ sudo apt-get install tensorrt

$ sudo apt-get install python-libnvinfer-dev

$ sudo apt-get install python3-libnvinfer-dev

$ sudo apt-get install uff-converter-tf

$ sudo apt-get install onnx-graphsurgeon

查詢是否安裝成功

$ dpkg -l | grep TensorRT