python3 train.py
python3 export_onnx.py
cd ../ # in project directory
mkdir build && cd build
cmake ..
make -j
cd ../../bin/
./tensorrt_inference lenet ../configs/lenet/config.yaml ../samples/mnist
model | PyTorch | TensorRT |
---|---|---|
inference time | 0.4ms | 0.046ms |