Introducing TensorRT lazy export and caching option with trt_compile() (

#11266) * Introducing trt_compile() Signed-off-by: Boris Fomitchev <[email protected]> * Adding tests for dynamic axes Signed-off-by: Boris Fomitchev <[email protected]> * Fixed folding constants and style check Signed-off-by: Boris Fomitchev <[email protected]> --------- Signed-off-by: Boris Fomitchev <[email protected]>
NVIDIA · Nov 27, 2024 · 06e6703 · 06e6703
1 parent e238327
commit 06e6703
Show file tree

Hide file tree

Showing 3 changed files with 855 additions and 0 deletions.
diff --git a/nemo/export/__init__.py b/nemo/export/__init__.py
@@ -11,3 +11,5 @@
 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
 # See the License for the specific language governing permissions and
 # limitations under the License.
+
+from nemo.export.tensorrt_lazy_compiler import trt_compile