Installing TensorRT? Worth it?

I noticed the TensorRT option when using “General Restoration”.

Has anyone installed TensorRT? And did it improve processing time?

And how do you know when its running/working with Hitpaw Vikpea?

I’m a bit of a novice and trying to download TensorRT is “interesting”.

Thanks.

I just bought Vikpea yesterday and my first run is with TensorRT It is very fast. Faster than other AI Videoenhancer apps I’ve used. However, I’m not sure if TensorRT reduces the enhancement quality as usually you sacrifice quality for speed.

Please let me know how to use the TenssorRT in Vikpea.

You have to enable it in the export queue screen and it only takes effect during the next processing not the current batch, which is not intuitive at all. Also only the Generative Restoration model is fast. The rest are very slow. But the Generative Restoration model is really good especially for 1x enhance, where it beats every single Topaz model I tried for 4k videos. At 2x upscale though, Topaz models are a bit better. But it depends on the video.

TensorRT is a model inference acceleration framework provided by NVIDIA. It significantly improves GPU performance and speeds up video enhancement model processing while maintaining video quality. If your graphics card supports it, please enable this feature for even faster processing speeds.

Thanks to everyone who replied. Just wanted to report back.

I found and installed (what I believe was) the required software.

Pressing “Alt + Z” brings up an options box on the left of the screen.

Which I think is game play, and not for Hitpaw Vikpea.

If you hold your mouse over the TensorRT button in Vikpea it says: “Using TensorRT requires downloading some components” etc.

But it doesn’t say what components, so I assume I’ve got the right ones.

As when I click it tells me it will start with the next processing task.

Anyway I now have a display on the top right hand side of the screen that tells me how much of the CPU and GPU are being used.

GPU usage sits around 90 to 99%.

I have a NVIDIA GeForce RTX 3060i. How do I enable it as you suggest?

You may see the notice on the Export interface.

Yes, I had noticed that. And clicked on it. And it say’s “Enabling TensorRT will take effect when you process the next task”. So just clicking on it when it’s GREEN turns it “ON”; and its greyed out when it is “ON”?

GREEN means the TensorRT is ON, and when the icon is greyed out, it’s OFF.

Hi, has anyone found a solution for this? I’m having the same problem.

“TensorRT mode requires some components to be downloaded.”

But which components? Everything is up to date on my e