As you know, Nvidia develop many apps to improve our gaming experience. But those software are not new and many of them have open source implementation. I speak about the DLSS and the upsacaling.
My suggestion are the following:
Integrate in the plex server and plex media player a deep learning software to upscale our video/image.
My idea are (read by case):
We use a plex media player and we have a good hardware on the computer (compatible graphic card): Upscale with this computer the stream. (In the same time, if the connection between the server and player are bad, downgrade the stream from the server and upscale on the player)
When the server hardware are good (compatible graphic card) and a good connection between the player and the server: transcode with deep learning upscale and send the video to the player (web player or plex media player)
I think this is the futur. With this system we don’t need to save 4k video file to take a 4k video. We need less space on the hard drive but just a better hardware.
This technology can be use to improve bad video quality and increase the frame rate too.
But all this feature have to be an option. And the user can activate it.
Thank you to reading my idea,
I hope this will be a new feature soon.
There’s also suggestions not to do that but deliver the video in its native resolution and let the tv handle the scaling (given it has dedicated chips / algorithms to do that.
When I speak upscaling, I means about IA upscaling. In video game they use DLSS from NVIDIA or in the future FidelityFX Super Resolution from AMD.
(I let you document about DLSS: NVIDIA DLSS 2.0: A Big Leap In AI Rendering )
Hi, the easiest way to get deep learning video upscaling is to get an Nvidia Shield pro (2019) SHIELD TV 2019: AI Upscaling isn’t working properly. Pay close attention to the Content Resolution, I currently believe you must have only those five resolutions for the AI upscaling to work, it is not any number between 360p and 1440p, so pay attention when cropping your video.
As far as your suggestion,
First, both Nvidia and AMD will have to add this to their video drivers, and then FFmpeg will have to incorporate it as I believe Plex is using FFmpeg to do most if not all of the Transcoding.
Recently I got the wild idea of transcoding and upscaling the blu-ray version of Avatar. I used MakeMKV to get it on the computer, just under 42GB, takes about an hour to do that. Then I used Xmedia Recode with Nvidia decode enabled in options, and x265 Nvidia encodes, in the filter section I changed the Resolution to 4K. It took about two hours, with a size of just over 13GB. I have an RTX 2080 Ti, and this was all being done on the GPU, not the CPU. So it is my belief that we have a way to go before Plex “on the fly” real-time transcoding, upscaling.
I am re-watching Star Trek: Deep Space Nine; my rip from the original DVDs. I’m using the first Nvidia Shield TV, so no upscaling. And its a shame. This is the best Star Trek series. I’d love to see Plex support upscaling while transcoding, as I have a pretty beefy video card. I’m not ready to upgrade to the new Shield TV yet. Anyway, here’s my vote two years after the last reply to see this feature.
It doesnt even have to be on server side. The PC desktop app should allow the gpu to upscale media. You can already do it in chromium browsers. So should the desktop client.
Many DVD players have had this feature for years. I’d like to have the Plex Server have this same feature. To upscale a 480p, to say a 720p, or a 1080p screen resolution. Of course the source file would be the make or break, if the quality of the upscaling would be decent. But I would like to have the option to select it in the Plex server. To suit my personal needs.
What’s your take on AI upscaling in 2025?
Now there’s Topaz and iSeeBetter and those are darn good but deploying them is out of reach for many.
I’d be willing to pay extra for this feature and I bet I am not alone.
