Request: Frame Interpolation (a.k.a. realtime motion tweening)

Feature Suggestions
1

Frame Interpolation

 

So, to start of, what is Frame Interpolation, and why should you want this?

 

The short answer, is that it will make any type of video a lot of 'smoother' to watch in many situations (depending on the type of scenes your movie has). 

To show you what it can do, please click here and watch that first. Then, go watch this, which is the same video, but interpolated.

 

If you watch Anime, like I do, then well, trust me.. You'll want this feature more than you want dinner tonight. Below are some examples:

  1. Evangelion 3.33 (And another example)
  2. Toaru Kagaku no Railgun S
  3. The Disappearance of Haruhi Suzumiya (Spoiler)
  4. The Garden of Words (Spoiler)
  5. Little Witch Academia
  6. Zankyou no Terror (Spoiler)
  7. Space Battleship Yamato 2199 (Minor Spoiler)

 

 

 

As you can see, these are all full 60-fps examples, and are a pleasure to watch.
Except for that they aren't 60FPS. They're all 24FPS upped to 60FPS using Frame Interpolation.

 

 

 

 

How does it work?

 

Frame Interpolation works by taking two consecutive frames and scanning the differences between them. These differences are then used to predict the motion and generate interpolated images to fill the gaps, allowing for smoother video.

 

Memc.jpg

 

 

Is it performance heavy?

 

To be fairly honest with you, I have no clue, but the Windows-based 'SmoothVideo Project' (that does this kind of stuff (too)) states that their 'plugin' allows you to watch FullHD 1080p-video 'recalculated' to 60Hz in real-time (even 3D!) using a mid-range CPU and almost any GPU hardware (note: they do provide GPU acceleration!)

 

Judging by that text, I assume the answer to wether it's performance heavy is probably no.

 

 

 

Why should I want it?
 

.. seriously..?

  1. It looks amazing, and quite literally brings you a completely new viewing experience.
  2. It's not that performance heavy (probably)
  3. /r/60fpsporn (NSFW)
  4. Cinema-like experience

 

Go test it out right now!

Since it's not implemented in Plex (yet), you could use SVP together with pretty much any player (XBMC DSPlayer, MPC-HC, Windows Media Player etc.). Alternatively, you can try this and directly convert files: http://www.spirton.com/convert-videos-to-60fps/

 

 

 

If you like this feature request, please like this post to bring it to the Plex developer's attention! Thanks!

2

Hi,

I like the idea.

Thats look like the same as Samsungs: "Motion Plus" and LGs "True Motion" build into TVs. The problem is most of the time its looks amazing but there are sometimes very hard jerks during scene change. It annoys me so much that I have this function disabled an my brand new Samsung TV.

But if your idea eliminated this jerks, thats would be fantastic. All movie with 60 fps and TV @60 hz sounds like a dream :-) I hate this oldschool 24p shit :-)

3

Hi,

I like the idea.

Thats look like the same as Samsungs: "Motion Plus" and LGs "True Motion" build into TVs. The problem is most of the time its looks amazing but there are sometimes very hard jerks during scene change. It annoys me so much that I have this function disabled an my brand new Samsung TV.

But if your idea eliminated this jerks, thats would be fantastic. All movie with 60 fps and TV @60 hz sounds like a dream :-) I hate this oldschool 24p ■■■■ :-)

I agree, there are certain 'hiccups' depending on the algorithm used and/or the type of motion, but it's modifyable in realtime with a ton of options, so you can keep those hiccups to a minimum depending on the settings and type of movie/episode.

Plus for the global outcome, I have to say, it's just so amazing that I found myself saying holy ■■■■ a couple of times in just 20 mins. I can totally forgive it for the hiccups that remain (I barely noticed them!). It definitely increases the experience.

----

As for how this could be implemented:

  1. Create a set of built-in presets (perhaps modify-able)
  2. Make presets toggle-able/settable and/or overrideable per library/show/episode (the same way subtitles are done)
  3. Obviously, have a default setting of 'off' or 'disabled'.

Note to devs: This can also be included into the syncing to Mobile devices, so it doesn't have to 'output' to screen in realtime.

Below you can see one of those 'hiccups' mentioned. You can also see how much customizeable there is to this interpolation thing.. Modifying those settings will modify algorithm response/jerkiness instantly.

ANfQegA.jpg

4

This is what is found on high end TVs. This would be a huge improvement to Plex!

5

Yes. I would very much like this feature to be implemented in the plex server!

6

Was motion interpolation ever implemented? I am using the Windows desktop Plex client. Thank you in advance.