Early access for Plex Pass users to new Apple TV & iOS Video Player

We’re introducing a great upgrade in terms of video playback experience to our iOS and Apple TV apps! Up until now, we relied on Apple’s AVPlayer for video playback. That was a simple solution, but very limited in many aspects. However, now we’ve added support for mpv: the same higher-quality video player we have in Plex Media Player, that will result in sharper video output and improved subtitle support.

The new player is still experimental, and we do plan to make it available to everyone, but for now it’s available to Plex Pass holders as an early-access preview. You can turn it on and off at any time in Settings -> Advanced.

What’s changed?

With this new video player, the apps will be able to play many more video formats without transcoding. This also includes a new custom video player UI in the Apple TV app that adds support for seek thumbnails, proper audio & subtitle switching during playback, and some other things we’ll add in the near future. We also gained more control over our playback stack.

Basically, with these changes, the apps will try to use the new video player based on mpv when possible, with a few exceptions:

  • News and Web Shows

In all these circumstances the app will use the old player. We’re working as we speak to reduce that list of exceptions.

There are two other exceptions where Apple’s AVPlayer is needed: when using AirPlay and Picture in Picture (on devices which support it). In those scenarios, when enabling those features the app will switch to the old player (meaning, it could require transcoding).

Finally, due to some performance and compatibility issues we found, for now the new player will be available only for devices with iOS 11 and newer.

It’s also worth mentioning that this doesn’t affect Sync right now. That means, your media will still be transcoded to the same format in order to be compatible with the old player.

What are those supported formats?

Right now, the new player can direct play the following formats:

  • Supported containers: mkv, mov, mp4, mpegts, mpeg, mpegvideo, avi, flv, ogg

  • Supported audio codecs: aac, aac_latm, ac3, alac, flac, dca, vorbis, opus, eac3, mp1, mp2, mp3

  • Supported video codecs: h264, hevc, vp8, vp9, h263, mpeg1video, mpeg2video, mpeg4, vc1 (in iPhone 7 and newer, iPad Pro from 2017 and newer, and in Apple TV 4K)

  • Supported subtitle codecs: ass, dvb_subtitle, vobsub, eia_608, pgs, microdvd, movtext, ssa, srt

What’s in development?

We’re actively working on:

  • Improving performance.

:white_check_mark: Adding support for HDR playback.

:white_check_mark: Adding support for tone mapping when playing HDR videos in SDR displays.

  • Improved controls/gestures in the Apple TV video player.

  • Increasing device compatibility.

What do you need tested?

Basically everything video-playback-related needs testing to help ensure the broadest coverage. Go ahead and throw your old, obscure, early-90s home movie or your super-high-bitrate GoPro footage at the player and see how it does.

Oh noes, something doesn’t play right! How do I report it?

Providing detailed info when you encounter a playback issue will help us investigate (and resolve!) the issue quickly, so things improve for everyone.

  • Test whether you see the same playback problem with the old player (see the information on switching back below)

  • Reproduce the playback issue with the NEW player

  • Grab logs from your app (iOS App Logs or Apple TV App Logs)

  • Save the “XML file” for the library item you tried to play (XML File Information)

  • If possible, create a small sample file (Generating Sample Files) of the video causing the issue, verify that the sample still causes the issue, and then upload that sample to somewhere such as Dropbox or Google Drive

  • Report your issue in our iOS or Apple TV forums with details about what exactly you experienced. Be sure to attach your logs and “XML file” and link to the sample file. If you’re testing a beta build, please use the iOS Beta or Apple TV Beta forums instead.

Do I really have to do all that?

We know it sounds like a lot, but it’s not as bad as it might first seem. It’s super important to get this information to allow us to investigate and resolve the issues, though. We all want the issue fixed and working, right?

With this new foundation we’ll have the ability to improve our format support and will be considering things like this for future improvements. For now, please let us know if you encounter any formats where the new player provides a worse experience that the old player.

TL;DR: A brand new video player with lots of improvements and new formats supported. Enjoy and report issues in the forums!

39 Likes

Released new betas for iOS v5.8 (15736) and tvOS v1.36 (10823) with the following changes:

  • Improved performance of the new player.
  • Fixed support for mov_text subtitles.
  • (iOS only) Added support for double-tap to zoom.
  • (iOS only) Fixed issue with synced videos that would play with no sound.
  • (iOS only) Fixed some issues with audio formats unsupported in some devices (EAC3, AC3…) not triggering transcoding.

We’re still working on getting the gestures of Apple’s tvOS video player into ours. They will be available in upcoming betas.

1 Like

Released new betas for iOS v5.8 (15818) and tvOS v1.36 (10896) with the following changes:

  • Fixed support for PCM, MP1 and MP2 audio tracks.
  • Fixed bug where playback could start with black screen but audio.
  • (tvOS only) Fixed MANY issues with remote control, added ±10sec gestures, etc.
  • (iOS only) Fixed issue with synced videos that would play with no sound. Hopefully, this time is actually fixed :sweat_smile:

We keep working on more improvements of the Apple TV control, and bugfixing in general. Keep the feedback coming! :smile:

3 Likes

Released new beta for tvOS v1.36 (10914) with the following changes:

  • Fixed huge performance issue with videos without seek thumbnails (specially noticeable in Apple TV 4K).
  • Fixed issue where all episodes would have the show art in the Season screen.
2 Likes

Released new betas for iOS v5.9 (16047) and tvOS v1.37 (11119) with the following changes:

  • Fixed many crashes when stopping playback with the new player.
  • Fixed crashes with certain HEVC video files.
  • Fixed problem with wrong tone-mapping algorithm.
  • Added support for VC-1 codec in devices that can play smoothly (iPhone 7 and newer, iPad Pro from 2017 and newer, Apple TV 4K).
  • (tvOS only) Now Apple TV 4th gen won’t show the new “Display Type” setting, since it doesn’t support HDR anyway.
2 Likes

We found a problem with VC-1 support, you can expect new builds shortly… sorry about that!

2 Likes

Released new betas for iOS v5.9 (16054) and tvOS v1.37 (11125) with the following changes:

  • Fixed an issue where VC-1 would not direct play for some users.

Thank you all for your feedback!

3 Likes

Released new betas for iOS v5.10 (16399) and tvOS v1.38 (11467) with the following changes:

  • (tvOS only) Initial support for HDR content played in HDR displays with the enhanced video player. Remember to set the Display Type (in the app settings) to either Auto or HDR if Auto doesn’t work.
  • Fixed stuttering issue with the enhanced video player.
  • The app would crash when moving it to background while playing video with the enhanced video player.
  • (iOS only) Fixed Picture in Picture button not working on the first time it’s tapped.

We keep working on more bugfixing and improved support with the enhanced video player. Stay tuned!

4 Likes

We’re still working on the stuttering issue with HDR playback, it’s more challenging than we anticipated. Because of that, we decided to temporarily disable HDR with the enhanced video player until this is fixed.

Sorry for any inconvenience.

Released new betas for iOS v5.11 (16550) and tvOS v1.39 (11615) with the following changes:

  • Added Live TV support to the enhanced video player.
  • Added support for deinterlacing videos with the enhanced video player.
  • Enhanced Video Player uses System’s Subtitles & Captioning settings.
  • Fixed crash after a few minutes of playback with the enhanced video player.
  • (tvOS only) Fixed an issue with the enhanced video player where playback could be resumed while the screensaver was visible.
  • (tvOS only) Video would look darker sometimes if you’re pressing the remote control while the video is loading.
5 Likes

Over the last few releases, you probably noticed some small improvements in the enhanced video player:

  • Improved subtitle support
  • Now it plays transcoded and remuxed streams (that requires Plex Media Server 1.15.2), reducing the amount of scenarios where video needs to be transcoded. This is the first time the enhanced video player gives an alternative to TrueHD audio, by converting the audio stream to the lossless format FLAC.
  • Many bugs fixed.

Today we released new betas for iOS v5.17 (17571) and tvOS v2.4 (12618) with the following changes in the enhanced video player:

  • The video render method has changed to reduce stuttering and frames being dropped.
  • (tvOS only) Initial support for HDR playback with the new enhanced video player.
  • (tvOS only) The app now seeks correctly in response to Siri remote voice commands when using the enhanced video player.
1 Like

Thanks to all users reporting playback issues in the latest betas. We’re aware of the problem, which is easier to reproduce when playing some specific formats like VC-1 and MPEG2. It manifests as the app getting stuck with a spinner, like it’s loading the video, and then it crashes and closes (or you’re forced to close it manually).

We have fixed the issue and will release a new beta as soon as possible.

Thanks for your patience and sorry for any inconvenience.

1 Like