Downloads Filling Transcoder Temp Directory

Server Version#: 1.41.0.8994
Player Version#: Android 10.24.0.2257

I (like many) use /dev/shm for my temporary transcoder directory. This works great for daily use. I have 24G of the total 32G the system has dedicated for this. Unfortunately, this seems to be causing an issue when doing downloads to my mobile devices. Plex seems to create the Output.mkv files but fails to push them to the device and then abandons them on the temporary folder. This causes the ramdisk to become full which then causes regular viewing to fail. The only fix is to go and manually delete them.

plex@plex:/dev/shm/Transcode$ ls -lsR
.:
total 0
0 drwxr-xr-x 2 plex plex  40 Nov 22 21:31 Detection
0 drwxr-xr-x 2 plex plex  40 Nov 17 10:01 Downloads
0 drwxr-xr-x 6 plex plex 120 Nov 22 21:31 Sessions

./Detection:
total 0

./Downloads:
total 0

./Sessions:
total 0
0 drwxr-xr-x 2 plex plex   60 Nov 19 13:15 plex-transcode-01c6c36dc909f41e7cd10722fa2b2cbde645749a-2416a76b-efe4-4ddc-9b64-37f2cce72bb7
0 drwxr-xr-x 2 plex plex   60 Nov 18 23:42 plex-transcode-594914e6a084ee7968b949142d9307e35784e258-cf6a1a6b-1e7c-48a3-94f0-2eb206cfc2be
0 drwxr-xr-x 2 plex plex   60 Nov 18 23:37 plex-transcode-d75557af8ad7f7346a3be98132e24f7e470dda3a-0af9d3ca-76c4-4bd4-b0b3-4fb0526277a6
0 drwxr-xr-x 2 plex plex 2520 Nov 20 21:05 plex-transcode-dgn0i39gkgqfz4ajgfdeiero-88e4951b-6bbf-4090-86a1-426f03fda679

./Sessions/plex-transcode-01c6c36dc909f41e7cd10722fa2b2cbde645749a-2416a76b-efe4-4ddc-9b64-37f2cce72bb7:
total 19094416
19094416 -rw-r--r-- 1 plex plex 19552681984 Nov 19 23:37 Output.mkv

./Sessions/plex-transcode-594914e6a084ee7968b949142d9307e35784e258-cf6a1a6b-1e7c-48a3-94f0-2eb206cfc2be:
total 2840084
2840084 -rw-r--r-- 1 plex plex 2908242584 Nov 19 01:06 Output.mkv

./Sessions/plex-transcode-d75557af8ad7f7346a3be98132e24f7e470dda3a-0af9d3ca-76c4-4bd4-b0b3-4fb0526277a6:
total 2819160
2819160 -rw-r--r-- 1 plex plex 2886819559 Nov 19 01:06 Output.mkv

./Sessions/plex-transcode-dgn0i39gkgqfz4ajgfdeiero-88e4951b-6bbf-4090-86a1-426f03fda679:
total 79920
 852 -rw-r--r-- 1 plex plex  868865 Nov 20 21:05 chunk-stream0-03178.m4s
1448 -rw-r--r-- 1 plex plex 1480648 Nov 20 21:05 chunk-stream0-03179.m4s
1900 -rw-r--r-- 1 plex plex 1943971 Nov 20 21:05 chunk-stream0-03180.m4s
 376 -rw-r--r-- 1 plex plex  381820 Nov 20 21:05 chunk-stream0-03181.m4s

Given most hard drives are capable of 250-ish MB/sec (2.5 Gbps),
do you really need to use memory for trancoding / video ?

Its more of the fact that the large number of reads and writes absolutely destroys my nvme. I’ve had 2 go out so far in my server because of this. By using the shm it keeps the drive quiet and prevents failure.

@pappavanwinkle

Which vendor & model SSDs are you using?

I’ve got SSDs purchased in 2017 which are still going strong running PMS (metadata and transcoding) with the entire OS on them.

Samsung 970evo in a NUC11

Irrespective of the device, the issue is that it’s not removing the stale files on failure. I dont run out of space until multiple have built up. It should delete those files when it fails.

@pappavanwinkle

I was only asking about the SSD because I’ve seen cases where folks will use a 150 or 300 TBW SSD for the entire machine and wonder why it’s burning out.

I use 970 Pro (2x 1TB) in my machine . 1200 TBW each.

I’m trying to recreate the problem and cannot.

  • While preparing download
[chuck@glockner Sessions.2016]$ ll
total 0
drwxr-xr-x 3 plex plex 60 Nov 22 23:11 ./
drwxr-xr-x 4 plex plex 80 Nov 20 00:07 ../
drwxr-xr-x 2 plex plex 60 Nov 22 23:11 plex-transcode-ae79f53b6b472f9a90e73353077a6dd824036f2d-194ed677-e732-4f59-994a-db5882cd506d/
[chuck@glockner Sessions.2017]$ du -hs .
  • After cancelling the download from the iOS app.
[chuck@glockner Sessions.2019]$ ls -la
total 0
drwxr-xr-x 2 plex plex 40 Nov 22 23:15 ./
drwxr-xr-x 4 plex plex 80 Nov 20 00:07 ../
[chuck@glockner Sessions.2020]$ 

May I see your server DEBUG logs ZIP file which captures the download session terminating ? I suspect a permissions problem there somewhere

If this were a PMS error, I would think there’d be a lot of other reports (?)

Ill attempt to pull a log tomorrow. Its not so much a cancel as a failure also. The downloads also dont always fail. Ive had several succeed without issue. This only happens when a failure does occur.

Anything which shows me an error (of any kind) is of huge help.

I haven’t been able to get it to crash on a download this morning despite trying. It’s very hit and miss for no real reason. As an alternative, it would be nice if you could specify a different transcoder directory for active streams versus downloads. I wouldn’t really have an issues letting downloads use the NVMe.

It’s not so much the TBW, but the distribution. It’s been a while since I’ve dug into this but in the past the linux kernel did a horrible job distributing the blocks across the SSD/NVMe over the lifetime. I had issues where the first 10% of the drive would just have enormous block failures because it wasn’t spreading the writes across the whole thing. This was especially common on systems with log files that would roll all day long. I’ve lost enough data on SSD/NVMe that I prefer to keep things like temp files and log files (not important ones) in /dev/shm so they don’t eat the drive.

I think I figured out how to recreate it, I just don’t have everything here right now to do it. This problem came up when we were about to go out of town as a family. Several of us were trying to download at once (not everyone is home right now for me to replicate). I believe it’s possible that the /dev/shm ran out of space which caused all of the downloads to fail. This then caused the situation where nothing cleaned up.

@pappavanwinkle

We looked through the history of issues and found one where the app’s failure (device full) would cause an infinite loop and not clean up the transcode session directory.

While you’re gone, I’ll try to recreate it.
(I have 512GB phone so it will take some doing :wink:

You can limit the number of simultaneous transcodes to lessen the load on memory

Interesting. Definitely not full on our device side. My phone still has 250gb free.

As far as limiting, that will cause problems with my actual streaming unfortunately.

That’s not how SSDs work. The SSD has a controller and translation layer, internally remapping every write across the physical cells. They also migrate data between cells to ensure good wear leveling. The kernel isn’t aware of this at all. It’s all done in the SSD itself.

A drive will deliver the same TBW if writing giant files, filling the whole thing, or by rewriting the same 1MB file repeatedly. In both cases the writes are spread across all of the physical cells.

Every time a logical block is overwritten, the controller grabs a fresh empty physical cell. It never overwrites the same physical cell. The controller updates the translation layer mapping every time.

Cheap USB flash keys are a different story. They have stupid controllers and really low TBW ratings.

1 Like

So, it used to be, maybe not so much now. Again, I said I haven’t looked into this in a while as moving things off to /dev/shm resolved my issues. I had a slew of issues with this a few years ago on ubuntu and ESXi hosts burning out their NVMe drives which ultimately was caused because of the linux kernel and drivers. The number of dead sectors in the first 10-20% was like 90% after 18 months or something insane like that. Things like TRIM weren’t implemented as quickly on linux as they were in Windows and when it was it didn’t work great. Either way, not ultimately relevant to the issue at hand here, was just context for why decisions were made.

@ChuckPa

Took some effort but I managed to make some fail and leave a stale file on the drive.

These two never went away:
plex-transcode-457471c72b9262b58fddcc8ce9539cae67a8e1bc-4cfbeda3-9653-4dd8-aa84-4a8c4754adf0
plex-transcode-2b276e219f48d9fbeedc907841f59518adb007de-f32fe0f0-d68c-40a1-9c0e-424b491b97df

I did this by repeatedly (but slowly) flipping my phone from wifi to cell while transcodes/downloads were going. Few minutes between each, enough for it to get spun up and start to download. To note, this is not what was happening when I first saw the issue, I was just sitting on my couch at that time. When I do a ā€œpsā€ the Plex Transcoder does not show up for either of those anymore. I pulled the log and attached it.

Plex Media Server Logs_2024-11-23_20-30-35.zip (3.9 MB)

Got another one to jam…

plex-transcode-457471c72b9262b58fddcc8ce9539cae67a8e1bc-ec317c7d-080a-41ab-942a-9afbb02227da

Plex Media Server Logs_2024-11-23_20-59-49.zip (4.0 MB)

In these logs, I find:

  • A device name PMS doesn’t understand. The names should be generated by Plex apps. Do you recognize this? They occur throughout the logs.

[MetadataAgent/tv.plex.agents.series] [HttpHeader] invalid ā€˜X-Plex-Device-Name’ header value (Mjƶlnir)

  • Missing directory or damaged filesystem ?

Nov 23, 2024 20:58:07.110 [139723132025656] WARN - Error scanning directory, we’ll skip and continue: boost::filesystem::last_write_time: No such file or directory [system:2]: ā€œ/volume1/ARCHIVE/archive1/tv-4k/Arcaneā€

  • Transcode / conversion started then aborted
Nov 23, 2024 20:15:35.809 [139719682063160] DEBUG - [Req#2b6a2a6/Transcode] TPU: hardware transcoding: final decoder: vaapi, final encoder: vaapi
Nov 23, 2024 20:15:35.809 [139719682063160] DEBUG - [Req#2b6a2a6/Transcode/JobRunner] Job running: EAE_ROOT=/tmp/pms-2dab8fa4-64ea-4b19-af6c-dc44836c3637/EasyAudioEncoder EnableAIL=0 FFMPEG_EXTERNAL_LIBS='/var/lib/plexmediaserver/Library/Application\ Support/Plex\ Media\ Server/Codecs/7592546-570471557d92948f58893deb-linux-x86_64/' LIBVA_DRIVERS_PATH="/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Cache/va-dri-linux-x86_64" NEOReadDebugKeys=1 OCL_ICD_VENDORS="/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Cache/cl-icds-linux-x86_64" X_PLEX_TOKEN=xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx cl_cache_dir="/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Cache/Shaders/icr-e8d3b00e629bec95ae9f2c9a-linux-x86_64/" "/usr/lib/plexmediaserver/Plex Transcoder" -codec:0 hevc -hwaccel:0 vaapi -hwaccel_fallback_threshold:0 10 -hwaccel_output_format:0 vaapi -hwaccel_device:0 vaapi -codec:1 truehd_eae -eae_prefix:1 f2df168a1cf06af467904050e617f3e5c1df6bf3_ -analyzeduration 20000000 -probesize 20000000 -i "/volume1/RAID/movies/downloads/completed/radarr/Deadpool 3 ()/Deadpool.and.Wolverine.2024.UHD.BluRay.2160p.TrueHD.Atmos.7.1.DV.HEVC.REMUX-FraMeSToR.mkv" -filter_complex "[0:0]hwupload[0];[0]scale_vaapi=w=1920:h=1080:format=p010[1];[1]hwmap=derive_device=opencl[2];[2]tonemap_opencl=tonemap=hable:format=nv12:m=bt709:p=bt709:r=tv[3];[3]hwmap=derive_device=vaapi:reverse=1[4];[4]hwupload[5]" -map "[5]" -codec:0 h264_vaapi -b:0 5325k -maxrate:0 7100k -bufsize:0 14200k -r:0 23.975999999999999 -filter_complex "[0:1] aresample=async=1:ochl='7.1':rematrix_maxval=0.000000dB:osr=48000[6]" -map "[6]" -metadata:s:1 language=eng -codec:1 libopus -b:1 424k -map 0:4 -metadata:s:2 language=eng -codec:2 ass -strict_ts:2 0 -f matroska -map_metadata -1 -map_chapters -1 Output.mkv -init_hw_device vaapi=vaapi:/dev/dri/renderD128,driver=iHD -filter_hw_device vaapi -y -nostats -loglevel quiet -loglevel_plex error -progressurl http://127.0.0.1:32400/video/:/transcode/session/f2df168a1cf06af467904050e617f3e5c1df6bf3/9b619885-2b43-4898-a753-22afd8b4ed6f/progress
Nov 23, 2024 20:15:35.809 [139719682063160] DEBUG - [Req#2b6a2a6/Transcode/JobRunner] In directory: "/dev/shm/Transcode/Sessions/plex-transcode-f2df168a1cf06af467904050e617f3e5c1df6bf3-9b619885-2b43-4898-a753-22afd8b4ed6f"
Nov 23, 2024 20:15:35.809 [139719682063160] DEBUG - [Req#2b6a2a6/Transcode/JobRunner] Jobs: Starting child process with pid 1790777
Nov 23, 2024 20:15:35.810 [139719483222840] DEBUG - [Req#2b6a2a6/Transcode] Whacked session 457471c72b9262b58fddcc8ce9539cae67a8e1bc, 3 remaining.
Nov 23, 2024 20:15:35.811 [139719662820152] DEBUG - Request: [127.0.0.1:50914 (Loopback)] PUT /video/:/transcode/session/f2df168a1cf06af467904050e617f3e5c1df6bf3/9b619885-2b43-4898-a753-22afd8b4ed6f/progress?status=startup (16 live) #2b6a2a4 Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:15:35.811 [139723157338936] DEBUG - Completed: [127.0.0.1:50914] 204 PUT /video/:/transcode/session/f2df168a1cf06af467904050e617f3e5c1df6bf3/9b619885-2b43-4898-a753-22afd8b4ed6f/progress?status=startup (16 live) #2b6a2a4 0ms 203 bytes (pipelined: 1) (range: bytes=0-) 
Nov 23, 2024 20:15:35.815 [139719474797368] DEBUG - Request: [127.0.0.1:50914 (Loopback)] PUT /video/:/transcode/session/f2df168a1cf06af467904050e617f3e5c1df6bf3/9b619885-2b43-4898-a753-22afd8b4ed6f/progress?status=startup (16 live) #2b6a2b9 Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:15:35.815 [139723159448376] DEBUG - Completed: [127.0.0.1:50914] 204 PUT /video/:/transcode/session/f2df168a1cf06af467904050e617f3e5c1df6bf3/9b619885-2b43-4898-a753-22afd8b4ed6f/progress?status=startup (16 live) #2b6a2b9 0ms 203 bytes (pipelined: 2) (range: bytes=0-) 
Nov 23, 2024 20:15:35.815 [139719421299512] DEBUG - Request: [127.0.0.1:50914 (Loopback)] PUT /video/:/transcode/session/f2df168a1cf06af467904050e617f3e5c1df6bf3/9b619885-2b43-4898-a753-22afd8b4ed6f/progress?status=opening (16 live) #2b6a2ba Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:15:35.815 [139723157338936] DEBUG - Completed: [127.0.0.1:50914] 204 PUT /video/:/transcode/session/f2df168a1cf06af467904050e617f3e5c1df6bf3/9b619885-2b43-4898-a753-22afd8b4ed6f/progress?status=opening (16 live) #2b6a2ba 0ms 203 bytes (pipelined: 3) (range: bytes=0-) 
Nov 23, 2024 20:15:35.817 [139719662820152] DEBUG - Request: [127.0.0.1:50914 (Loopback)] PUT /video/:/transcode/session/f2df168a1cf06af467904050e617f3e5c1df6bf3/9b619885-2b43-4898-a753-22afd8b4ed6f/progress?status=opened (16 live) #2b6a2bb Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:15:35.817 [139723159448376] DEBUG - Completed: [127.0.0.1:50914] 204 PUT /video/:/transcode/session/f2df168a1cf06af467904050e617f3e5c1df6bf3/9b619885-2b43-4898-a753-22afd8b4ed6f/progress?status=opened (16 live) #2b6a2bb 0ms 203 bytes (pipelined: 4) (range: bytes=0-) 
Nov 23, 2024 20:15:35.817 [139719474797368] DEBUG - Request: [127.0.0.1:50914 (Loopback)] PUT /video/:/transcode/session/f2df168a1cf06af467904050e617f3e5c1df6bf3/9b619885-2b43-4898-a753-22afd8b4ed6f/progress/stream?index=0&id=0&codec=hevc&type=video (16 live) #2b6a2bc Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:15:35.817 [139723159448376] DEBUG - Completed: [127.0.0.1:50914] 200 PUT /video/:/transcode/session/f2df168a1cf06af467904050e617f3e5c1df6bf3/9b619885-2b43-4898-a753-22afd8b4ed6f/progress/stream?index=0&id=0&codec=hevc&type=video (16 live) #2b6a2bc 0ms 195 bytes (pipelined: 5) (range: bytes=0-) 
Nov 23, 2024 20:15:35.817 [139719421299512] DEBUG - Request: [127.0.0.1:50914 (Loopback)] PUT /video/:/transcode/session/f2df168a1cf06af467904050e617f3e5c1df6bf3/9b619885-2b43-4898-a753-22afd8b4ed6f/progress/stream?index=1&id=0&codec=truehd&type=audio (16 live) #2b6a2bd Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:15:35.817 [139723159448376] DEBUG - Completed: [127.0.0.1:50914] 200 PUT /video/:/transcode/session/f2df168a1cf06af467904050e617f3e5c1df6bf3/9b619885-2b43-4898-a753-22afd8b4ed6f/progress/stream?index=1&id=0&codec=truehd&type=audio (16 live) #2b6a2bd 0ms 195 bytes (pipelined: 6) (range: bytes=0-) 
Nov 23, 2024 20:15:35.818 [139719662820152] DEBUG - Request: [127.0.0.1:50914 (Loopback)] PUT /video/:/transcode/session/f2df168a1cf06af467904050e617f3e5c1df6bf3/9b619885-2b43-4898-a753-22afd8b4ed6f/progress/stream?index=2&id=0&codec=ac3&type=audio (16 live) #2b6a2be Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:15:35.818 [139723159448376] DEBUG - Completed: [127.0.0.1:50914] 200 PUT /video/:/transcode/session/f2df168a1cf06af467904050e617f3e5c1df6bf3/9b619885-2b43-4898-a753-22afd8b4ed6f/progress/stream?index=2&id=0&codec=ac3&type=audio (16 live) #2b6a2be 0ms 195 bytes (pipelined: 7) (range: bytes=0-) 
Nov 23, 2024 20:15:35.818 [139719474797368] DEBUG - Request: [127.0.0.1:50914 (Loopback)] PUT /video/:/transcode/session/f2df168a1cf06af467904050e617f3e5c1df6bf3/9b619885-2b43-4898-a753-22afd8b4ed6f/progress/stream?index=3&id=0&codec=ac3&type=audio (16 live) #2b6a2bf Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:15:35.818 [139723159448376] DEBUG - Completed: [127.0.0.1:50914] 200 PUT /video/:/transcode/session/f2df168a1cf06af467904050e617f3e5c1df6bf3/9b619885-2b43-4898-a753-22afd8b4ed6f/progress/stream?index=3&id=0&codec=ac3&type=audio (16 live) #2b6a2bf 0ms 195 bytes (pipelined: 8) (range: bytes=0-) 
Nov 23, 2024 20:15:35.832 [139723169917752] DEBUG - Jobs: '/usr/lib/plexmediaserver/Plex Transcoder' exit code for process 1790402 is -9 (signal: Killed)
  • The next transcode starts and is aborted
Nov 23, 2024 20:16:09.080 [139719421299512] DEBUG - [Req#2b6a3ff/Transcode] TPU: hardware transcoding: final decoder: vaapi, final encoder: vaapi
Nov 23, 2024 20:16:09.080 [139719421299512] DEBUG - [Req#2b6a3ff/Transcode/JobRunner] Job running: EnableAIL=0 FFMPEG_EXTERNAL_LIBS='/var/lib/plexmediaserver/Library/Application\ Support/Plex\ Media\ Server/Codecs/7592546-570471557d92948f58893deb-linux-x86_64/' LIBVA_DRIVERS_PATH="/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Cache/va-dri-linux-x86_64" NEOReadDebugKeys=1 OCL_ICD_VENDORS="/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Cache/cl-icds-linux-x86_64" X_PLEX_TOKEN=xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx cl_cache_dir="/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Cache/Shaders/icr-e8d3b00e629bec95ae9f2c9a-linux-x86_64/" "/usr/lib/plexmediaserver/Plex Transcoder" -codec:0 hevc -hwaccel:0 vaapi -hwaccel_fallback_threshold:0 10 -hwaccel_output_format:0 vaapi -hwaccel_device:0 vaapi -codec:1 dca -analyzeduration 20000000 -probesize 20000000 -i "/volume1/ARCHIVE/archive1/radarr/Predator (1987)/Predator (1987).mkv" -filter_complex "[0:0]hwupload[0];[0]scale_vaapi=w=1920:h=1080:format=p010[1];[1]hwmap=derive_device=opencl[2];[2]tonemap_opencl=tonemap=hable:format=nv12:m=bt709:p=bt709:r=tv[3];[3]hwmap=derive_device=vaapi:reverse=1[4];[4]hwupload[5]" -map "[5]" -metadata:s:0 language=eng -codec:0 h264_vaapi -b:0 5434k -maxrate:0 7246k -bufsize:0 14492k -r:0 23.975999999999999 -filter_complex "[0:1] aresample=async=1:ochl='5.1':rematrix_maxval=0.000000dB:osr=48000[6]" -map "[6]" -metadata:s:1 language=eng -codec:1 libopus -b:1 321k -f matroska -map_metadata -1 -map_chapters -1 Output.mkv -init_hw_device vaapi=vaapi:/dev/dri/renderD128,driver=iHD -filter_hw_device vaapi -y -nostats -loglevel quiet -loglevel_plex error -progressurl http://127.0.0.1:32400/video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress
Nov 23, 2024 20:16:09.080 [139719421299512] DEBUG - [Req#2b6a3ff/Transcode/JobRunner] In directory: "/dev/shm/Transcode/Sessions/plex-transcode-457471c72b9262b58fddcc8ce9539cae67a8e1bc-28945fd5-5d43-4394-b035-27a1d474a98a"
Nov 23, 2024 20:16:09.080 [139719421299512] DEBUG - [Req#2b6a3ff/Transcode/JobRunner] Jobs: Starting child process with pid 1790811
Nov 23, 2024 20:16:09.082 [139719474797368] DEBUG - Request: [127.0.0.1:50916 (Loopback)] PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress?status=startup (15 live) #2b6a3fd Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:16:09.082 [139723159448376] DEBUG - Completed: [127.0.0.1:50916] 204 PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress?status=startup (15 live) #2b6a3fd 0ms 203 bytes (pipelined: 1) (range: bytes=0-) 
Nov 23, 2024 20:16:09.086 [139719682063160] DEBUG - Request: [127.0.0.1:50916 (Loopback)] PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress?status=startup (14 live) #2b6a412 Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:16:09.086 [139723159448376] DEBUG - Completed: [127.0.0.1:50916] 204 PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress?status=startup (14 live) #2b6a412 0ms 203 bytes (pipelined: 2) (range: bytes=0-) 
Nov 23, 2024 20:16:09.086 [139719662820152] DEBUG - Request: [127.0.0.1:50916 (Loopback)] PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress?status=opening (14 live) #2b6a414 Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:16:09.086 [139723157338936] DEBUG - Completed: [127.0.0.1:50916] 204 PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress?status=opening (14 live) #2b6a414 0ms 203 bytes (pipelined: 3) (range: bytes=0-) 
Nov 23, 2024 20:16:09.087 [139719474797368] DEBUG - Request: [127.0.0.1:50916 (Loopback)] PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress?status=opened (14 live) #2b6a415 Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:16:09.087 [139723159448376] DEBUG - Completed: [127.0.0.1:50916] 204 PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress?status=opened (14 live) #2b6a415 0ms 203 bytes (pipelined: 4) (range: bytes=0-) 
Nov 23, 2024 20:16:09.087 [139719682063160] DEBUG - Request: [127.0.0.1:50916 (Loopback)] PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=0&id=0&codec=hevc&type=video (14 live) #2b6a416 Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:16:09.088 [139723159448376] DEBUG - Completed: [127.0.0.1:50916] 200 PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=0&id=0&codec=hevc&type=video (14 live) #2b6a416 0ms 195 bytes (pipelined: 5) (range: bytes=0-) 
Nov 23, 2024 20:16:09.088 [139719662820152] DEBUG - Request: [127.0.0.1:50916 (Loopback)] PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=1&id=0&codec=dts&type=audio (14 live) #2b6a417 Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:16:09.088 [139723159448376] DEBUG - Completed: [127.0.0.1:50916] 200 PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=1&id=0&codec=dts&type=audio (14 live) #2b6a417 0ms 195 bytes (pipelined: 6) (range: bytes=0-) 
Nov 23, 2024 20:16:09.088 [139719474797368] DEBUG - Request: [127.0.0.1:50916 (Loopback)] PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=2&id=0&codec=dts&type=audio (14 live) #2b6a418 Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:16:09.088 [139723157338936] DEBUG - Completed: [127.0.0.1:50916] 200 PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=2&id=0&codec=dts&type=audio (14 live) #2b6a418 0ms 195 bytes (pipelined: 7) (range: bytes=0-) 
Nov 23, 2024 20:16:09.088 [139719682063160] DEBUG - Request: [127.0.0.1:50916 (Loopback)] PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=3&id=0&codec=dts&type=audio (14 live) #2b6a419 Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:16:09.088 [139723157338936] DEBUG - Completed: [127.0.0.1:50916] 200 PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=3&id=0&codec=dts&type=audio (14 live) #2b6a419 0ms 195 bytes (pipelined: 8) (range: bytes=0-) 
Nov 23, 2024 20:16:09.088 [139719662820152] DEBUG - Request: [127.0.0.1:50916 (Loopback)] PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=4&id=0&codec=dts&type=audio (14 live) #2b6a41a Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:16:09.088 [139723159448376] DEBUG - Completed: [127.0.0.1:50916] 200 PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=4&id=0&codec=dts&type=audio (14 live) #2b6a41a 0ms 195 bytes (pipelined: 9) (range: bytes=0-) 
Nov 23, 2024 20:16:09.088 [139719474797368] DEBUG - Request: [127.0.0.1:50916 (Loopback)] PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=5&id=0&codec=ac3&type=audio (14 live) #2b6a41b Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:16:09.088 [139723157338936] DEBUG - Completed: [127.0.0.1:50916] 200 PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=5&id=0&codec=ac3&type=audio (14 live) #2b6a41b 0ms 195 bytes (pipelined: 10) (range: bytes=0-) 
Nov 23, 2024 20:16:09.088 [139719682063160] DEBUG - Request: [127.0.0.1:50916 (Loopback)] PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=6&id=0&codec=dts&type=audio (14 live) #2b6a41c Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:16:09.088 [139723159448376] DEBUG - Completed: [127.0.0.1:50916] 200 PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=6&id=0&codec=dts&type=audio (14 live) #2b6a41c 0ms 195 bytes (pipelined: 11) (range: bytes=0-) 
Nov 23, 2024 20:16:09.088 [139719662820152] DEBUG - Request: [127.0.0.1:50916 (Loopback)] PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=7&id=0&codec=dts&type=audio (14 live) #2b6a41d Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:16:09.088 [139723159448376] DEBUG - Completed: [127.0.0.1:50916] 200 PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=7&id=0&codec=dts&type=audio (14 live) #2b6a41d 0ms 195 bytes (pipelined: 12) (range: bytes=0-) 
Nov 23, 2024 20:16:09.088 [139719474797368] DEBUG - Request: [127.0.0.1:50916 (Loopback)] PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=8&id=0&codec=dts&type=audio (14 live) #2b6a41e Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:16:09.088 [139723157338936] DEBUG - Completed: [127.0.0.1:50916] 200 PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=8&id=0&codec=dts&type=audio (14 live) #2b6a41e 0ms 195 bytes (pipelined: 13) (range: bytes=0-) 
Nov 23, 2024 20:16:09.089 [139719682063160] DEBUG - Request: [127.0.0.1:50916 (Loopback)] PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=9&id=0&codec=dts&type=audio (14 live) #2b6a41f Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:16:09.089 [139723159448376] DEBUG - Completed: [127.0.0.1:50916] 200 PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=9&id=0&codec=dts&type=audio (14 live) #2b6a41f 0ms 195 bytes (pipelined: 14) (range: bytes=0-) 
Nov 23, 2024 20:16:09.089 [139719662820152] DEBUG - Request: [127.0.0.1:50916 (Loopback)] PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=10&id=0&codec=ac3&type=audio (14 live) #2b6a420 Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:16:09.089 [139723159448376] DEBUG - Completed: [127.0.0.1:50916] 200 PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=10&id=0&codec=ac3&type=audio (14 live) #2b6a420 0ms 195 bytes (pipelined: 15) (range: bytes=0-) 
Nov 23, 2024 20:16:09.089 [139719474797368] DEBUG - Request: [127.0.0.1:50916 (Loopback)] PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=11&id=0&codec=ac3&type=audio (14 live) #2b6a421 Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:16:09.089 [139723157338936] DEBUG - Completed: [127.0.0.1:50916] 200 PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=11&id=0&codec=ac3&type=audio (14 live) #2b6a421 0ms 195 bytes (pipelined: 16) (range: bytes=0-) 
Nov 23, 2024 20:16:09.089 [139719682063160] DEBUG - Request: [127.0.0.1:50916 (Loopback)] PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=12&id=0&codec=dts&type=audio (14 live) #2b6a422 Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:16:09.089 [139723159448376] DEBUG - Completed: [127.0.0.1:50916] 200 PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=12&id=0&codec=dts&type=audio (14 live) #2b6a422 0ms 195 bytes (pipelined: 17) (range: bytes=0-) 
Nov 23, 2024 20:16:09.089 [139719662820152] DEBUG - Request: [127.0.0.1:50916 (Loopback)] PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=13&id=0&codec=dts&type=audio (14 live) #2b6a423 Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:16:09.089 [139723159448376] DEBUG - Completed: [127.0.0.1:50916] 200 PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=13&id=0&codec=dts&type=audio (14 live) #2b6a423 0ms 195 bytes (pipelined: 18) (range: bytes=0-) 
Nov 23, 2024 20:16:09.089 [139719474797368] DEBUG - Request: [127.0.0.1:50916 (Loopback)] PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=14&id=0&codec=ac3&type=audio (14 live) #2b6a424 Signed-in Token (PappaVanWinkle) (range: bytes=0-) 
Nov 23, 2024 20:16:09.089 [139723157338936] DEBUG - Completed: [127.0.0.1:50916] 200 PUT /video/:/transcode/session/457471c72b9262b58fddcc8ce9539cae67a8e1bc/28945fd5-5d43-4394-b035-27a1d474a98a/progress/stream?index=14&id=0&codec=ac3&type=audio (14 live) #2b6a424 0ms 195 bytes (pipelined: 19) (range: bytes=0-) 
Nov 23, 2024 20:16:09.091 [139723169917752] DEBUG - Jobs: '/usr/lib/plexmediaserver/Plex Transcoder' exit code for process 1790465 is -9 (signal: Killed)
Nov 23, 2024 20:16:09.091 [139719589018424] DEBUG - Cleaning directory for session 2b276e219f48d9fbeedc907841f59518adb007de (/dev/shm/Transcode/Sessions/plex-transcode-2b276e219f48d9fbeedc907841f59518adb007de-e63f72ca-7b4f-4a1b-87d1-a87a5971b676)

Is this when the failure occurred ?

There is nothing in your logs which report any errors.
I only see this activity report.

Are the player devices out of memory for download?

I did some research.

Would you please be able to:

  1. Using your phone
  2. Start a download session/transcode
  3. After a few minutes (3m) – change from WiFi → LTE
  4. Let it sit in LTE a few minutes (2m)
  5. Switch back to WiFi
  6. Wait 3 minutes
  7. Download the logs from the Phone app → to your computer → Upload here.