I believe what you suggest is already covered in a wider suggestion asking for an option to manage the buffering behavior (incl. rules to preload content from „Continue Watching“
There’s been another suggestion focusing more on increasing the buffer before playing media.
Please comment/vote in those threads (as applicable) in order to help us avoid distracting or cannibalizing votes.