I’m going to suggest something slightly different to your suggestion, but Buffering Troubleshooting - some kind of system/network benchmark was closed as duplicate.
In addition to benchmarking the server, it’d be great if there were an inbuilt tool to benchmark/diagnose the client+server end-to-end. This would help understand if the client, server, and network are adequate, identify optimal settings, and troubleshoot any issues.
Some things I’d like to see are
- Connection quality between client and server (eg. using iperf)
- Transcoding performance of the client (not aware of any good way to do this)
- Transcoding performance of the server (probably lots of ways to do this)
- Performance with different bitrates, codecs, subtitle formats
- Impact of various settings (subtitle burning, refresh rate switching, io cache)
With this tool, perhaps you could also set up a database of hardware config and benchmark scores to:
- Help people purchase appropriate hardware
- Benchmark consumer client devices (xbox, CCwGTV, Apple TV, Nvidia Shield, etc)
- Help people identify if their device is performing worse than other identical devices
