So with the help of another user eric8bits, he suggested installing an older version.
I installed: plex-media-server-1-29-2-6364 which I downloaded from Download Plex Media Server 1.29.2.6364 for Windows | Uptodown.com
I completely uninstalled the Plex Media Server from my computer. Installed the earlier version. Loaded it up and where it hangs to finish the setup, this version just works perfectly.
Once it’s done installing, it shows there is an update for the server. Knowing that I could just go back to this older version, I told it to update and install. Afterwards, everything was working as it should with the most recent update.