There is a difference between the location of the program files and the location of the plex library data.
@dbirch is only talking about the former, which only takes up about 265 MB.
If you really need to free some capacity on C:, move the plex data folder away from it. [HowTo] An extended guide on how to move the Plex data folder on Windows
This is completely independent from the installation location.
