Sure: https://support.plex.tv/articles/201941078-uninstall-plex-media-server/
However, before you throw away all the metadata and playback statistics, try “Method 2.2” from this article: You need to reclaim your server, but don't dare to touch the Windows Registry
