Plex doesn’t read .nfo files. At least not without the .nfo importer agents
IMHO only if you made the mistake to put your files onto cloud storage.
If they are stored in the local network, it is doable in a manageable time frame.
You could use e.g. this mp3tag which allows you to do it on many files at once.