stored in the same folder, often as hidden file(s)
See
If the music library (or just this one album) was ever ‘touched’ by Windows Media Player, you will very likely find those hidden thumbnail images in there.
Particularly if you got the files from someone else.