No, that’s not how it works.
Every item in the library will retain its individual metadata agent.
Refreshing metadata will only fetch metadata from this same, individually assigned, agent.
You can only change the matching with ‘Fix Match’, or the Plex Dance.
