May I ask which VPN you are using and on which MacOS iteration your Mac is running?
Please note using DNS other than a VPN providers default can create leaks and unusual behaviour like mentioned above.
Other settings like Killswitch can also be troublesome in some cases.
Split Tunnelling with an MacOS Monterey and Ventura is not supported due to Apple Security.