I have the same FiOS router and I’ve been struggling with the same problem. I think I solved it. I logged into the router and went to Advanced, then Universal Plug and Play, then I unchecked “Enable Automatic Cleanup of Old Unused UPnP Services”. I changed that setting several days ago and haven’t lost remote access since.
