TBF, there may be a way to reset Wi-Fi settings without Wi-Fi connectivity, but I don’t know what it is.
Getting a new router should be fine as long as all the key settings remain the same (SSID, password, gateway, subnet, auth type). And in a pinch, you can always get a cheap router (e.g. run...