Unless the new server goes offline for whatever reason. Then videos will go back to the default server until the new one comes back online.

Also note that there's no point in adding a lot of different servers. It will only use the most recent one to be added.