@TomKasa Update: I left the plug plugged in and early morning checked the app, and the remote control slider was gone (meaning server connected). I know this because the plug now shows up in my Alexa...

I have exact same issue when adding two new plugs. The plugs are the same type that are currently working, however.