I seem to have solved the annoying "Device Unreachable" or out of range problem by disabling 5G on my wifi router. When I did this all my disconnected smart plugs suddenly reconnected on their own. I didn't have to reset them manually at all. 
I did some reading about the difference between 2.4G and 5G and it turns out that 2.4G has better range and better ability to pass through walls etc.  5G is faster but these devices don't seem to need the speed as much as the range. My smart TV is still working fine as well. I Will keep my fingers crossed in hopes that this has solved my problem for good.