@Barrarar 

Someone is either starting or being introduced into your electrical outlets. Maybe a appliance starts causing too much noise disconnecting the powerline network.

When you are noticing the issue, what is the color of all the LED lights for both plugs?

@Tony 

When I noticing the issue, the colour for both plugs is green but the pair LED is not on.

@Barrarar 

Do your other devices have internet? I am wondering if the router could be losing internet.

If you are able to, plug both adapter into the same room, just to test to see if they still drop.

Just to be certain it is the powerline light so the one that looks like a house icon that is turning off?

@Tony 

I plugged them in the same room, they connected and I could connect to the internet.

And my other devices have internet when I connect them to the router.

I can plug the adapter to one of the closest outlets to the router but I can't plug it to my room.