It al had to do with the Ookla Speed Test on the Apple TV wich wasn't picking the right server.

Hi there! I've got an issue with the internet speed on my Apple TV4K. It seems to be capped at 100MBs while connecting to my (mesh)network with 1000/100. This happens on WI-FI (5Ghz) and Ethernet. My...