@Clive_A  Sorry let me explain clearly with some screenshots. My primary wan only has ipv4, secondary wan has ipv4 and ipv6. When I unplug my primary wan and check my  ip address on google it only show ipv6 and no ipv4, than means for some reason I'm only getting ipv6 routing on my secondary wan.

  @Clive_A  I think I have found the problem. I created a new site and started changing settings one by one. The problem is with the port forwarding, when I port forward with only my primary wan I stop getting ipv4 address on my secondary wan. I have tried this multiple times and evey time its the same issue, if I select both my wan in port forwarding rule everything works fine. For some reason port forwarding with primary wan is blocking all the traffic from secondary wan in load balancing too.