Thanks eejimm. I use to think that there was a right and wrong way to networking but I'm finding that it is more of an art. You wouldn't happen to have a diagram of what you are talking about would you? 
Would it work if I received 5 IPs from each ISP and then used VRRP on both sides of the router with failover to the different ISPs? To simplify we can even take one of the ISPs out of the mix. Have one ISP with 5 IPs. Use VRRP to one IP from the outside and then VRRP to one gateway on the inside.