Technical Report ERGO 10-008

Approximate dynamic programming with Bézier curves/surfaces for top-percentile traffic routing
Andreas Grothey and Xinan Yang


Multi-homing is used by Internet Service Provider (ISP) to connect to the Internet via different network providers. This study investigates the optimal routing strategy under multi-homing in the case where network providers charge ISPs according to top-percentile pricing (i.e. based on the θ-th highest volume of traffic shipped). We call this problem the Top-percentile Traffic Routing Problem (TpTRP).

Solution approaches based on stochastic dynamic programming require discretization in state space, which introduces a large number of state variables. This is know as the curse of dimensionality. To overcome this we suggested to use approximate dynamic programming (ADP) to construct approximations of the value function in previous work, which works nicely for medium size instances of TpTRP. In this work we keep working on the ADP model, use Bézier curves/surfaces to do the aggregation over time. This modification accelerates the efficiency of parameter training in the solution of the ADP model, which makes the real-sized TpTRP tractable.


top-percentile pricing, multi-homing, stochastic, routing policy, approximate dynamic programming, Bézier curves/surfaces




Written: 23 December 2010


Published in European Journal of Operations Research.