Jia Yuan Yu, Shie Mannor, Nahum Shimkin: Markov Decision Processes with Arbitrary Reward Processes. Math. Oper. Res. 34(3): 737-757 (2009)