PGraphplan and TGraphplan are Graphplan-based planners for STRIPS-style domains that include probabilistic actions. PGraphplan finds contingent plans with highest probability of success within the horizon.
P. Andrews, J. Pane, and I. Zaihrayeu. Workshop on Discovering Meaning On the Go in Large Heterogeneous Data 2011, International Joint Conference on Artificial Intelligence, (2011)