Simultaneous action execution. Durative actions. Stochastic action durations. Presents Concurrent Markov Decision Processes (CoMDPs) that extend MDPs by allowing multiple actions per decision epoch. Time is discretized. States are extended with time stamps, exploding the number of states.