Actor-Critic Algorithms for Hierarchical Markov Decision Processes Actor-Critic Algorithms for Hierarchical Markov Decision Processes