Meta Learning Shared Hierarchies Notation S: state space. A: action space. MDP: transition function P(s’, r|s, a), (s’, r): next state and reward, (s,a): state and action. PM : distribution over MDPs M with the same state-action space (S, A). Agent: a function mapping from a multi-episode history (s0, a0, r0, s1, a2, r2, …… read more »
Hierarchical Policy Gradient Algorithms Math Notation M : the overall task MDP. {M0, M1, M2 , M3 , . . . , Mn } : a finite set of subtask MDPs. Mi : subtask, models a subtask in the hierarchy. M0 : root task and solving it solves the entire MDP M. i : non-primitive subtask, paper uses… read more »
Hierarchical Actor-Critic Download Hierarchical_Actor-Critic Flowchart Terminology Artificial intelligence Optimization/decision/control a Agent Controller or decision maker b Action Control c Environment System d Reward of a stage (Opposite of) Cost of a stage e Stage value (Opposite of) Cost of a state f Value (or state-value) function (Opposite of) Cost function g Maximizing the value function… read more »
Consider two features x1, x2 for a single training set:
Download Radix Sort // // main.cpp // Radix_Sort // // Created by Z Pei on 12/24/18. // Copyright © 2018 Z Pei. All rights reserved. // // C++ implementation of Radix Sort #include<iostream> using namespace std; // A utility function to get maximum value in arr[] int getMax(int arr[], int n) { int… read more »
Download Bucket Sort // // main.cpp // Bucket_Sort // // Created by Z Pei on 12/24/18. // Copyright © 2018 Z Pei. All rights reserved. // // C++ program to sort an array using bucket sort #include <iostream> #include <algorithm> #include <vector> using namespace std; // Function to sort arr[] of size n using bucket… read more »
Download Counting Sort // // main.cpp // Counting_Sort // // Created by Z Pei on 12/24/18. // Copyright © 2018 Z Pei. All rights reserved. // // C Program for counting sort #include <stdio.h> #include <string.h> #define RANGE 255 // The main function that sort the given string arr[] in // alphabatical order void countSort(char… read more »
Geeks for Geeks for Heap Sort. Visualization for Heap Sort. Animation for Heap Sort. Download Heap Sort // // main.cpp // Heap_Sort // // Created by Z Pei on 12/24/18. // Copyright © 2018 Z Pei. All rights reserved. // // C++ program for implementation of Heap Sort #include <iostream> using namespace std;… read more »
Download Quick Sort // // main.cpp // Quick_Sort // // Created by Z Pei on 12/24/18. // Copyright © 2018 Z Pei. All rights reserved. // /* C implementation QuickSort */ #include<stdio.h> // A utility function to swap two elements void swap(int* a, int* b) { int t = *a; *a… read more »
Download Merge Sort // // main.cpp // Merge_Sort // // Created by Z Pei on 12/23/18. // Copyright © 2018 Z Pei. All rights reserved. // /* C program for Merge Sort */ #include<stdlib.h> #include<stdio.h> // Merges two subarrays of arr[]. // First subarray is arr[l..m] // Second subarray is arr[m+1..r] void merge(int arr[], int… read more »