Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feature(pu): add Go env, AlphaZero ctree and league training #65

Open
wants to merge 41 commits into
base: main
Choose a base branch
from
Open

feature(pu): add Go env, AlphaZero ctree and league training #65

wants to merge 41 commits into from
+73,553 −360

Commits on May 3, 2023

  1. feature(pu): add init league version of alphazero config and collecto… 

    …r for tictactoe and gomoku
    @puyuan1996
    puyuan1996 committed May 3, 2023
    Configuration menu
    Copy the full SHA
    1d43e5e View commit details
    Browse the repository at this point in the history

  2. sync code

    @puyuan1996
    puyuan1996 committed May 3, 2023
    Configuration menu
    Copy the full SHA
    473cfd6 View commit details
    Browse the repository at this point in the history

Commits on May 4, 2023

  1. fix(pu): fix eval_episode_return in self_play_mode

    @puyuan1996
    puyuan1996 committed May 4, 2023
    Configuration menu
    Copy the full SHA
    7355fc8 View commit details
    Browse the repository at this point in the history

Commits on May 10, 2023

  1. feature(pu): add rule_bot as the fist init historical_player in league

    @puyuan1996
    puyuan1996 committed May 10, 2023
    Configuration menu
    Copy the full SHA
    9502336 View commit details
    Browse the repository at this point in the history

Commits on May 11, 2023

  1. fix(pu): fix gomoku_rule_bot_v0

    @puyuan1996
    puyuan1996 committed May 11, 2023
    Configuration menu
    Copy the full SHA
    0897677 View commit details
    Browse the repository at this point in the history

Commits on May 16, 2023

  1. Merge branch 'main' of https://github.com/opendilab/LightZero into de… 

    …v-league
    @puyuan1996
    puyuan1996 committed May 16, 2023
    Configuration menu
    Copy the full SHA
    43e3abf View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of https://github.com/opendilab/LightZero into de… 

    …v-league
    @puyuan1996
    puyuan1996 committed May 16, 2023
    Configuration menu
    Copy the full SHA
    8d6490a View commit details
    Browse the repository at this point in the history

  3. feature(pu): add snapshot_the_player_in_iter_zero and one_phase_step … 

    …option, fix norm_type in az prediction net, fix temperature in az_league
    @puyuan1996
    puyuan1996 committed May 16, 2023
    Configuration menu
    Copy the full SHA
    71d6eac View commit details
    Browse the repository at this point in the history

Commits on May 17, 2023

  1. fix(pu): only use the main_player transitions to tran main_player, po… 

    …lish league config
    @puyuan1996
    puyuan1996 committed May 17, 2023
    Configuration menu
    Copy the full SHA
    52b5d8c View commit details
    Browse the repository at this point in the history

  2. fix(pu): fix save transitions in battle_alphazero_collector

    @puyuan1996
    puyuan1996 committed May 17, 2023
    Configuration menu
    Copy the full SHA
    31376c6 View commit details
    Browse the repository at this point in the history

Commits on May 18, 2023

  1. fix(pu): fix new_data bug

    @puyuan1996
    puyuan1996 committed May 18, 2023
    Configuration menu
    Copy the full SHA
    0d38129 View commit details
    Browse the repository at this point in the history

  2. polish(pu): polish league config

    @puyuan1996
    puyuan1996 committed May 18, 2023
    Configuration menu
    Copy the full SHA
    cc3be43 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' of https://github.com/opendilab/LightZero into de… 

    …v-league
    @puyuan1996
    puyuan1996 committed May 18, 2023
    Configuration menu
    Copy the full SHA
    aed4f30 View commit details
    Browse the repository at this point in the history

Commits on May 24, 2023

  1. polish(pu): polish gomoku_alphazero_league_config

    @puyuan1996
    puyuan1996 committed May 24, 2023
    Configuration menu
    Copy the full SHA
    36ecf62 View commit details
    Browse the repository at this point in the history

Commits on May 30, 2023

  1. polish(pu): polish gomoku eval render

    @puyuan1996
    puyuan1996 committed May 30, 2023
    Configuration menu
    Copy the full SHA
    5dfa97c View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2023

  1. feature(pu): add init version of go env and related alphazero sp config

    @puyuan1996
    puyuan1996 committed Jun 22, 2023
    Configuration menu
    Copy the full SHA
    73c18fd View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2023

  1. feature(pu): add init version of go muzero config

    @puyuan1996
    puyuan1996 committed Jun 24, 2023
    Configuration menu
    Copy the full SHA
    aa41a55 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2023

  1. poliah(pu): polish go alphazero/muzero configs

    @puyuan1996
    puyuan1996 committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    e10e849 View commit details
    Browse the repository at this point in the history

  2. feature(pu): add eval_go_mcts_bot_speed_win-rate.py, polish test_go_m… 

    …cts_bot.py
    @puyuan1996
    puyuan1996 committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    b0509d4 View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2023

  1. feature(pu): add init versio of katago pure policy based bot (without… 

    … mcts)
    @puyuan1996
    puyuan1996 committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    689e1c7 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of https://github.com/opendilab/LightZero into de… 

    …v-league
    @puyuan1996
    puyuan1996 committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    34025e7 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'dev-league' into dev-go-league

    @puyuan1996
    puyuan1996 committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    c9359a3 View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2023

  1. polish(pu): polish katago_policy, polish test_katago_bot, fix go_env … 

    …reward bug
    @puyuan1996
    puyuan1996 committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    51df0d5 View commit details
    Browse the repository at this point in the history

  2. fix(pu): fix katago_policy cuda bug

    @puyuan1996
    puyuan1996 committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    5b68ba9 View commit details
    Browse the repository at this point in the history

Commits on Jul 6, 2023

  1. polish(pu): polish katago_policy init

    @puyuan1996
    puyuan1996 committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    b975913 View commit details
    Browse the repository at this point in the history

  2. polish katago python import

    @puyuan1996
    puyuan1996 committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    2349e28 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'dev-go' into dev-go-league

    @puyuan1996
    puyuan1996 committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    2e62926 View commit details
    Browse the repository at this point in the history

Commits on Jul 21, 2023

  1. feature(pu): add alphazero ctree init version

    @puyuan1996
    puyuan1996 committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    d6083e4 View commit details
    Browse the repository at this point in the history

  2. feature(pu): add init version of alphazero ctree

    @puyuan1996
    puyuan1996 committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    0f4803c View commit details
    Browse the repository at this point in the history

  3. polish(pu): ignore build directory

    @puyuan1996
    puyuan1996 committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    6ef40bd View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2023

  1. feature(pu): add go_bot_policy_v0 and ao_alphazero_league_config, pol… 

    …ish the update of katago_game_state
    @puyuan1996
    puyuan1996 committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    db6cca1 View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2023

  1. fix(pu): fix simulate_env_copy.battle_mode and polish softmax in mcts… 

    …_alphazero.cpp
    @puyuan1996
    puyuan1996 committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    5372979 View commit details
    Browse the repository at this point in the history

  2. fix(pu): add reset_katago_game_state() method in go_env reset()

    @puyuan1996
    puyuan1996 committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    aec6805 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2023

  1. polish(pu): polish visit_count_to_action_dist method, polish reset_ka… 

    …tago_game_state, polish go_alphazero_league_config
    @puyuan1996
    puyuan1996 committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    bfeeaf5 View commit details
    Browse the repository at this point in the history

  2. sync code

    @puyuan1996
    puyuan1996 committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    d965be2 View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2023

  1. polish(pu): optimize the get_next_action method by replacing the deep… 

    …copy operation on the env object with env.reset().
    @puyuan1996
    puyuan1996 committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    3adc32b View commit details
    Browse the repository at this point in the history

Commits on Aug 11, 2023

  1. sync code

    @puyuan1996
    puyuan1996 committed Aug 11, 2023
    Configuration menu
    Copy the full SHA
    a696efd View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of https://github.com/opendilab/LightZero into de… 

    …v-go-league-polish-copy
    @puyuan1996
    puyuan1996 committed Aug 11, 2023
    Configuration menu
    Copy the full SHA
    5138dfa View commit details
    Browse the repository at this point in the history

Commits on Aug 12, 2023

  1. fix(pu): use would_be_suicide check in katago legal_action, fix Katag… 

    …oPolicy pos_len
    @puyuan1996
    puyuan1996 committed Aug 12, 2023
    Configuration menu
    Copy the full SHA
    6bccaeb View commit details
    Browse the repository at this point in the history

Commits on Aug 13, 2023

  1. feature(pu): add get_katago_statistics_for_dataset method

    @puyuan1996
    puyuan1996 committed Aug 13, 2023
    Configuration menu
    Copy the full SHA
    bca67bc View commit details
    Browse the repository at this point in the history

  2. polish(pu): polish get_katago_statistics_for_dataset

    @puyuan1996
    puyuan1996 committed Aug 13, 2023
    Configuration menu
    Copy the full SHA
    475df17 View commit details
    Browse the repository at this point in the history