From 71ccee150da45ca3f40df8c90e8ff783bc410a09 Mon Sep 17 00:00:00 2001 From: --help Date: Tue, 8 Jun 2021 22:44:26 +0900 Subject: [PATCH 01/10] init --- docs/en_US/Release.rst | 87 ++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 87 insertions(+) diff --git a/docs/en_US/Release.rst b/docs/en_US/Release.rst index 506ff84007..300a5a9431 100644 --- a/docs/en_US/Release.rst +++ b/docs/en_US/Release.rst @@ -5,6 +5,93 @@ Change Log ========== +Release 2.3 - 6/9/2021 +----------------------- + +Major Updates +^^^^^^^^^^^^^ + +Neural Architecture Search +"""""""""""""""""""""""""" + +* Improve NAS 2.0 (Retiarii) Framework (Beta Release) + + * Support new high-level APIs: ``Repeat`` and ``Cell`` (#3481) + * Support pure-python execution engine (#3605) + * Support policy-based RL strategy (#3650) + * Support nested ModuleList (#3652) + * Refer to `here `__ for Retiarii Roadmap + +* Add new NAS algorithm: Blockwise DNAS FBNet (#3532, thanks the external contributor @alibaba-yiwuyao) + +Model Compression +""""""""""""""""" + +* Support Auto Compression Framework (#3631) +* Support slim pruner in Tensorflow (#3614) +* Support LSQ quantizer (#3503, thanks the external contributor @chenbohua3) +* Improve APIs for iterative pruners (#3507 #3688) + +Training service & Rest +""""""""""""""""""""""" + +* Support 3rd-party training service (#3662 #3726) +* Support setting prefix URL (#3625 #3674 #3672 #3643) +* Improve NNI manager logging (#3624) +* Remove tensorboard code on nnictl (#3613) + +Hyper-Parameter Optimization +"""""""""""""""""""""""""""" + +* Add new tuner: DNGO (#3479 #3707) +* Add benchmark for tuners (#3644 #3720 #3689) + +WebUI +""""" + +* Improve search parameters on trial detail page (#3651 #3723 #3715) +* Make selected trials consistent after auto-refresh in detail table (#3597) +* Add trial stdout button on local mode (#3653 #3690) + +Examples & Documentation +"""""""""""""""""""""""" + +* Promote Retiarii documentation and deprecate old NAS framework +* Convert all trial examples' from config v1 to config v2 (#3721 #3733 #3711 #3600) +* Add new jupyter notebook examples (#3599 #3700) +* Add pipeline badge in README (#3589) + +Others +"""""" + +* Upgrade dependencies in Dockerfile (#3713 #3722) +* Substitute PyYAML for ``ruamel.yaml`` (#3702) +* Update issue bug report template (#3501) +* Add pipelines for AML and hybrid training service and experiment config V2 (#3477 #3648) + + +Bug Fixes & Minor Updates +^^^^^^^^^^^^^^^^^^^^^^^^^ + +* Fix syntax error on Windows (#3634) +* Fix a logging related bug (#3705) +* Fix a bug in GPU indices (#3721) +* Fix a bug in FrameworkController (#3730) +* Fix a bug in ``export_data_url format`` (#3665) +* Report version check failure as a warning (#3654) +* Fix bugs and lints in nnictl (#3712) +* Fix bug of ``optimize_mode`` on WebUI (#3731) +* Fix bug of ``useActiveGpu`` in AML v2 config (#3655) +* Fix bug of ``experiment_working_directory`` in Retiarii config (#3607) +* Fix a bug in mask conflict (#3629, thanks the external contributor @Davidxswang) +* Fix a bug in model speedup shape inference (#3588, thanks the external contributor @Davidxswang) +* Fix a bug in multithread on Windows (#3604, thanks the external contributor @Ivanfangsc) +* Delete redundant code in training service (#3526, thanks the external contributor @maxsuren) +* Fix typo in DoReFa compression doc (#3693, thanks the external contributor @Erfandarzi) +* Update docstring in model compression (#3647, thanks the external contributor @ichejun) +* Fix a bug when using Kubernetes container (#3719, thanks the external contributor @rmfan) + + Release 2.2 - 4/26/2021 ----------------------- From ebe967984330b0c24dc91c4da95e9c06f545d025 Mon Sep 17 00:00:00 2001 From: --help Date: Tue, 8 Jun 2021 22:50:10 +0900 Subject: [PATCH 02/10] minor --- docs/en_US/Release.rst | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/docs/en_US/Release.rst b/docs/en_US/Release.rst index 300a5a9431..53b61ca032 100644 --- a/docs/en_US/Release.rst +++ b/docs/en_US/Release.rst @@ -6,7 +6,7 @@ Change Log ========== Release 2.3 - 6/9/2021 ------------------------ +---------------------- Major Updates ^^^^^^^^^^^^^ @@ -20,6 +20,7 @@ Neural Architecture Search * Support pure-python execution engine (#3605) * Support policy-based RL strategy (#3650) * Support nested ModuleList (#3652) + * Improve documentation and deprecate old NAS framework * Refer to `here `__ for Retiarii Roadmap * Add new NAS algorithm: Blockwise DNAS FBNet (#3532, thanks the external contributor @alibaba-yiwuyao) @@ -56,7 +57,6 @@ WebUI Examples & Documentation """""""""""""""""""""""" -* Promote Retiarii documentation and deprecate old NAS framework * Convert all trial examples' from config v1 to config v2 (#3721 #3733 #3711 #3600) * Add new jupyter notebook examples (#3599 #3700) * Add pipeline badge in README (#3589) From 49328240b59041a9c0a5964fbc7d10136a79d5d6 Mon Sep 17 00:00:00 2001 From: Scarlett Li <39592018+scarlett2018@users.noreply.github.com> Date: Wed, 9 Jun 2021 11:31:52 +0800 Subject: [PATCH 03/10] Update Release.rst updated the Retiarii part directly --- docs/en_US/Release.rst | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/docs/en_US/Release.rst b/docs/en_US/Release.rst index 53b61ca032..a6876c5ce7 100644 --- a/docs/en_US/Release.rst +++ b/docs/en_US/Release.rst @@ -14,14 +14,14 @@ Major Updates Neural Architecture Search """""""""""""""""""""""""" -* Improve NAS 2.0 (Retiarii) Framework (Beta Release) +* Retiarii Framework (NNI NAS 2.0) Beta Release with new features: * Support new high-level APIs: ``Repeat`` and ``Cell`` (#3481) * Support pure-python execution engine (#3605) * Support policy-based RL strategy (#3650) * Support nested ModuleList (#3652) - * Improve documentation and deprecate old NAS framework - * Refer to `here `__ for Retiarii Roadmap + * Updated documentation +**Note**: there are more exciting Retiarii features planned in future releases, please refer to `Retiarii Roadmap `__ for more information. * Add new NAS algorithm: Blockwise DNAS FBNet (#3532, thanks the external contributor @alibaba-yiwuyao) From 56e24fe9370a724268b7bb6b314db4abd6d9a99c Mon Sep 17 00:00:00 2001 From: Scarlett Li <39592018+scarlett2018@users.noreply.github.com> Date: Wed, 9 Jun 2021 14:58:16 +0800 Subject: [PATCH 04/10] Update Release.rst --- docs/en_US/Release.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/en_US/Release.rst b/docs/en_US/Release.rst index a6876c5ce7..df81a794b9 100644 --- a/docs/en_US/Release.rst +++ b/docs/en_US/Release.rst @@ -21,7 +21,7 @@ Neural Architecture Search * Support policy-based RL strategy (#3650) * Support nested ModuleList (#3652) * Updated documentation -**Note**: there are more exciting Retiarii features planned in future releases, please refer to `Retiarii Roadmap `__ for more information. +**Note**: there are more exciting Retiarii features planned in future releases, please refer to `Retiarii Roadmap `__ for more information. * Add new NAS algorithm: Blockwise DNAS FBNet (#3532, thanks the external contributor @alibaba-yiwuyao) From f30c83b2dd08dd1a6992ccea8adce6a69791af16 Mon Sep 17 00:00:00 2001 From: --help Date: Thu, 10 Jun 2021 12:58:33 +0900 Subject: [PATCH 05/10] update --- docs/en_US/Release.rst | 17 +++++++++-------- 1 file changed, 9 insertions(+), 8 deletions(-) diff --git a/docs/en_US/Release.rst b/docs/en_US/Release.rst index df81a794b9..50626a037c 100644 --- a/docs/en_US/Release.rst +++ b/docs/en_US/Release.rst @@ -5,7 +5,7 @@ Change Log ========== -Release 2.3 - 6/9/2021 +Release 2.3 - 6//2021 ---------------------- Major Updates @@ -20,8 +20,9 @@ Neural Architecture Search * Support pure-python execution engine (#3605) * Support policy-based RL strategy (#3650) * Support nested ModuleList (#3652) - * Updated documentation -**Note**: there are more exciting Retiarii features planned in future releases, please refer to `Retiarii Roadmap `__ for more information. + * Improve documentation (#3785) + + **Note**: there are more exciting features of Retiarii planned in the future releases, please refer to `Retiarii Roadmap `__ for more information. * Add new NAS algorithm: Blockwise DNAS FBNet (#3532, thanks the external contributor @alibaba-yiwuyao) @@ -39,7 +40,7 @@ Training service & Rest * Support 3rd-party training service (#3662 #3726) * Support setting prefix URL (#3625 #3674 #3672 #3643) * Improve NNI manager logging (#3624) -* Remove tensorboard code on nnictl (#3613) +* Remove outdated TensorBoard code on nnictl (#3613) Hyper-Parameter Optimization """""""""""""""""""""""""""" @@ -59,15 +60,15 @@ Examples & Documentation * Convert all trial examples' from config v1 to config v2 (#3721 #3733 #3711 #3600) * Add new jupyter notebook examples (#3599 #3700) -* Add pipeline badge in README (#3589) -Others -"""""" +Dev Excellent +""""""""""""" * Upgrade dependencies in Dockerfile (#3713 #3722) * Substitute PyYAML for ``ruamel.yaml`` (#3702) -* Update issue bug report template (#3501) * Add pipelines for AML and hybrid training service and experiment config V2 (#3477 #3648) +* Add pipeline badge in README (#3589) +* Update issue bug report template (#3501) Bug Fixes & Minor Updates From 24aaafd6107b7ba8e769c20b53a042cb854ef13e Mon Sep 17 00:00:00 2001 From: Yuge Zhang Date: Tue, 15 Jun 2021 13:49:26 +0900 Subject: [PATCH 06/10] Update all versions to v2.3 --- README.md | 4 ++-- docs/en_US/CommunitySharings/AutoCompletion.rst | 2 +- docs/en_US/NAS/Benchmarks.rst | 2 +- docs/en_US/TrainingService/AMLMode.rst | 2 +- docs/en_US/TrialExample/SquadEvolutionExamples.rst | 2 +- docs/en_US/Tutorial/Contributing.rst | 2 +- docs/en_US/Tutorial/InstallationLinux.rst | 6 +++--- docs/en_US/Tutorial/InstallationWin.rst | 4 ++-- docs/en_US/conf.py | 2 +- 9 files changed, 13 insertions(+), 13 deletions(-) diff --git a/README.md b/README.md index 415bdeb6a0..5fe91db870 100644 --- a/README.md +++ b/README.md @@ -26,7 +26,7 @@ The tool manages automated machine learning (AutoML) experiments, **dispatches a * ML Platform owners who want to **support AutoML in their platform**. ## **What's NEW!**   -* **New release**: [v2.2 is available](https://github.com/microsoft/nni/releases) - _released on April-26-2021_ +* **New release**: [v2.3 is available](https://github.com/microsoft/nni/releases) - _released on April-26-2021_ * **New demo available**: [Youtube entry](https://www.youtube.com/channel/UCKcafm6861B2mnYhPbZHavw) | [Bilibili 入口](https://space.bilibili.com/1649051673) - _last updated on Apr-21-2021_ * **New use case sharing**: [Cost-effective Hyper-parameter Tuning using AdaptDL with NNI](https://medium.com/casl-project/cost-effective-hyper-parameter-tuning-using-adaptdl-with-nni-e55642888761) - _posted on Feb-23-2021_ @@ -252,7 +252,7 @@ Note: * Download the examples via clone the source code. ```bash - git clone -b v2.2 https://github.com/Microsoft/nni.git + git clone -b v2.3 https://github.com/Microsoft/nni.git ``` * Run the MNIST example. diff --git a/docs/en_US/CommunitySharings/AutoCompletion.rst b/docs/en_US/CommunitySharings/AutoCompletion.rst index 8664aa733f..f9b97a1efb 100644 --- a/docs/en_US/CommunitySharings/AutoCompletion.rst +++ b/docs/en_US/CommunitySharings/AutoCompletion.rst @@ -25,7 +25,7 @@ Step 1. Download ``bash-completion`` cd ~ wget https://raw.githubusercontent.com/microsoft/nni/{nni-version}/tools/bash-completion -Here, {nni-version} should by replaced by the version of NNI, e.g., ``master``, ``v2.2``. You can also check the latest ``bash-completion`` script :githublink:`here `. +Here, {nni-version} should by replaced by the version of NNI, e.g., ``master``, ``v2.3``. You can also check the latest ``bash-completion`` script :githublink:`here `. .. cannot find :githublink:`here `. diff --git a/docs/en_US/NAS/Benchmarks.rst b/docs/en_US/NAS/Benchmarks.rst index 4749b46543..bc9a499907 100644 --- a/docs/en_US/NAS/Benchmarks.rst +++ b/docs/en_US/NAS/Benchmarks.rst @@ -32,7 +32,7 @@ To avoid storage and legality issues, we do not provide any prepared databases. git clone -b ${NNI_VERSION} https://github.com/microsoft/nni cd nni/examples/nas/benchmarks - Replace ``${NNI_VERSION}`` with a released version name or branch name, e.g., ``v2.2``. + Replace ``${NNI_VERSION}`` with a released version name or branch name, e.g., ``v2.3``. #. Install dependencies via ``pip3 install -r xxx.requirements.txt``. ``xxx`` can be ``nasbench101``\ , ``nasbench201`` or ``nds``. diff --git a/docs/en_US/TrainingService/AMLMode.rst b/docs/en_US/TrainingService/AMLMode.rst index aa6452917e..1f799a682d 100644 --- a/docs/en_US/TrainingService/AMLMode.rst +++ b/docs/en_US/TrainingService/AMLMode.rst @@ -124,7 +124,7 @@ Run the following commands to start the example experiment: nnictl create --config config_aml.yml -Replace ``${NNI_VERSION}`` with a released version name or branch name, e.g., ``v2.2``. +Replace ``${NNI_VERSION}`` with a released version name or branch name, e.g., ``v2.3``. Monitor your code in the cloud by using the studio -------------------------------------------------- diff --git a/docs/en_US/TrialExample/SquadEvolutionExamples.rst b/docs/en_US/TrialExample/SquadEvolutionExamples.rst index c9dd77e260..869ade893e 100644 --- a/docs/en_US/TrialExample/SquadEvolutionExamples.rst +++ b/docs/en_US/TrialExample/SquadEvolutionExamples.rst @@ -120,7 +120,7 @@ Modify ``nni/examples/trials/ga_squad/config_pai.yml``\ , here is the default co #Your nni_manager ip nniManagerIp: 10.10.10.10 tuner: - codeDir: https://github.com/Microsoft/nni/tree/v2.2/examples/tuners/ga_customer_tuner + codeDir: https://github.com/Microsoft/nni/tree/v2.3/examples/tuners/ga_customer_tuner classFileName: customer_tuner.py className: CustomerTuner classArgs: diff --git a/docs/en_US/Tutorial/Contributing.rst b/docs/en_US/Tutorial/Contributing.rst index bf8cc0a31f..43486a2be9 100644 --- a/docs/en_US/Tutorial/Contributing.rst +++ b/docs/en_US/Tutorial/Contributing.rst @@ -71,4 +71,4 @@ Our documentation is built with :githublink:`sphinx `. * It's an image link which needs to be formatted with embedded html grammar, please use global URL like ``https://user-images.githubusercontent.com/44491713/51381727-e3d0f780-1b4f-11e9-96ab-d26b9198ba65.png``, which can be automatically generated by dragging picture onto `Github Issue `__ Box. - * It cannot be re-formatted by sphinx, such as source code, please use its global URL. For source code that links to our github repo, please use URLs rooted at ``https://github.com/Microsoft/nni/tree/v2.2/`` (:githublink:`mnist.py ` for example). + * It cannot be re-formatted by sphinx, such as source code, please use its global URL. For source code that links to our github repo, please use URLs rooted at ``https://github.com/Microsoft/nni/tree/v2.3/`` (:githublink:`mnist.py ` for example). diff --git a/docs/en_US/Tutorial/InstallationLinux.rst b/docs/en_US/Tutorial/InstallationLinux.rst index 9db4b731bf..74e186e218 100644 --- a/docs/en_US/Tutorial/InstallationLinux.rst +++ b/docs/en_US/Tutorial/InstallationLinux.rst @@ -24,7 +24,7 @@ Install NNI through source code .. code-block:: bash - git clone -b v2.2 https://github.com/Microsoft/nni.git + git clone -b v2.3 https://github.com/Microsoft/nni.git cd nni python3 -m pip install --upgrade pip setuptools python3 setup.py develop @@ -37,7 +37,7 @@ If you want to perform a persist install instead, we recommend to build your own .. code-block:: bash - git clone -b v2.2 https://github.com/Microsoft/nni.git + git clone -b v2.3 https://github.com/Microsoft/nni.git cd nni export NNI_RELEASE=2.0 python3 -m pip install --upgrade pip setuptools wheel @@ -59,7 +59,7 @@ Verify installation .. code-block:: bash - git clone -b v2.2 https://github.com/Microsoft/nni.git + git clone -b v2.3 https://github.com/Microsoft/nni.git * Run the MNIST example. diff --git a/docs/en_US/Tutorial/InstallationWin.rst b/docs/en_US/Tutorial/InstallationWin.rst index c2fb9bd763..189d9fc5db 100644 --- a/docs/en_US/Tutorial/InstallationWin.rst +++ b/docs/en_US/Tutorial/InstallationWin.rst @@ -40,7 +40,7 @@ If you want to contribute to NNI, refer to `setup development environment Date: Tue, 15 Jun 2021 13:04:25 +0800 Subject: [PATCH 07/10] Update README.md --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 6e5047f5b3..b09f8bd1f8 100644 --- a/README.md +++ b/README.md @@ -27,7 +27,7 @@ The tool manages automated machine learning (AutoML) experiments, **dispatches a ## **What's NEW!**   -* **New release**: [v2.3 is available](https://github.com/microsoft/nni/releases) - _released on April-26-2021_ +* **New release**: [v2.3 is available](https://github.com/microsoft/nni/releases) - _released on June-15-2021_ * **New demo available**: [Youtube entry](https://www.youtube.com/channel/UCKcafm6861B2mnYhPbZHavw) | [Bilibili 入口](https://space.bilibili.com/1649051673) - _last updated on May-26-2021_ * **New use case sharing**: [Cost-effective Hyper-parameter Tuning using AdaptDL with NNI](https://medium.com/casl-project/cost-effective-hyper-parameter-tuning-using-adaptdl-with-nni-e55642888761) - _posted on Feb-23-2021_ From f08464ccc7007a8725741c845dae572280bbdf3f Mon Sep 17 00:00:00 2001 From: Yuge Zhang Date: Tue, 15 Jun 2021 13:04:51 +0800 Subject: [PATCH 08/10] Update Release.rst --- docs/en_US/Release.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/en_US/Release.rst b/docs/en_US/Release.rst index 50626a037c..9d7e8c119f 100644 --- a/docs/en_US/Release.rst +++ b/docs/en_US/Release.rst @@ -5,7 +5,7 @@ Change Log ========== -Release 2.3 - 6//2021 +Release 2.3 - 6/15/2021 ---------------------- Major Updates From c4fd56c7b3aef5fb1f908d7362b09b690b0cf2f6 Mon Sep 17 00:00:00 2001 From: --help Date: Tue, 15 Jun 2021 14:38:06 +0900 Subject: [PATCH 09/10] lint --- docs/en_US/Release.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/en_US/Release.rst b/docs/en_US/Release.rst index 9d7e8c119f..edbc045a35 100644 --- a/docs/en_US/Release.rst +++ b/docs/en_US/Release.rst @@ -6,7 +6,7 @@ Change Log ========== Release 2.3 - 6/15/2021 ----------------------- +----------------------- Major Updates ^^^^^^^^^^^^^ From 5a536670cd7a6e81e4d9ff5201998f2316c1a2f0 Mon Sep 17 00:00:00 2001 From: --help Date: Tue, 15 Jun 2021 15:07:15 +0900 Subject: [PATCH 10/10] update --- README.md | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index b09f8bd1f8..f871a81330 100644 --- a/README.md +++ b/README.md @@ -29,7 +29,8 @@ The tool manages automated machine learning (AutoML) experiments, **dispatches a * **New release**: [v2.3 is available](https://github.com/microsoft/nni/releases) - _released on June-15-2021_ * **New demo available**: [Youtube entry](https://www.youtube.com/channel/UCKcafm6861B2mnYhPbZHavw) | [Bilibili 入口](https://space.bilibili.com/1649051673) - _last updated on May-26-2021_ -* **New use case sharing**: [Cost-effective Hyper-parameter Tuning using AdaptDL with NNI](https://medium.com/casl-project/cost-effective-hyper-parameter-tuning-using-adaptdl-with-nni-e55642888761) - _posted on Feb-23-2021_ +* **New webinar**: [Introducing Retiarii: A deep learning exploratory-training framework on NNI](https://note.microsoft.com/MSR-Webinar-Retiarii-Registration-Live.html) - _scheduled on June-24-2021_ +* **New community channel**: [Discussions](https://github.com/microsoft/nni/discussions) ## **NNI capabilities in a glance** @@ -317,6 +318,7 @@ We appreciate all contributions and thank all the contributors! ## **Feedback** * [File an issue](https://github.com/microsoft/nni/issues/new/choose) on GitHub. +* Open or participate in a [discussion](https://github.com/microsoft/nni/discussions). * Discuss on the NNI [Gitter](https://gitter.im/Microsoft/nni?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge&utm_content=badge) in NNI. Join IM discussion groups: