Skip to content

Commit

Permalink
update venv (aws-neuron#504)
Browse files Browse the repository at this point in the history
Neuron SDK Release 1.19.1

* Installation instructions and Tutorial aupdates
  • Loading branch information
musunita authored and aws-mesharma committed May 28, 2022
1 parent bd7a487 commit 3a90b89
Show file tree
Hide file tree
Showing 23 changed files with 1,718 additions and 50 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -31,14 +31,7 @@ neuron-cc
Update compilation EC2 instance
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Update to the latest neuron software by executing the following commands
:

.. code:: bash
source activate aws_neuron_tensorflow_p36
conda update tensorflow-neuron
conda update numpy
Update to the latest neuron software by executing the instructions at :ref:`install-neuron-tensorflow`.

Note: if your tensorflow-neuron version on the inference instance is
lower than 1.15.0.1.0.1333.0, you will need to run this demo on
Expand All @@ -53,7 +46,7 @@ inference for the MRPC task and the saved model should be fine tuned for
MRPC. Users who need additional help to fine-tune the model for MRPC or
to create a saved model can refer to :ref:`bert-tensorflow-demo-appendix1`.

In the same conda environment and directory bert_demo scripts, run the
In the same environment and directory bert_demo scripts, run the
following :

.. code:: bash
Expand Down Expand Up @@ -81,14 +74,7 @@ aws-neuron-runtime and aws-neuron-tools.
Update inference EC2 instance
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Update to the latest neuron software by executing the following commands
:

.. code:: bash
source activate aws_neuron_tensorflow_p36
conda update tensorflow-neuron
conda update numpy
Update to the latest neuron software by executing the instructions at :ref:`install-neuron-tensorflow`.

Launching the BERT-Large demo server
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -15,10 +15,7 @@ package.
Install TensorFlow Model Server and Serving API
-----------------------------------------------

Follow the steps in the :ref:`neuron-install-guide`.

If using DLAMI and aws_neuron_tensorflow_p36 environment, you can skip
the installation step below.
Follow the steps in the :ref:`install-neuron-tensorflow`.

Then ensure you install using either apt-get or yum:

Expand Down
2 changes: 1 addition & 1 deletion neuron-guide/neuronperf/neuronperf_faq.rst
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ NeuronPerf FAQ
- When measuring end-to-end performance that includes your network serving stack. Instead, your should compare your e2e numbers to those obtained by NeuronPerf to optimize your serving overhead.

- Is NeuronPerf Open Source?
- Yes. You can :download:`download the source here</src/neuronperf/neuronperf.tar.gz>`.
- Yes. You can :download:`download the source here </src/neuronperf.tar.gz>`.

- What is the secret to obtaining the best numbers?
- There is no secret sauce. NeuronPerf follows best practices.
Expand Down
8 changes: 3 additions & 5 deletions neuron-intro/install-templates/note-setup-libnrt-warning.rst
Original file line number Diff line number Diff line change
@@ -1,7 +1,5 @@
.. important ::
For successful installation or update to Neuron 1.16.0 and newer from previous releases:
* Stop Neuron Runtime 1.x daemon (``neuron-rtd``) by running: ``sudo systemctl stop neuron-rtd``
* Uninstall ``neuron-rtd`` by running: ``sudo apt remove aws-neuron-runtime`` or ``sudo yum remove aws-neuron-runtime``
* Install or upgrade to latest Neuron driver (``aws-neuron-dkms``) by following the "Setup Guide" instructions.
* Visit :ref:`introduce-libnrt` for more information.
For successful installation or update to next releases (Neuron 1.20.0 and newer):
* Uninstall ``aws-neuron-dkms`` by running: ``sudo apt remove aws-neuron-dkms`` or ``sudo yum remove aws-neuron-dkms``
* Install or upgrade to latest Neuron driver (``aws-neuron-dkms``) by following the "Setup Guide" instructions.
1 change: 1 addition & 0 deletions neuron-intro/mxnet-setup/mxnet-install-prev.rst
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,7 @@ Install previous Neuron MXNet releases
.. toctree::
:maxdepth: 1

Neuron 1.19.0 </neuron-intro/mxnet-setup/prev-releases/neuron-1.19.0-mxnet-install>
Neuron 1.18.0 </neuron-intro/mxnet-setup/prev-releases/neuron-1.18.0-mxnet-install>
Neuron 1.17.2 </neuron-intro/mxnet-setup/prev-releases/neuron-1.17.2-mxnet-install>
Neuron 1.16.3 </neuron-intro/mxnet-setup/prev-releases/neuron-1.16.3-mxnet-install>
Expand Down
222 changes: 222 additions & 0 deletions neuron-intro/mxnet-setup/prev-releases/neuron-1.19.0-mxnet-install.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,222 @@
.. _install-neuron-1.19.0-mxnet:

Install Neuron MXNet
=====================

.. include:: /neuron-intro/install-templates/note-setup-cntr.rst


.. contents::
:local:
:depth: 2



Develop on AWS ML accelerator instance
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

.. include:: /neuron-intro/install-templates/develop_mode.rst



.. tabs::

.. group-tab:: MXNet 1.8.0

.. tabs::

.. group-tab:: Ubuntu AMI

.. include :: /neuron-intro/install-templates/note-setup-general.rst
.. program-output:: python3 src/helperscripts/neuronsetuphelper.py --file src/helperscripts/neuron-releases-manifest.json --install mxnet --mode=develop --ami=non-dlami --os=ubuntu --neuron-version=1.19.0

.. group-tab:: Amazon Linux AMI

.. include :: /neuron-intro/install-templates/note-setup-general.rst
.. program-output:: python3 src/helperscripts/neuronsetuphelper.py --file src/helperscripts/neuron-releases-manifest.json --install mxnet --mode=develop --ami=non-dlami --os=amazonlinux --neuron-version=1.19.0

.. group-tab:: Ubuntu DLAMI

.. include :: /neuron-intro/install-templates/note-setup-general.rst
.. program-output:: python3 src/helperscripts/neuronsetuphelper.py --file src/helperscripts/neuron-releases-manifest.json --install mxnet --mode=develop --ami=dlami --os=ubuntu --neuron-version=1.19.0

.. group-tab:: Amazon Linux DLAMI

.. include :: /neuron-intro/install-templates/note-setup-general.rst
.. program-output:: python3 src/helperscripts/neuronsetuphelper.py --file src/helperscripts/neuron-releases-manifest.json --install mxnet --mode=develop --ami=dlami --os=amazonlinux --neuron-version=1.19.0



.. group-tab:: MXNet 1.5.1

.. tabs::

.. group-tab:: Ubuntu AMI

.. include :: /neuron-intro/install-templates/note-setup-general.rst
.. program-output:: python3 src/helperscripts/neuronsetuphelper.py --file src/helperscripts/neuron-releases-manifest.json --install mxnet --mode=develop --ami=non-dlami --os=ubuntu --neuron-version=1.19.0 --framework-version=mxnet-1.5.1

.. group-tab:: Amazon Linux AMI

.. include :: /neuron-intro/install-templates/note-setup-general.rst
.. program-output:: python3 src/helperscripts/neuronsetuphelper.py --file src/helperscripts/neuron-releases-manifest.json --install mxnet --mode=develop --ami=non-dlami --os=amazonlinux --neuron-version=1.19.0 --framework-version=mxnet-1.5.1

.. group-tab:: Ubuntu DLAMI

.. include :: /neuron-intro/install-templates/note-setup-general.rst
.. program-output:: python3 src/helperscripts/neuronsetuphelper.py --file src/helperscripts/neuron-releases-manifest.json --install mxnet --mode=develop --ami=dlami --os=ubuntu --neuron-version=1.19.0 --framework-version=mxnet-1.5.1

.. group-tab:: Amazon Linux DLAMI

.. include :: /neuron-intro/install-templates/note-setup-general.rst
.. program-output:: python3 src/helperscripts/neuronsetuphelper.py --file src/helperscripts/neuron-releases-manifest.json --install mxnet --mode=develop --ami=dlami --os=amazonlinux --neuron-version=1.19.0 --framework-version=mxnet-1.5.1





Compile on compute instance
^^^^^^^^^^^^^^^^^^^^^^^^^^^

.. include:: /neuron-intro/install-templates/compile_mode.rst



.. tabs::

.. group-tab:: MXNet 1.8.0

.. tabs::

.. group-tab:: Ubuntu AMI

.. include :: /neuron-intro/install-templates/note-setup-general.rst
.. program-output:: python3 src/helperscripts/neuronsetuphelper.py --file src/helperscripts/neuron-releases-manifest.json --install mxnet --mode=compile --ami=non-dlami --os=ubuntu --neuron-version=1.19.0

.. group-tab:: Amazon Linux AMI

.. include :: /neuron-intro/install-templates/note-setup-general.rst
.. program-output:: python3 src/helperscripts/neuronsetuphelper.py --file src/helperscripts/neuron-releases-manifest.json --install mxnet --mode=compile --ami=non-dlami --os=amazonlinux --neuron-version=1.19.0

.. group-tab:: Ubuntu DLAMI

.. include :: /neuron-intro/install-templates/note-setup-general.rst
.. program-output:: python3 src/helperscripts/neuronsetuphelper.py --file src/helperscripts/neuron-releases-manifest.json --install mxnet --mode=compile --ami=dlami --os=ubuntu --neuron-version=1.19.0

.. group-tab:: Amazon Linux DLAMI

.. include :: /neuron-intro/install-templates/note-setup-general.rst
.. program-output:: python3 src/helperscripts/neuronsetuphelper.py --file src/helperscripts/neuron-releases-manifest.json --install mxnet --mode=compile --ami=dlami --os=amazonlinux --neuron-version=1.19.0



.. group-tab:: MXNet 1.5.1

.. tabs::

.. group-tab:: Ubuntu AMI

.. include :: /neuron-intro/install-templates/note-setup-general.rst
.. program-output:: python3 src/helperscripts/neuronsetuphelper.py --file src/helperscripts/neuron-releases-manifest.json --install mxnet --mode=compile --ami=non-dlami --os=ubuntu --neuron-version=1.19.0 --framework-version=mxnet-1.5.1

.. group-tab:: Amazon Linux AMI

.. include :: /neuron-intro/install-templates/note-setup-general.rst
.. program-output:: python3 src/helperscripts/neuronsetuphelper.py --file src/helperscripts/neuron-releases-manifest.json --install mxnet --mode=compile --ami=non-dlami --os=amazonlinux --neuron-version=1.19.0 --framework-version=mxnet-1.5.1

.. group-tab:: Ubuntu DLAMI

.. include :: /neuron-intro/install-templates/note-setup-general.rst
.. program-output:: python3 src/helperscripts/neuronsetuphelper.py --file src/helperscripts/neuron-releases-manifest.json --install mxnet --mode=compile --ami=dlami --os=ubuntu --neuron-version=1.19.0 --framework-version=mxnet-1.5.1

.. group-tab:: Amazon Linux DLAMI

.. include :: /neuron-intro/install-templates/note-setup-general.rst
.. program-output:: python3 src/helperscripts/neuronsetuphelper.py --file src/helperscripts/neuron-releases-manifest.json --install mxnet --mode=compile --ami=dlami --os=amazonlinux --neuron-version=1.19.0 --framework-version=mxnet-1.5.1



Deploy on AWS ML accelerator instance
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

.. include:: /neuron-intro/install-templates/deploy_mode.rst



.. tabs::

.. group-tab:: MXNet 1.8.0

.. tabs::

.. group-tab:: Ubuntu AMI

.. include :: /neuron-intro/install-templates/note-setup-general.rst
.. program-output:: python3 src/helperscripts/neuronsetuphelper.py --file src/helperscripts/neuron-releases-manifest.json --install mxnet --mode=deploy --ami=non-dlami --os=ubuntu --neuron-version=1.19.0

.. group-tab:: Amazon Linux AMI

.. include :: /neuron-intro/install-templates/note-setup-general.rst
.. program-output:: python3 src/helperscripts/neuronsetuphelper.py --file src/helperscripts/neuron-releases-manifest.json --install mxnet --mode=deploy --ami=non-dlami --os=amazonlinux --neuron-version=1.19.0

.. group-tab:: Ubuntu DLAMI

.. include :: /neuron-intro/install-templates/note-setup-general.rst
.. program-output:: python3 src/helperscripts/neuronsetuphelper.py --file src/helperscripts/neuron-releases-manifest.json --install mxnet --mode=deploy --ami=dlami --os=ubuntu --neuron-version=1.19.0

.. group-tab:: Amazon Linux DLAMI

.. include :: /neuron-intro/install-templates/note-setup-general.rst
.. program-output:: python3 src/helperscripts/neuronsetuphelper.py --file src/helperscripts/neuron-releases-manifest.json --install mxnet --mode=deploy --ami=dlami --os=amazonlinux --neuron-version=1.19.0




.. group-tab:: MXNet 1.5.1

.. tabs::

.. group-tab:: Ubuntu AMI

.. include :: /neuron-intro/install-templates/note-setup-general.rst
.. program-output:: python3 src/helperscripts/neuronsetuphelper.py --file src/helperscripts/neuron-releases-manifest.json --install mxnet --mode=deploy --ami=non-dlami --os=ubuntu --neuron-version=1.19.0 --framework-version=mxnet-1.5.1

.. group-tab:: Amazon Linux AMI

.. include :: /neuron-intro/install-templates/note-setup-general.rst
.. program-output:: python3 src/helperscripts/neuronsetuphelper.py --file src/helperscripts/neuron-releases-manifest.json --install mxnet --mode=deploy --ami=non-dlami --os=amazonlinux --neuron-version=1.19.0 --framework-version=mxnet-1.5.1

.. group-tab:: Ubuntu DLAMI

.. include :: /neuron-intro/install-templates/note-setup-general.rst
.. program-output:: python3 src/helperscripts/neuronsetuphelper.py --file src/helperscripts/neuron-releases-manifest.json --install mxnet --mode=deploy --ami=dlami --os=ubuntu --neuron-version=1.19.0 --framework-version=mxnet-1.5.1

.. group-tab:: Amazon Linux DLAMI

.. include :: /neuron-intro/install-templates/note-setup-general.rst
.. program-output:: python3 src/helperscripts/neuronsetuphelper.py --file src/helperscripts/neuron-releases-manifest.json --install mxnet --mode=deploy --ami=dlami --os=amazonlinux --neuron-version=1.19.0 --framework-version=mxnet-1.5.1

Loading

0 comments on commit 3a90b89

Please sign in to comment.