Cerebras/online-normalization
Python
Captured source
source ↗Cerebras/online-normalization
Description: Online Normalization for Training Neural Networks (Companion Repository)
Language: Python
License: BSD-3-Clause
Stars: 89
Forks: 21
Open issues: 2
Created: 2019-04-04T04:45:25Z
Pushed: 2021-04-22T01:06:40Z
Default branch: master
Fork: no
Archived: no
README:
Online Normalization
Implementation of Online Normalization for Training Neural Networks. Different implementations of Online Normalization can be found in the online_norm folder. Code to reproduce experimental results can be found in the experimentation folder. The examples folder has minimally modified versions of commonly trained networks, modified to replace Batch Normalization with Online Normalization.
PyTorch Usage
Installation
cd ./online-norm/pytorch python -m pip install -e .
Usage
see ./online-norm/pytorch
TensorFlow Usage
Installation
cd ./online-norm/tensorflow python -m pip install -e .
Usage
see ./online-norm/tensorflow
Contact
The reference code in this repository is written and maintained by the authors of the research publication Online Normalization for Training Neural Networks.