Simon Layton 2bfacff426 Fp16 training initializers ...

Summary:
Adds support for generating and training pfp16 models. Added SGD optimizer for multi-precision trainers and a new callback to data_parallel_model in order to help multi-precision models keep their different copies of parameters in sync during training.
Closes https://github.com/caffe2/caffe2/pull/697

Differential Revision: D5159712

Pulled By: salexspb

fbshipit-source-id: 60a889494d2e2f4df1d720331e19f638c5eb95cc

2017-05-31 17:46:58 -07:00

..

docs

fixed document generator for github

2017-05-15 11:40:46 -07:00

examples

add optimizer support to data_parallel_model; Use MomentumSGDUpdate

2017-05-30 12:49:57 -07:00

helpers

Fp16 training initializers

2017-05-31 17:46:58 -07:00

layers

Add batch normalization layer

2017-05-26 16:46:52 -07:00

mint

doxygen python block added

2017-03-29 06:46:16 -07:00

mkl

MKL related files with review comments incorporated

2017-04-25 00:31:29 -07:00

modeling

Fp16 training initializers

2017-05-31 17:46:58 -07:00

models

Remove map() and filter() in favor of comprehensions

2017-05-30 15:32:58 -07:00

operator_test

Make fills work with input_shape when run in CUDAContext

2017-05-30 20:47:16 -07:00

predictor

Relax requirement on the outputs of the predictor.

2017-05-30 17:23:18 -07:00

rnn

CuDNN comparison mode

2017-05-20 15:19:43 -07:00

_import_c_extension.py

doxygen python block added

2017-03-29 06:46:16 -07:00

attention.py

ModelHelper.create_param, Initializer abstraction and ParameterInfo for optimizers

2017-05-25 22:03:15 -07:00

brew_test.py

arg scope in ModelHelper

2017-05-12 11:18:59 -07:00

brew.py

String-related fixes for Python 3

2017-05-26 16:04:32 -07:00

caffe_translator_test.py

…

caffe_translator.py

Fixed typo caffe_translator.py, fixes bug #397

2017-05-24 12:18:32 -07:00

checkpoint_test.py

Adds interfaces to check the existence of a DB

2017-04-11 14:07:49 -07:00

checkpoint.py

Adds interfaces to check the existence of a DB

2017-04-11 14:07:49 -07:00

CMakeLists.txt

…

cnn.py

cnnmodelhelper deprecate warning

2017-05-18 23:35:26 -07:00

context_test.py

…

context.py

doxygen python block added

2017-03-29 06:46:16 -07:00

control_test.py

…

control.py

doxygen python block added

2017-03-29 06:46:16 -07:00

convnet_benchmarks_test.py

…

convnet_benchmarks.py

doxygen python block added

2017-03-29 06:46:16 -07:00

core_gradients_test.py

Caffe2 gradient generator bug fix

2017-05-30 18:47:08 -07:00

core_test.py

String-related fixes for Python 3

2017-05-26 16:04:32 -07:00

core.py

Caffe2 gradient generator bug fix

2017-05-30 18:47:08 -07:00

crf.py

Integrate CRF in DeepText + New caffe2 operator for viterbi decode

2017-05-01 20:39:41 -07:00

data_parallel_model_test.py

add optimizer support to data_parallel_model; Use MomentumSGDUpdate

2017-05-30 12:49:57 -07:00

data_parallel_model.py

Fp16 training initializers

2017-05-31 17:46:58 -07:00

data_workers_test.py

add test for input order

2017-05-19 23:46:38 -07:00

data_workers.py

fix race condition at terminate

2017-05-30 13:47:10 -07:00

dataio_test.py

…

dataio.py

doxygen python block added

2017-03-29 06:46:16 -07:00

dataset.py

doxygen python block added

2017-03-29 06:46:16 -07:00

db_test.py

String-related fixes for Python 3

2017-05-26 16:04:32 -07:00

device_checker.py

doxygen python block added

2017-03-29 06:46:16 -07:00

dyndep.py

doxygen python block added

2017-03-29 06:46:16 -07:00

empty.so

Adding video data layer for caffe2

2017-05-05 14:16:38 -07:00

experiment_util.py

Port Xray OC workflow to elastic_data_parallel_model

2017-05-01 00:32:47 -07:00

extension_loader.py

Make extension loader properly handle visibility.

2017-03-30 14:38:38 -07:00

gradient_check_test.py

…

gradient_checker.py

MultiRNNCell (Caffe2)

2017-05-03 10:02:31 -07:00

hsm_util.py

doxygen python block added

2017-03-29 06:46:16 -07:00

hypothesis_test_util.py

Add option to control the size of lengths tensor

2017-04-20 09:53:22 -07:00

hypothesis_test.py

cuda unique op

2017-05-11 21:08:10 -07:00

layer_model_helper.py

fix for realtime training.

2017-05-26 23:49:40 -07:00

layer_model_instantiator.py

Remove map() and filter() in favor of comprehensions

2017-05-30 15:32:58 -07:00

layer_test_util.py

Add batch normalization layer

2017-05-26 16:46:52 -07:00

layers_test.py

Add batch normalization layer

2017-05-26 16:46:52 -07:00

load_save_test.py

Allow Load operator to load into overriden names

2017-04-27 01:18:12 -07:00

lstm_benchmark.py

lstm_benchmark use rnn_cell.LSTM multicell + assertion

2017-05-04 17:02:32 -07:00

memonger_test.py

Change hypothesis settings for slow memonger test

2017-05-30 09:16:48 -07:00

memonger.py

fix another bug related to in-place ops --> treat in-place ops like any other

2017-05-24 23:32:03 -07:00

mkl_test_util.py

doxygen python block added

2017-03-29 06:46:16 -07:00

model_device_test.py

…

model_helper.py

Add description to assert in model_helper

2017-05-31 00:02:18 -07:00

mpi_python.cc

Fix pybind11 module name for MPI helpers

2017-05-02 23:18:50 -07:00

muji_test.py

…

muji.py

doxygen python block added

2017-03-29 06:46:16 -07:00

net_builder_test.py

Remove map() and filter() in favor of comprehensions

2017-05-30 15:32:58 -07:00

net_builder.py

Remove map() and filter() in favor of comprehensions

2017-05-30 15:32:58 -07:00

net_drawer.py

net_drawer: --input is required

2017-05-04 11:45:57 -07:00

net_printer_test.py

Remove map() and filter() in favor of comprehensions

2017-05-30 15:32:58 -07:00

net_printer.py

Remove map() and filter() in favor of comprehensions

2017-05-30 15:32:58 -07:00

optimizer_test_util.py

Fp16 training initializers

2017-05-31 17:46:58 -07:00

optimizer_test.py

Fp16 training initializers

2017-05-31 17:46:58 -07:00

optimizer.py

Fp16 training initializers

2017-05-31 17:46:58 -07:00

pipeline.py

Profiles pipe stages.

2017-05-24 12:02:03 -07:00

predictor_constants.py

Re-apply #266

2017-04-25 21:17:04 -07:00

pybind_state_gpu.cc

…

pybind_state_mkl.cc

…

pybind_state.cc

String-related fixes for Python 3

2017-05-26 16:04:32 -07:00

pybind_state.h

String-related fixes for Python 3

2017-05-26 16:04:32 -07:00

python_op_test.py

…

queue_util.py

doxygen python block added

2017-03-29 06:46:16 -07:00

record_queue.py

doxygen python block added

2017-03-29 06:46:16 -07:00

recurrent.py

Remove map() and filter() in favor of comprehensions

2017-05-30 15:32:58 -07:00

rnn_cell.py

DropoutCell as wrapper for another RNNCell

2017-05-24 11:36:45 -07:00

schema_test.py

Prevent false overwriting of a field

2017-05-02 23:18:49 -07:00

schema.py

String-related fixes for Python 3

2017-05-26 16:04:32 -07:00

scope_test.py

Fix corruption of NameScope when exception is thrown

2017-04-24 22:46:27 -07:00

scope.py

String-related fixes for Python 3

2017-05-26 16:04:32 -07:00

session_test.py

Warn on setting blob on Scalar

2017-05-01 20:18:30 -07:00

session.py

doxygen python block added

2017-03-29 06:46:16 -07:00

sparse_to_dense_mask_test.py

String-related fixes for Python 3

2017-05-26 16:04:32 -07:00

task.py

Remove map() and filter() in favor of comprehensions

2017-05-30 15:32:58 -07:00

test_util.py

doxygen python block added

2017-03-29 06:46:16 -07:00

text_file_reader.py

doxygen python block added

2017-03-29 06:46:16 -07:00

timeout_guard.py

doxygen python block added

2017-03-29 06:46:16 -07:00

toy_regression_test.py

…

tt_core_test.py

…

tt_core.py

doxygen python block added

2017-03-29 06:46:16 -07:00

utils.py

String-related fixes for Python 3

2017-05-26 16:04:32 -07:00

visualize.py

doxygen python block added

2017-03-29 06:46:16 -07:00

workspace_test.py

String-related fixes for Python 3

2017-05-26 16:04:32 -07:00

workspace.py

String-related fixes for Python 3

2017-05-26 16:04:32 -07:00