update DynamicQuant op doc

This commit is contained in:
LiWanpeng 2026-06-03 16:13:02 +08:00
parent a0f640d016
commit a15ed64713
234 changed files with 621 additions and 720 deletions

Binary file not shown.

View File

@ -61,7 +61,7 @@ DSP Library C API Reference
divgrad
dropout
dropoutgrad
dynamicquant
dynamic_quant
eltwise
elu
embeddinglookup

View File

@ -0,0 +1,91 @@
DynamicQuant
=================
将浮点输入张量按给定的 scale 和 zero point 量化为 INT8 输出张量。
.. math::
q_i = \mathrm{clip}\left( \mathrm{round}\left( x_i \times \frac{1}{scale} + zp \right), -128, 127 \right)
其中:
- :math:`x_i` 为输入浮点值
- :math:`scale` 为量化比例因子
- :math:`zp` 为零点zero point
- 当输入为 :math:`+\infty` 时,输出饱和到 127
- 当输入为 :math:`-\infty` 时,输出饱和到 -128
输入:
- **real_values** - 输入浮点数据地址。
- **quant_values** - 输出 INT8 量化结果地址。
- **scale** - 量化比例因子(标量)。
- **zp** - 量化零点标量int32 类型)。
- **size** - 输入元素总数。
- **min_value** - 量化下界(通常为 -128
- **max_value** - 量化上界(通常为 127
- **core_mask** - 核掩码(仅适用于共享存储版本)。
输出:
- **quant_values** - 量化后的 INT8 结果。
支持平台:
``FT78NE``
``MT7004``
.. note::
- FT78NE 支持 fp32 → int8
- MT7004 支持 fp32, fp16 → int8
- 量化结果被限制在 ``[min_value, max_value]`` 范围内(通常为 ``[-128, 127]``
**共享存储版本:**
.. c:function:: void fp_dynamic_quant_s(float* real_values, int8_t* quant_values, float scale, int32_t zp, int size, int32_t min_value, int32_t max_value, int core_mask)
.. c:function:: void hp_dynamic_quant_s(half* real_values, int8_t* quant_values, float scale, int32_t zp, int size, int32_t min_value, int32_t max_value, int core_mask)
**C调用示例**
.. code-block:: c
:linenos:
:emphasize-lines: 13
#include <stdio.h>
int main(int argc, char* argv[]) {
float *input = (float *)0x81000000;
int8_t *output = (int8_t *)0x82000000;
float scale = 0.1f;
int32_t zp = 0;
int size = 1024;
int32_t min_value = -128;
int32_t max_value = 127;
int core_mask = 0xff;
fp_dynamic_quant_s(input, output, scale, zp, size, min_value, max_value, core_mask);
return 0;
}
**私有存储版本:**
.. c:function:: void fp_dynamic_quant_p(float* real_values, int8_t* quant_values, float scale, int32_t zp, int size, int32_t min_value, int32_t max_value)
.. c:function:: void hp_dynamic_quant_p(half* real_values, int8_t* quant_values, float scale, int32_t zp, int size, int32_t min_value, int32_t max_value)
**C调用示例**
.. code-block:: c
:linenos:
:emphasize-lines: 12
#include <stdio.h>
int main(int argc, char* argv[]) {
float *input = (float *)0x10010000;
int8_t *output = (int8_t *)0x10020000;
float scale = 0.1f;
int32_t zp = 0;
int size = 1024;
int32_t min_value = -128;
int32_t max_value = 127;
fp_dynamic_quant_p(input, output, scale, zp, size, min_value, max_value);
return 0;
}

View File

@ -1,138 +0,0 @@
DynamicQuant
=================
将 FP32 输入张量按给定的 scale 和 zero pointzp动态量化为 INT8 输出张量。
支持按整张量量化或按指定轴分段量化per-axis dynamic quantization
.. math::
q_i = \mathrm{clip}\left( \mathrm{round}\left( \frac{x_i}{scale} + zp \right), q_{min}, q_{max} \right)
其中:
- :math:`x_i` 为输入浮点值
- :math:`scale` 为量化比例因子
- :math:`zp` 为零点zero point
- :math:`q_{min} = -128`
- :math:`q_{max} = 127`
当输入为 :math:`+\infty` 或 :math:`-\infty` 时,输出分别饱和到最大或最小量化值。
---
输入:
- **real_values** - 输入 FP32 数据地址
- **element_num** - 输入元素总数
- **scale** - 量化 scale 数组地址
- **zp** - 量化 zero point 数组地址
- **segment_num** - 分段数量(用于按轴量化)
- **axis_num** - 量化轴标识
- ``0``整张量量化per-tensor
- ``!=0``按轴分段量化per-axis
输出:
- **quant_values** - 输出 INT8 量化结果地址
---
支持平台:
``FT78NE``
``MT7004``
---
.. note::
- 当前算子仅支持 **FP32\Fp16 → INT8** 的动态量化
- 当 ``axis_num = 0`` 时,仅使用 ``scale[0]`` 与 ``zp[0]`` 进行整张量量化
- 当 ``axis_num != 0`` 时,输入按 ``segment_num`` 进行分段,每段使用对应的 ``scale[i]`` 与 ``zp[i]``
- 分段大小通过 ``UP_DIV(element_num, segment_num)`` 计算,最后一段自动处理剩余元素
- 量化结果会被限制在 ``[-128, 127]`` 范围内
---
**私有存储版本:**
.. c:function:: void fp_QuantData_p(float* real_values, int8_t* quant_values, int element_num, float* scale, int* zp, int segment_num, int axis_num)
.. c:function:: void hp_QuantData_p(half* real_values, half* quant_values, int element_num, half* scale, int* zp, int segment_num, int axis_num)
---
**C调用示例**
.. code-block:: c
:linenos:
:emphasize-lines: 11
#include <stdio.h>
#include <quant.h>
int main(int argc, char* argv[]) {
float *input = (float *)0x10000000; // FP32 输入
int8_t *output = (int8_t *)0x10004000; // INT8 输出
float scale[4] = {0.1f, 0.12f, 0.11f, 0.09f};
int zp[4] = {0, 0, 0, 0};
int element_num = 1024;
int segment_num = 4;
int axis_num = 1;
fp_QuantData_p(input, output, element_num,
scale, zp, segment_num, axis_num);
return 0;
}
---
**共享存储版本:**
.. c:function:: void fp_QuantData_s(float* real_values, int8_t* quant_values, int element_num, float* scale, int* zp, int segment_num, int axis_num, int core_mask)
.. c:function:: void hp_QuantData_s(half* real_values, half* quant_values, int element_num, half* scale, int* zp, int segment_num, int axis_num, int core_mask)
---
**C调用示例**
.. code-block:: c
:linenos:
:emphasize-lines: 11
#include <stdio.h>
#include <quant.h>
int main(int argc, char* argv[]) {
float *input = (float *)0x10000000; // FP32 输入
int8_t *output = (int8_t *)0x10004000; // INT8 输出
float scale[4] = {0.1f, 0.12f, 0.11f, 0.09f};
int zp[4] = {0, 0, 0, 0};
int element_num = 1024;
int segment_num = 4;
int axis_num = 1, core_mask = 0xff;
fp_QuantData_s(input, output, element_num,
scale, zp, segment_num, axis_num, core_mask);
return 0;
}
---
**实现说明:**
- 当 ``axis_num == 0`` 时:
- 对整个输入数组执行一次统一量化
- 等价于 per-tensor quantization
- 当 ``axis_num != 0`` 时:
- 输入数据按 ``segment_num`` 均分为多个分段
- 每个分段使用独立的 ``scale[i]`` 与 ``zp[i]``
- 等价于 per-axis dynamic quantization
- 核心量化过程由 ``DoQuantizeFp32ToInt8`` 完成,包括:
- 反 scale 计算
- 四舍五入
- 饱和裁剪
- INF 特殊值处理

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3 current"><a class="current reference internal" href="#">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3 current"><a class="current reference internal" href="#">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -24,7 +24,7 @@
<script src="../../_static/js/theme.js"></script>
<link rel="index" title="索引" href="../../genindex.html" />
<link rel="search" title="搜索" href="../../search.html" />
<link rel="next" title="Adder" href="adder.html" />
<link rel="next" title="AdderFusion" href="adder.html" />
<link rel="prev" title="Adam" href="adam.html" />
</head>
@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3 current"><a class="current reference internal" href="#">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>
@ -434,7 +434,7 @@ var_t &amp;= var_{t-1} - lr \cdot (\hat{m}_t + decay \cdot var_{t-1})
</div>
<footer><div class="rst-footer-buttons" role="navigation" aria-label="页脚">
<a href="adam.html" class="btn btn-neutral float-left" title="Adam" accesskey="p" rel="prev"><span class="fa fa-arrow-circle-left" aria-hidden="true"></span> 上一页</a>
<a href="adder.html" class="btn btn-neutral float-right" title="Adder" accesskey="n" rel="next">下一页 <span class="fa fa-arrow-circle-right" aria-hidden="true"></span></a>
<a href="adder.html" class="btn btn-neutral float-right" title="AdderFusion" accesskey="n" rel="next">下一页 <span class="fa fa-arrow-circle-right" aria-hidden="true"></span></a>
</div>
<hr/>

View File

@ -25,7 +25,7 @@
<link rel="index" title="索引" href="../../genindex.html" />
<link rel="search" title="搜索" href="../../search.html" />
<link rel="next" title="Addgrad" href="addgrad.html" />
<link rel="prev" title="Adder" href="adder.html" />
<link rel="prev" title="AdderFusion" href="adder.html" />
</head>
<body class="wy-body-for-nav">
@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3 current"><a class="current reference internal" href="#">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>
@ -529,7 +529,7 @@
访问量:<span id="busuanzi_page_uv"></span>
</div>
<footer><div class="rst-footer-buttons" role="navigation" aria-label="页脚">
<a href="adder.html" class="btn btn-neutral float-left" title="Adder" accesskey="p" rel="prev"><span class="fa fa-arrow-circle-left" aria-hidden="true"></span> 上一页</a>
<a href="adder.html" class="btn btn-neutral float-left" title="AdderFusion" accesskey="p" rel="prev"><span class="fa fa-arrow-circle-left" aria-hidden="true"></span> 上一页</a>
<a href="addgrad.html" class="btn btn-neutral float-right" title="Addgrad" accesskey="n" rel="next">下一页 <span class="fa fa-arrow-circle-right" aria-hidden="true"></span></a>
</div>

View File

@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3 current"><a class="current reference internal" href="#">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3 current"><a class="current reference internal" href="#">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -59,7 +59,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -108,7 +108,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -59,7 +59,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -108,7 +108,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -59,7 +59,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -108,7 +108,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -59,7 +59,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -108,7 +108,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -59,7 +59,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -108,7 +108,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -59,7 +59,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -108,7 +108,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -59,7 +59,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -108,7 +108,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -59,7 +59,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -108,7 +108,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -59,7 +59,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -108,7 +108,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -59,7 +59,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -108,7 +108,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -59,7 +59,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -108,7 +108,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -59,7 +59,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -108,7 +108,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -59,7 +59,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -108,7 +108,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -59,7 +59,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -108,7 +108,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3 current"><a class="current reference internal" href="#">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3 current"><a class="current reference internal" href="#">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -24,7 +24,7 @@
<script src="../../_static/js/theme.js"></script>
<link rel="index" title="索引" href="../../genindex.html" />
<link rel="search" title="搜索" href="../../search.html" />
<link rel="next" title="DynamicQuant" href="dynamicquant.html" />
<link rel="next" title="DynamicQuant" href="dynamic_quant.html" />
<link rel="prev" title="Dropout" href="dropout.html" />
</head>
@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3 current"><a class="current reference internal" href="#">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>
@ -410,7 +410,7 @@
</div>
<footer><div class="rst-footer-buttons" role="navigation" aria-label="页脚">
<a href="dropout.html" class="btn btn-neutral float-left" title="Dropout" accesskey="p" rel="prev"><span class="fa fa-arrow-circle-left" aria-hidden="true"></span> 上一页</a>
<a href="dynamicquant.html" class="btn btn-neutral float-right" title="DynamicQuant" accesskey="n" rel="next">下一页 <span class="fa fa-arrow-circle-right" aria-hidden="true"></span></a>
<a href="dynamic_quant.html" class="btn btn-neutral float-right" title="DynamicQuant" accesskey="n" rel="next">下一页 <span class="fa fa-arrow-circle-right" aria-hidden="true"></span></a>
</div>
<hr/>

View File

@ -108,7 +108,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>
@ -367,7 +367,7 @@
<li class="toctree-l1"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l1"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l1"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l1"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l1"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l1"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l1"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l1"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -300,7 +300,7 @@
<li class="breadcrumb-item"><a href="dsplib_index.html">DSP Library C API Reference</a></li>
<li class="breadcrumb-item active">DynamicQuant</li>
<li class="wy-breadcrumbs-aside">
<a href="../../_sources/functionlib/dsplib/dynamicquant.rst.txt" rel="nofollow"> 查看页面源码</a>
<a href="../../_sources/functionlib/dsplib/dynamic_quant.rst.txt" rel="nofollow"> 查看页面源码</a>
</li>
</ul>
<hr/>
@ -311,154 +311,102 @@
<section id="dynamicquant">
<h1>DynamicQuant<a class="headerlink" href="#dynamicquant" title="此标题的永久链接"></a></h1>
<p>将 FP32 输入张量按给定的 scale 和 zero pointzp动态量化为 INT8 输出张量。
支持按整张量量化或按指定轴分段量化per-axis dynamic quantization</p>
<p>将浮点输入张量按给定的 scale 和 zero point 量化为 INT8 输出张量。</p>
<div class="math notranslate nohighlight">
\[q_i = \mathrm{clip}\left( \mathrm{round}\left( \frac{x_i}{scale} + zp \right), q_{min}, q_{max} \right)\]</div>
\[q_i = \mathrm{clip}\left( \mathrm{round}\left( x_i \times \frac{1}{scale} + zp \right), -128, 127 \right)\]</div>
<p>其中:</p>
<ul class="simple">
<li><p><span class="math notranslate nohighlight">\(x_i\)</span> 为输入浮点值</p></li>
<li><p><span class="math notranslate nohighlight">\(scale\)</span> 为量化比例因子</p></li>
<li><p><span class="math notranslate nohighlight">\(zp\)</span> 为零点zero point</p></li>
<li><p><span class="math notranslate nohighlight">\(q_{min} = -128\)</span></p></li>
<li><p><span class="math notranslate nohighlight">\(q_{max} = 127\)</span></p></li>
<li><p>当输入为 <span class="math notranslate nohighlight">\(+\infty\)</span> 时,输出饱和到 127</p></li>
<li><p>当输入为 <span class="math notranslate nohighlight">\(-\infty\)</span> 时,输出饱和到 -128</p></li>
</ul>
<p>当输入为 <span class="math notranslate nohighlight">\(+\infty\)</span><span class="math notranslate nohighlight">\(-\infty\)</span> 时,输出分别饱和到最大或最小量化值。</p>
<p></p>
<dl class="simple">
<dt>输入:</dt><dd><ul class="simple">
<li><p><strong>real_values</strong> - 输入 FP32 数据地址</p></li>
<li><p><strong>element_num</strong> - 输入元素总数</p></li>
<li><p><strong>scale</strong> - 量化 scale 数组地址</p></li>
<li><p><strong>zp</strong> - 量化 zero point 数组地址</p></li>
<li><p><strong>segment_num</strong> - 分段数量(用于按轴量化)</p></li>
<li><dl class="simple">
<dt><strong>axis_num</strong> - 量化轴标识</dt><dd><ul>
<li><p><code class="docutils literal notranslate"><span class="pre">0</span></code>整张量量化per-tensor</p></li>
<li><p><code class="docutils literal notranslate"><span class="pre">!=0</span></code>按轴分段量化per-axis</p></li>
</ul>
</dd>
</dl>
</li>
<li><p><strong>real_values</strong> - 输入浮点数据地址。</p></li>
<li><p><strong>quant_values</strong> - 输出 INT8 量化结果地址。</p></li>
<li><p><strong>scale</strong> - 量化比例因子(标量)。</p></li>
<li><p><strong>zp</strong> - 量化零点标量int32 类型)。</p></li>
<li><p><strong>size</strong> - 输入元素总数。</p></li>
<li><p><strong>min_value</strong> - 量化下界(通常为 -128</p></li>
<li><p><strong>max_value</strong> - 量化上界(通常为 127</p></li>
<li><p><strong>core_mask</strong> - 核掩码(仅适用于共享存储版本)。</p></li>
</ul>
</dd>
<dt>输出:</dt><dd><ul class="simple">
<li><p><strong>quant_values</strong> - 输出 INT8 量化结果地址</p></li>
<li><p><strong>quant_values</strong> - 量化后的 INT8 结果。</p></li>
</ul>
</dd>
</dl>
<p></p>
<dl class="simple">
<dt>支持平台:</dt><dd><p><code class="docutils literal notranslate"><span class="pre">FT78NE</span></code>
<code class="docutils literal notranslate"><span class="pre">MT7004</span></code></p>
</dd>
</dl>
<p></p>
<div class="admonition note">
<p class="admonition-title">备注</p>
<ul class="simple">
<li><p>当前算子仅支持 <strong>FP32Fp16 → INT8</strong> 的动态量化</p></li>
<li><p><code class="docutils literal notranslate"><span class="pre">axis_num</span> <span class="pre">=</span> <span class="pre">0</span></code> 时,仅使用 <code class="docutils literal notranslate"><span class="pre">scale[0]</span></code><code class="docutils literal notranslate"><span class="pre">zp[0]</span></code> 进行整张量量化</p></li>
<li><p><code class="docutils literal notranslate"><span class="pre">axis_num</span> <span class="pre">!=</span> <span class="pre">0</span></code> 时,输入按 <code class="docutils literal notranslate"><span class="pre">segment_num</span></code> 进行分段,每段使用对应的 <code class="docutils literal notranslate"><span class="pre">scale[i]</span></code><code class="docutils literal notranslate"><span class="pre">zp[i]</span></code></p></li>
<li><p>分段大小通过 <code class="docutils literal notranslate"><span class="pre">UP_DIV(element_num,</span> <span class="pre">segment_num)</span></code> 计算,最后一段自动处理剩余元素</p></li>
<li><p>量化结果会被限制在 <code class="docutils literal notranslate"><span class="pre">[-128,</span> <span class="pre">127]</span></code> 范围内</p></li>
<li><p>FT78NE 支持 fp32 → int8</p></li>
<li><p>MT7004 支持 fp32, fp16 → int8</p></li>
<li><p>量化结果被限制在 <code class="docutils literal notranslate"><span class="pre">[min_value,</span> <span class="pre">max_value]</span></code> 范围内(通常为 <code class="docutils literal notranslate"><span class="pre">[-128,</span> <span class="pre">127]</span></code></p></li>
</ul>
</div>
<p></p>
<p><strong>私有存储版本:</strong></p>
<dl class="c function">
<dt class="sig sig-object c" id="c.fp_QuantData_p">
<span class="kt"><span class="pre">void</span></span><span class="w"> </span><span class="sig-name descname"><span class="n"><span class="pre">fp_QuantData_p</span></span></span><span class="sig-paren">(</span><span class="kt"><span class="pre">float</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">real_values</span></span>, <span class="n"><span class="pre">int8_t</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">quant_values</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">element_num</span></span>, <span class="kt"><span class="pre">float</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">scale</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">zp</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">segment_num</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">axis_num</span></span><span class="sig-paren">)</span><a class="headerlink" href="#c.fp_QuantData_p" title="永久链接至目标"></a><br /></dt>
<dd></dd></dl>
<dl class="c function">
<dt class="sig sig-object c" id="c.hp_QuantData_p">
<span class="kt"><span class="pre">void</span></span><span class="w"> </span><span class="sig-name descname"><span class="n"><span class="pre">hp_QuantData_p</span></span></span><span class="sig-paren">(</span><span class="n"><span class="pre">half</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">real_values</span></span>, <span class="n"><span class="pre">half</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">quant_values</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">element_num</span></span>, <span class="n"><span class="pre">half</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">scale</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">zp</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">segment_num</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">axis_num</span></span><span class="sig-paren">)</span><a class="headerlink" href="#c.hp_QuantData_p" title="永久链接至目标"></a><br /></dt>
<dd></dd></dl>
<p></p>
<p><strong>C调用示例</strong></p>
<blockquote>
<div><div class="highlight-c notranslate"><div class="highlight"><pre><span></span><span class="linenos"> 1</span><span class="cp">#include</span><span class="w"> </span><span class="cpf">&lt;stdio.h&gt;</span>
<span class="linenos"> 2</span><span class="cp">#include</span><span class="w"> </span><span class="cpf">&lt;quant.h&gt;</span>
<span class="linenos"> 3</span>
<span class="linenos"> 4</span><span class="kt">int</span><span class="w"> </span><span class="nf">main</span><span class="p">(</span><span class="kt">int</span><span class="w"> </span><span class="n">argc</span><span class="p">,</span><span class="w"> </span><span class="kt">char</span><span class="o">*</span><span class="w"> </span><span class="n">argv</span><span class="p">[])</span><span class="w"> </span><span class="p">{</span>
<span class="linenos"> 5</span><span class="w"> </span><span class="kt">float</span><span class="w"> </span><span class="o">*</span><span class="n">input</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="kt">float</span><span class="w"> </span><span class="o">*</span><span class="p">)</span><span class="mh">0x10000000</span><span class="p">;</span><span class="w"> </span><span class="c1">// FP32 输入</span>
<span class="linenos"> 6</span><span class="w"> </span><span class="kt">int8_t</span><span class="w"> </span><span class="o">*</span><span class="n">output</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="kt">int8_t</span><span class="w"> </span><span class="o">*</span><span class="p">)</span><span class="mh">0x10004000</span><span class="p">;</span><span class="w"> </span><span class="c1">// INT8 输出</span>
<span class="linenos"> 7</span><span class="w"> </span><span class="kt">float</span><span class="w"> </span><span class="n">scale</span><span class="p">[</span><span class="mi">4</span><span class="p">]</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">{</span><span class="mf">0.1f</span><span class="p">,</span><span class="w"> </span><span class="mf">0.12f</span><span class="p">,</span><span class="w"> </span><span class="mf">0.11f</span><span class="p">,</span><span class="w"> </span><span class="mf">0.09f</span><span class="p">};</span>
<span class="linenos"> 8</span><span class="w"> </span><span class="kt">int</span><span class="w"> </span><span class="n">zp</span><span class="p">[</span><span class="mi">4</span><span class="p">]</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">{</span><span class="mi">0</span><span class="p">,</span><span class="w"> </span><span class="mi">0</span><span class="p">,</span><span class="w"> </span><span class="mi">0</span><span class="p">,</span><span class="w"> </span><span class="mi">0</span><span class="p">};</span>
<span class="linenos"> 9</span><span class="w"> </span><span class="kt">int</span><span class="w"> </span><span class="n">element_num</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">1024</span><span class="p">;</span>
<span class="linenos">10</span><span class="w"> </span><span class="kt">int</span><span class="w"> </span><span class="n">segment_num</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">4</span><span class="p">;</span>
<span class="hll"><span class="linenos">11</span><span class="w"> </span><span class="kt">int</span><span class="w"> </span><span class="n">axis_num</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">1</span><span class="p">;</span>
</span><span class="linenos">12</span>
<span class="linenos">13</span><span class="w"> </span><span class="n">fp_QuantData_p</span><span class="p">(</span><span class="n">input</span><span class="p">,</span><span class="w"> </span><span class="n">output</span><span class="p">,</span><span class="w"> </span><span class="n">element_num</span><span class="p">,</span>
<span class="linenos">14</span><span class="w"> </span><span class="n">scale</span><span class="p">,</span><span class="w"> </span><span class="n">zp</span><span class="p">,</span><span class="w"> </span><span class="n">segment_num</span><span class="p">,</span><span class="w"> </span><span class="n">axis_num</span><span class="p">);</span>
<span class="linenos">15</span>
<span class="linenos">16</span><span class="w"> </span><span class="k">return</span><span class="w"> </span><span class="mi">0</span><span class="p">;</span>
<span class="linenos">17</span><span class="p">}</span>
</pre></div>
</div>
</div></blockquote>
<p></p>
<p><strong>共享存储版本:</strong></p>
<dl class="c function">
<dt class="sig sig-object c" id="c.fp_QuantData_s">
<span class="kt"><span class="pre">void</span></span><span class="w"> </span><span class="sig-name descname"><span class="n"><span class="pre">fp_QuantData_s</span></span></span><span class="sig-paren">(</span><span class="kt"><span class="pre">float</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">real_values</span></span>, <span class="n"><span class="pre">int8_t</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">quant_values</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">element_num</span></span>, <span class="kt"><span class="pre">float</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">scale</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">zp</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">segment_num</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">axis_num</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">core_mask</span></span><span class="sig-paren">)</span><a class="headerlink" href="#c.fp_QuantData_s" title="永久链接至目标"></a><br /></dt>
<dt class="sig sig-object c" id="c.fp_dynamic_quant_s">
<span class="kt"><span class="pre">void</span></span><span class="w"> </span><span class="sig-name descname"><span class="n"><span class="pre">fp_dynamic_quant_s</span></span></span><span class="sig-paren">(</span><span class="kt"><span class="pre">float</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">real_values</span></span>, <span class="n"><span class="pre">int8_t</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">quant_values</span></span>, <span class="kt"><span class="pre">float</span></span><span class="w"> </span><span class="n"><span class="pre">scale</span></span>, <span class="n"><span class="pre">int32_t</span></span><span class="w"> </span><span class="n"><span class="pre">zp</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">size</span></span>, <span class="n"><span class="pre">int32_t</span></span><span class="w"> </span><span class="n"><span class="pre">min_value</span></span>, <span class="n"><span class="pre">int32_t</span></span><span class="w"> </span><span class="n"><span class="pre">max_value</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">core_mask</span></span><span class="sig-paren">)</span><a class="headerlink" href="#c.fp_dynamic_quant_s" title="永久链接至目标"></a><br /></dt>
<dd></dd></dl>
<dl class="c function">
<dt class="sig sig-object c" id="c.hp_QuantData_s">
<span class="kt"><span class="pre">void</span></span><span class="w"> </span><span class="sig-name descname"><span class="n"><span class="pre">hp_QuantData_s</span></span></span><span class="sig-paren">(</span><span class="n"><span class="pre">half</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">real_values</span></span>, <span class="n"><span class="pre">half</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">quant_values</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">element_num</span></span>, <span class="n"><span class="pre">half</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">scale</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">zp</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">segment_num</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">axis_num</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">core_mask</span></span><span class="sig-paren">)</span><a class="headerlink" href="#c.hp_QuantData_s" title="永久链接至目标"></a><br /></dt>
<dt class="sig sig-object c" id="c.hp_dynamic_quant_s">
<span class="kt"><span class="pre">void</span></span><span class="w"> </span><span class="sig-name descname"><span class="n"><span class="pre">hp_dynamic_quant_s</span></span></span><span class="sig-paren">(</span><span class="n"><span class="pre">half</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">real_values</span></span>, <span class="n"><span class="pre">int8_t</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">quant_values</span></span>, <span class="kt"><span class="pre">float</span></span><span class="w"> </span><span class="n"><span class="pre">scale</span></span>, <span class="n"><span class="pre">int32_t</span></span><span class="w"> </span><span class="n"><span class="pre">zp</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">size</span></span>, <span class="n"><span class="pre">int32_t</span></span><span class="w"> </span><span class="n"><span class="pre">min_value</span></span>, <span class="n"><span class="pre">int32_t</span></span><span class="w"> </span><span class="n"><span class="pre">max_value</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">core_mask</span></span><span class="sig-paren">)</span><a class="headerlink" href="#c.hp_dynamic_quant_s" title="永久链接至目标"></a><br /></dt>
<dd></dd></dl>
<p></p>
<p><strong>C调用示例</strong></p>
<blockquote>
<div><div class="highlight-c notranslate"><div class="highlight"><pre><span></span><span class="linenos"> 1</span><span class="cp">#include</span><span class="w"> </span><span class="cpf">&lt;stdio.h&gt;</span>
<span class="linenos"> 2</span><span class="cp">#include</span><span class="w"> </span><span class="cpf">&lt;quant.h&gt;</span>
<span class="linenos"> 3</span>
<span class="linenos"> 4</span><span class="kt">int</span><span class="w"> </span><span class="nf">main</span><span class="p">(</span><span class="kt">int</span><span class="w"> </span><span class="n">argc</span><span class="p">,</span><span class="w"> </span><span class="kt">char</span><span class="o">*</span><span class="w"> </span><span class="n">argv</span><span class="p">[])</span><span class="w"> </span><span class="p">{</span>
<span class="linenos"> 5</span><span class="w"> </span><span class="kt">float</span><span class="w"> </span><span class="o">*</span><span class="n">input</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="kt">float</span><span class="w"> </span><span class="o">*</span><span class="p">)</span><span class="mh">0x10000000</span><span class="p">;</span><span class="w"> </span><span class="c1">// FP32 输入</span>
<span class="linenos"> 6</span><span class="w"> </span><span class="kt">int8_t</span><span class="w"> </span><span class="o">*</span><span class="n">output</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="kt">int8_t</span><span class="w"> </span><span class="o">*</span><span class="p">)</span><span class="mh">0x10004000</span><span class="p">;</span><span class="w"> </span><span class="c1">// INT8 输出</span>
<span class="linenos"> 7</span><span class="w"> </span><span class="kt">float</span><span class="w"> </span><span class="n">scale</span><span class="p">[</span><span class="mi">4</span><span class="p">]</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">{</span><span class="mf">0.1f</span><span class="p">,</span><span class="w"> </span><span class="mf">0.12f</span><span class="p">,</span><span class="w"> </span><span class="mf">0.11f</span><span class="p">,</span><span class="w"> </span><span class="mf">0.09f</span><span class="p">};</span>
<span class="linenos"> 8</span><span class="w"> </span><span class="kt">int</span><span class="w"> </span><span class="n">zp</span><span class="p">[</span><span class="mi">4</span><span class="p">]</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">{</span><span class="mi">0</span><span class="p">,</span><span class="w"> </span><span class="mi">0</span><span class="p">,</span><span class="w"> </span><span class="mi">0</span><span class="p">,</span><span class="w"> </span><span class="mi">0</span><span class="p">};</span>
<span class="linenos"> 9</span><span class="w"> </span><span class="kt">int</span><span class="w"> </span><span class="n">element_num</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">1024</span><span class="p">;</span>
<span class="linenos">10</span><span class="w"> </span><span class="kt">int</span><span class="w"> </span><span class="n">segment_num</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">4</span><span class="p">;</span>
<span class="hll"><span class="linenos">11</span><span class="w"> </span><span class="kt">int</span><span class="w"> </span><span class="n">axis_num</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">1</span><span class="p">,</span><span class="w"> </span><span class="n">core_mask</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mh">0xff</span><span class="p">;</span>
</span><span class="linenos">12</span>
<span class="linenos">13</span><span class="w"> </span><span class="n">fp_QuantData_s</span><span class="p">(</span><span class="n">input</span><span class="p">,</span><span class="w"> </span><span class="n">output</span><span class="p">,</span><span class="w"> </span><span class="n">element_num</span><span class="p">,</span>
<span class="linenos">14</span><span class="w"> </span><span class="n">scale</span><span class="p">,</span><span class="w"> </span><span class="n">zp</span><span class="p">,</span><span class="w"> </span><span class="n">segment_num</span><span class="p">,</span><span class="w"> </span><span class="n">axis_num</span><span class="p">,</span><span class="w"> </span><span class="n">core_mask</span><span class="p">);</span>
<span class="linenos">15</span>
<span class="linenos">16</span><span class="w"> </span><span class="k">return</span><span class="w"> </span><span class="mi">0</span><span class="p">;</span>
<span class="linenos">17</span><span class="p">}</span>
<div class="highlight-c notranslate"><div class="highlight"><pre><span></span><span class="linenos"> 1</span><span class="cp">#include</span><span class="w"> </span><span class="cpf">&lt;stdio.h&gt;</span>
<span class="linenos"> 2</span>
<span class="linenos"> 3</span><span class="kt">int</span><span class="w"> </span><span class="nf">main</span><span class="p">(</span><span class="kt">int</span><span class="w"> </span><span class="n">argc</span><span class="p">,</span><span class="w"> </span><span class="kt">char</span><span class="o">*</span><span class="w"> </span><span class="n">argv</span><span class="p">[])</span><span class="w"> </span><span class="p">{</span>
<span class="linenos"> 4</span><span class="w"> </span><span class="kt">float</span><span class="w"> </span><span class="o">*</span><span class="n">input</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="kt">float</span><span class="w"> </span><span class="o">*</span><span class="p">)</span><span class="mh">0x81000000</span><span class="p">;</span>
<span class="linenos"> 5</span><span class="w"> </span><span class="kt">int8_t</span><span class="w"> </span><span class="o">*</span><span class="n">output</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="kt">int8_t</span><span class="w"> </span><span class="o">*</span><span class="p">)</span><span class="mh">0x82000000</span><span class="p">;</span>
<span class="linenos"> 6</span><span class="w"> </span><span class="kt">float</span><span class="w"> </span><span class="n">scale</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mf">0.1f</span><span class="p">;</span>
<span class="linenos"> 7</span><span class="w"> </span><span class="kt">int32_t</span><span class="w"> </span><span class="n">zp</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">0</span><span class="p">;</span>
<span class="linenos"> 8</span><span class="w"> </span><span class="kt">int</span><span class="w"> </span><span class="n">size</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">1024</span><span class="p">;</span>
<span class="linenos"> 9</span><span class="w"> </span><span class="kt">int32_t</span><span class="w"> </span><span class="n">min_value</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">-128</span><span class="p">;</span>
<span class="linenos">10</span><span class="w"> </span><span class="kt">int32_t</span><span class="w"> </span><span class="n">max_value</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">127</span><span class="p">;</span>
<span class="linenos">11</span><span class="w"> </span><span class="kt">int</span><span class="w"> </span><span class="n">core_mask</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mh">0xff</span><span class="p">;</span>
<span class="linenos">12</span>
<span class="hll"><span class="linenos">13</span><span class="w"> </span><span class="n">fp_dynamic_quant_s</span><span class="p">(</span><span class="n">input</span><span class="p">,</span><span class="w"> </span><span class="n">output</span><span class="p">,</span><span class="w"> </span><span class="n">scale</span><span class="p">,</span><span class="w"> </span><span class="n">zp</span><span class="p">,</span><span class="w"> </span><span class="n">size</span><span class="p">,</span><span class="w"> </span><span class="n">min_value</span><span class="p">,</span><span class="w"> </span><span class="n">max_value</span><span class="p">,</span><span class="w"> </span><span class="n">core_mask</span><span class="p">);</span>
</span><span class="linenos">14</span><span class="w"> </span><span class="k">return</span><span class="w"> </span><span class="mi">0</span><span class="p">;</span>
<span class="linenos">15</span><span class="p">}</span>
</pre></div>
</div>
<p><strong>私有存储版本:</strong></p>
<dl class="c function">
<dt class="sig sig-object c" id="c.fp_dynamic_quant_p">
<span class="kt"><span class="pre">void</span></span><span class="w"> </span><span class="sig-name descname"><span class="n"><span class="pre">fp_dynamic_quant_p</span></span></span><span class="sig-paren">(</span><span class="kt"><span class="pre">float</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">real_values</span></span>, <span class="n"><span class="pre">int8_t</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">quant_values</span></span>, <span class="kt"><span class="pre">float</span></span><span class="w"> </span><span class="n"><span class="pre">scale</span></span>, <span class="n"><span class="pre">int32_t</span></span><span class="w"> </span><span class="n"><span class="pre">zp</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">size</span></span>, <span class="n"><span class="pre">int32_t</span></span><span class="w"> </span><span class="n"><span class="pre">min_value</span></span>, <span class="n"><span class="pre">int32_t</span></span><span class="w"> </span><span class="n"><span class="pre">max_value</span></span><span class="sig-paren">)</span><a class="headerlink" href="#c.fp_dynamic_quant_p" title="永久链接至目标"></a><br /></dt>
<dd></dd></dl>
<dl class="c function">
<dt class="sig sig-object c" id="c.hp_dynamic_quant_p">
<span class="kt"><span class="pre">void</span></span><span class="w"> </span><span class="sig-name descname"><span class="n"><span class="pre">hp_dynamic_quant_p</span></span></span><span class="sig-paren">(</span><span class="n"><span class="pre">half</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">real_values</span></span>, <span class="n"><span class="pre">int8_t</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">quant_values</span></span>, <span class="kt"><span class="pre">float</span></span><span class="w"> </span><span class="n"><span class="pre">scale</span></span>, <span class="n"><span class="pre">int32_t</span></span><span class="w"> </span><span class="n"><span class="pre">zp</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">size</span></span>, <span class="n"><span class="pre">int32_t</span></span><span class="w"> </span><span class="n"><span class="pre">min_value</span></span>, <span class="n"><span class="pre">int32_t</span></span><span class="w"> </span><span class="n"><span class="pre">max_value</span></span><span class="sig-paren">)</span><a class="headerlink" href="#c.hp_dynamic_quant_p" title="永久链接至目标"></a><br /></dt>
<dd></dd></dl>
<p><strong>C调用示例</strong></p>
<div class="highlight-c notranslate"><div class="highlight"><pre><span></span><span class="linenos"> 1</span><span class="cp">#include</span><span class="w"> </span><span class="cpf">&lt;stdio.h&gt;</span>
<span class="linenos"> 2</span>
<span class="linenos"> 3</span><span class="kt">int</span><span class="w"> </span><span class="nf">main</span><span class="p">(</span><span class="kt">int</span><span class="w"> </span><span class="n">argc</span><span class="p">,</span><span class="w"> </span><span class="kt">char</span><span class="o">*</span><span class="w"> </span><span class="n">argv</span><span class="p">[])</span><span class="w"> </span><span class="p">{</span>
<span class="linenos"> 4</span><span class="w"> </span><span class="kt">float</span><span class="w"> </span><span class="o">*</span><span class="n">input</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="kt">float</span><span class="w"> </span><span class="o">*</span><span class="p">)</span><span class="mh">0x10010000</span><span class="p">;</span>
<span class="linenos"> 5</span><span class="w"> </span><span class="kt">int8_t</span><span class="w"> </span><span class="o">*</span><span class="n">output</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="kt">int8_t</span><span class="w"> </span><span class="o">*</span><span class="p">)</span><span class="mh">0x10020000</span><span class="p">;</span>
<span class="linenos"> 6</span><span class="w"> </span><span class="kt">float</span><span class="w"> </span><span class="n">scale</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mf">0.1f</span><span class="p">;</span>
<span class="linenos"> 7</span><span class="w"> </span><span class="kt">int32_t</span><span class="w"> </span><span class="n">zp</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">0</span><span class="p">;</span>
<span class="linenos"> 8</span><span class="w"> </span><span class="kt">int</span><span class="w"> </span><span class="n">size</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">1024</span><span class="p">;</span>
<span class="linenos"> 9</span><span class="w"> </span><span class="kt">int32_t</span><span class="w"> </span><span class="n">min_value</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">-128</span><span class="p">;</span>
<span class="linenos">10</span><span class="w"> </span><span class="kt">int32_t</span><span class="w"> </span><span class="n">max_value</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">127</span><span class="p">;</span>
<span class="linenos">11</span>
<span class="hll"><span class="linenos">12</span><span class="w"> </span><span class="n">fp_dynamic_quant_p</span><span class="p">(</span><span class="n">input</span><span class="p">,</span><span class="w"> </span><span class="n">output</span><span class="p">,</span><span class="w"> </span><span class="n">scale</span><span class="p">,</span><span class="w"> </span><span class="n">zp</span><span class="p">,</span><span class="w"> </span><span class="n">size</span><span class="p">,</span><span class="w"> </span><span class="n">min_value</span><span class="p">,</span><span class="w"> </span><span class="n">max_value</span><span class="p">);</span>
</span><span class="linenos">13</span><span class="w"> </span><span class="k">return</span><span class="w"> </span><span class="mi">0</span><span class="p">;</span>
<span class="linenos">14</span><span class="p">}</span>
</pre></div>
</div>
</div></blockquote>
<p></p>
<p><strong>实现说明:</strong></p>
<ul class="simple">
<li><p><code class="docutils literal notranslate"><span class="pre">axis_num</span> <span class="pre">==</span> <span class="pre">0</span></code> 时:</p>
<ul>
<li><p>对整个输入数组执行一次统一量化</p></li>
<li><p>等价于 per-tensor quantization</p></li>
</ul>
</li>
<li><p><code class="docutils literal notranslate"><span class="pre">axis_num</span> <span class="pre">!=</span> <span class="pre">0</span></code> 时:</p>
<ul>
<li><p>输入数据按 <code class="docutils literal notranslate"><span class="pre">segment_num</span></code> 均分为多个分段</p></li>
<li><p>每个分段使用独立的 <code class="docutils literal notranslate"><span class="pre">scale[i]</span></code><code class="docutils literal notranslate"><span class="pre">zp[i]</span></code></p></li>
<li><p>等价于 per-axis dynamic quantization</p></li>
</ul>
</li>
<li><p>核心量化过程由 <code class="docutils literal notranslate"><span class="pre">DoQuantizeFp32ToInt8</span></code> 完成,包括:</p>
<ul>
<li><p>反 scale 计算</p></li>
<li><p>四舍五入</p></li>
<li><p>饱和裁剪</p></li>
<li><p>INF 特殊值处理</p></li>
</ul>
</li>
</ul>
</section>

View File

@ -25,7 +25,7 @@
<link rel="index" title="索引" href="../../genindex.html" />
<link rel="search" title="搜索" href="../../search.html" />
<link rel="next" title="Elu" href="elu.html" />
<link rel="prev" title="DynamicQuant" href="dynamicquant.html" />
<link rel="prev" title="DynamicQuant" href="dynamic_quant.html" />
</head>
<body class="wy-body-for-nav">
@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3 current"><a class="current reference internal" href="#">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>
@ -512,7 +512,7 @@
访问量:<span id="busuanzi_page_uv"></span>
</div>
<footer><div class="rst-footer-buttons" role="navigation" aria-label="页脚">
<a href="dynamicquant.html" class="btn btn-neutral float-left" title="DynamicQuant" accesskey="p" rel="prev"><span class="fa fa-arrow-circle-left" aria-hidden="true"></span> 上一页</a>
<a href="dynamic_quant.html" class="btn btn-neutral float-left" title="DynamicQuant" accesskey="p" rel="prev"><span class="fa fa-arrow-circle-left" aria-hidden="true"></span> 上一页</a>
<a href="elu.html" class="btn btn-neutral float-right" title="Elu" accesskey="n" rel="next">下一页 <span class="fa fa-arrow-circle-right" aria-hidden="true"></span></a>
</div>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3 current"><a class="current reference internal" href="#">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3 current"><a class="current reference internal" href="#">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -59,7 +59,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -108,7 +108,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -59,7 +59,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -108,7 +108,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -59,7 +59,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -108,7 +108,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -59,7 +59,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -108,7 +108,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -59,7 +59,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -108,7 +108,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

View File

@ -60,7 +60,7 @@
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">AdderFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="add.html">AddFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
@ -109,7 +109,7 @@
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamicquant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="dynamic_quant.html">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>

Some files were not shown because too many files have changed in this diff Show More