FT_DSP.gitlink.net/master/html/functionlib/dsplib/dynamicquant.html

502 lines
48 KiB
HTML
Raw Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

<!DOCTYPE html>
<html class="writer-html5" lang="zh-CN">
<head>
<meta charset="utf-8" /><meta name="viewport" content="width=device-width, initial-scale=1" />
<meta name="viewport" content="width=device-width, initial-scale=1.0" />
<title>DynamicQuant &mdash; MindSpore Signal+ 使用手册 alpha 文档</title>
<link rel="stylesheet" type="text/css" href="../../_static/pygments.css?v=03e43079" />
<link rel="stylesheet" type="text/css" href="../../_static/css/theme.css?v=e59714d7" />
<link rel="stylesheet" type="text/css" href="../../_static/table.css?v=72b86d3e" />
<link rel="stylesheet" type="text/css" href="../../_static/pageviews.css?v=ff0ce7dc" />
<script src="../../_static/jquery.js?v=5d32c60e"></script>
<script src="../../_static/_sphinx_javascript_frameworks_compat.js?v=2cd50e6c"></script>
<script data-url_root="../../" id="documentation_options" src="../../_static/documentation_options.js?v=595569a8"></script>
<script src="../../_static/doctools.js?v=888ff710"></script>
<script src="../../_static/sphinx_highlight.js?v=4825356b"></script>
<script src="../../_static/translations.js?v=beaddf03"></script>
<script async="async" src="https://cdn.jsdelivr.net/npm/mathjax@3/es5/tex-mml-chtml.js"></script>
<script src="../../_static/table.js?v=99ed15ba"></script>
<script src="../../_static/js/theme.js"></script>
<link rel="index" title="索引" href="../../genindex.html" />
<link rel="search" title="搜索" href="../../search.html" />
<link rel="next" title="Eltwise" href="eltwise.html" />
<link rel="prev" title="Dropoutgrad" href="dropoutgrad.html" />
</head>
<body class="wy-body-for-nav">
<div class="wy-grid-for-nav">
<nav data-toggle="wy-nav-shift" class="wy-nav-side">
<div class="wy-side-scroll">
<div class="wy-side-nav-search" >
<a href="../../index.html" class="icon icon-home">
MindSpore Signal+ 使用手册
</a>
<div role="search">
<form id="rtd-search-form" class="wy-form" action="../../search.html" method="get">
<input type="text" name="q" placeholder="搜索文档" aria-label="搜索文档" />
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
</form>
</div>
</div><div class="wy-menu wy-menu-vertical" data-spy="affix" role="navigation" aria-label="导航菜单">
<ul class="current">
<li class="toctree-l1"><a class="reference internal" href="../../quickstart/index.html">快速入门</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../appdevelop/index.html">应用开发示例</a></li>
<li class="toctree-l1 current"><a class="reference internal" href="../index.html">算子库支持</a><ul class="current">
<li class="toctree-l2"><a class="reference internal" href="../supported_op.html">算子库支持情况</a></li>
<li class="toctree-l2"><a class="reference internal" href="../custom_op/index.html">自定义算子列表</a></li>
<li class="toctree-l2 current"><a class="reference internal" href="dsplib_index.html">DSP Library C API Reference</a><ul class="current">
<li class="toctree-l3"><a class="reference internal" href="abs.html">Abs</a></li>
<li class="toctree-l3"><a class="reference internal" href="abs_grad.html">AbsGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="activation.html">Activation</a></li>
<li class="toctree-l3"><a class="reference internal" href="activation_grad.html">ActivationGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="adam.html">Adam</a></li>
<li class="toctree-l3"><a class="reference internal" href="adamweightdecay.html">AdamWeightDecay</a></li>
<li class="toctree-l3"><a class="reference internal" href="adder.html">Adder</a></li>
<li class="toctree-l3"><a class="reference internal" href="addfusion.html">Addfusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="addgrad.html">Addgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="addn.html">AddN</a></li>
<li class="toctree-l3"><a class="reference internal" href="affine.html">Affine</a></li>
<li class="toctree-l3"><a class="reference internal" href="all.html">All</a></li>
<li class="toctree-l3"><a class="reference internal" href="allgather.html">AllGather</a></li>
<li class="toctree-l3"><a class="reference internal" href="apply_momentum.html">ApplyMomentum</a></li>
<li class="toctree-l3"><a class="reference internal" href="argmax.html">Argmax</a></li>
<li class="toctree-l3"><a class="reference internal" href="argmin.html">Argmin</a></li>
<li class="toctree-l3"><a class="reference internal" href="assert.html">Assert</a></li>
<li class="toctree-l3"><a class="reference internal" href="assign.html">Assign</a></li>
<li class="toctree-l3"><a class="reference internal" href="assignadd.html">AssignAdd</a></li>
<li class="toctree-l3"><a class="reference internal" href="attention.html">Attention</a></li>
<li class="toctree-l3"><a class="reference internal" href="audio_spectrogram.html">AudioSpectrogram</a></li>
<li class="toctree-l3"><a class="reference internal" href="avgpooling.html">Avgpooling</a></li>
<li class="toctree-l3"><a class="reference internal" href="avg_pool_grad.html">AvgPoolGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="batchnorm.html">BatchNorm</a></li>
<li class="toctree-l3"><a class="reference internal" href="batchnormgrad.html">Batchnormgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="batch_to_space.html">BatchToSpace</a></li>
<li class="toctree-l3"><a class="reference internal" href="batchtospacend.html">BatchToSpaceND</a></li>
<li class="toctree-l3"><a class="reference internal" href="biasadd.html">Biasadd</a></li>
<li class="toctree-l3"><a class="reference internal" href="biasaddgrad.html">Biasaddgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="binarycrossentropy.html">Binarycrossentropy</a></li>
<li class="toctree-l3"><a class="reference internal" href="binary_cross_entropy_grad.html">BinaryCrossEntropyGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="broadcastto.html">BroadcastTo</a></li>
<li class="toctree-l3"><a class="reference internal" href="cast.html">Cast</a></li>
<li class="toctree-l3"><a class="reference internal" href="ceil.html">Ceil</a></li>
<li class="toctree-l3"><a class="reference internal" href="clip.html">Clip</a></li>
<li class="toctree-l3"><a class="reference internal" href="concat.html">Concat</a></li>
<li class="toctree-l3"><a class="reference internal" href="constant_of_shape.html">ConstantOfShape</a></li>
<li class="toctree-l3"><a class="reference internal" href="conv2d.html">Conv2d</a></li>
<li class="toctree-l3"><a class="reference internal" href="conv2d_transpose.html">Conv2dTranspose</a></li>
<li class="toctree-l3"><a class="reference internal" href="conv2dbackpropfilterfusion.html">Conv2DBackpropFilterFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="conv2dbackpropinputfusion.html">Conv2DBackpropInputFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="cos.html">Cos</a></li>
<li class="toctree-l3"><a class="reference internal" href="crop.html">Crop</a></li>
<li class="toctree-l3"><a class="reference internal" href="crop_and_resize.html">CropAndResize</a></li>
<li class="toctree-l3"><a class="reference internal" href="cumsum.html">Cumsum</a></li>
<li class="toctree-l3"><a class="reference internal" href="customextractfeatures.html">CustomExtractFeatures</a></li>
<li class="toctree-l3"><a class="reference internal" href="customnormalize.html">Customnormalize</a></li>
<li class="toctree-l3"><a class="reference internal" href="custompredict.html">CustomPredict</a></li>
<li class="toctree-l3"><a class="reference internal" href="deconvgradfilter.html">DeconvGradFilter</a></li>
<li class="toctree-l3"><a class="reference internal" href="depthtospace.html">DepthToSpace</a></li>
<li class="toctree-l3"><a class="reference internal" href="detection_post_process.html">DetectionPostProcess</a></li>
<li class="toctree-l3"><a class="reference internal" href="div_fusion.html">DivFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="divgrad.html">Divgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropout.html">Dropout</a></li>
<li class="toctree-l3"><a class="reference internal" href="dropoutgrad.html">Dropoutgrad</a></li>
<li class="toctree-l3 current"><a class="current reference internal" href="#">DynamicQuant</a></li>
<li class="toctree-l3"><a class="reference internal" href="eltwise.html">Eltwise</a></li>
<li class="toctree-l3"><a class="reference internal" href="elu.html">Elu</a></li>
<li class="toctree-l3"><a class="reference internal" href="embeddinglookup.html">EmbeddingLookup</a></li>
<li class="toctree-l3"><a class="reference internal" href="equal.html">Equal</a></li>
<li class="toctree-l3"><a class="reference internal" href="erf.html">Erf</a></li>
<li class="toctree-l3"><a class="reference internal" href="expand_dims.html">ExpandDims</a></li>
<li class="toctree-l3"><a class="reference internal" href="expfusion.html">ExpFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="fake_quant_with_min_max_vars.html">FakeQuantWithMinMaxVars</a></li>
<li class="toctree-l3"><a class="reference internal" href="fake_quant_with_min_max_vars_per_channel.html">FakeQuantWithMinMaxVarsPerChannel</a></li>
<li class="toctree-l3"><a class="reference internal" href="fftimag.html">FFTImag</a></li>
<li class="toctree-l3"><a class="reference internal" href="fftreal.html">FFTReal</a></li>
<li class="toctree-l3"><a class="reference internal" href="fill.html">Fill</a></li>
<li class="toctree-l3"><a class="reference internal" href="fillv2.html">FillV2</a></li>
<li class="toctree-l3"><a class="reference internal" href="flatten.html">Flatten</a></li>
<li class="toctree-l3"><a class="reference internal" href="flattengrad.html">FlattenGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="floor.html">Floor</a></li>
<li class="toctree-l3"><a class="reference internal" href="floordiv.html">FloorDiv</a></li>
<li class="toctree-l3"><a class="reference internal" href="floormod.html">Floormod</a></li>
<li class="toctree-l3"><a class="reference internal" href="formattranspose.html">FormatTranspose</a></li>
<li class="toctree-l3"><a class="reference internal" href="fullconnection.html">FullConnection</a></li>
<li class="toctree-l3"><a class="reference internal" href="fusedbatchnorm.html">FusedBatchNorm</a></li>
<li class="toctree-l3"><a class="reference internal" href="gather.html">Gather</a></li>
<li class="toctree-l3"><a class="reference internal" href="gatherd.html">GatherD</a></li>
<li class="toctree-l3"><a class="reference internal" href="gather_nd.html">GatherNd</a></li>
<li class="toctree-l3"><a class="reference internal" href="glu.html">GLU</a></li>
<li class="toctree-l3"><a class="reference internal" href="greater.html">Greater</a></li>
<li class="toctree-l3"><a class="reference internal" href="greaterequal.html">GreaterEqual</a></li>
<li class="toctree-l3"><a class="reference internal" href="groupnormfusion.html">GroupNormFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="gru.html">GRU</a></li>
<li class="toctree-l3"><a class="reference internal" href="hashtablelookup.html">HashtableLookup</a></li>
<li class="toctree-l3"><a class="reference internal" href="instancenorm.html">InstanceNorm</a></li>
<li class="toctree-l3"><a class="reference internal" href="invertpermutation.html">InvertPermutation</a></li>
<li class="toctree-l3"><a class="reference internal" href="isfinite.html">Isfinite</a></li>
<li class="toctree-l3"><a class="reference internal" href="l2norm.html">L2norm</a></li>
<li class="toctree-l3"><a class="reference internal" href="layernormfusion.html">LayerNormFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="layernormgrad.html">Layernormgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="leaky_relu.html">LeakyReLu</a></li>
<li class="toctree-l3"><a class="reference internal" href="less.html">Less</a></li>
<li class="toctree-l3"><a class="reference internal" href="lessequal.html">LessEqual</a></li>
<li class="toctree-l3"><a class="reference internal" href="linspace.html">LinSpace</a></li>
<li class="toctree-l3"><a class="reference internal" href="log.html">Log</a></li>
<li class="toctree-l3"><a class="reference internal" href="log1p.html">Log1p</a></li>
<li class="toctree-l3"><a class="reference internal" href="loggrad.html">LogGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="logicaland.html">LogicalAnd</a></li>
<li class="toctree-l3"><a class="reference internal" href="logical_not.html">LogicalNot</a></li>
<li class="toctree-l3"><a class="reference internal" href="logical_or.html">LogicalOr</a></li>
<li class="toctree-l3"><a class="reference internal" href="logsoftmax.html">LogSoftmax</a></li>
<li class="toctree-l3"><a class="reference internal" href="lpnormalization.html">LpNormalization</a></li>
<li class="toctree-l3"><a class="reference internal" href="lrn.html">Lrn</a></li>
<li class="toctree-l3"><a class="reference internal" href="lsh_projection.html">LshProjection</a></li>
<li class="toctree-l3"><a class="reference internal" href="lstm.html">LSTM</a></li>
<li class="toctree-l3"><a class="reference internal" href="lstmgrad.html">LstmGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="lstmgraddata.html">LstmGradData</a></li>
<li class="toctree-l3"><a class="reference internal" href="lstmgradweight.html">LstmGradWeight</a></li>
<li class="toctree-l3"><a class="reference internal" href="matmulfusion.html">MatMulFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="maximum.html">Maximum</a></li>
<li class="toctree-l3"><a class="reference internal" href="maximumgrad.html">Maximumgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="maxpoolfusion.html">MaxPoolFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="maxpoolgrad.html">MaxPoolGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="mfcc.html">MFCC</a></li>
<li class="toctree-l3"><a class="reference internal" href="minimum.html">Minimum</a></li>
<li class="toctree-l3"><a class="reference internal" href="minimumgrad.html">Minimumgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="mod.html">Mod</a></li>
<li class="toctree-l3"><a class="reference internal" href="mul.html">Mul</a></li>
<li class="toctree-l3"><a class="reference internal" href="mulgrad.html">Mulgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="neg.html">Neg</a></li>
<li class="toctree-l3"><a class="reference internal" href="neg_grad.html">NegGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="nllloss.html">NLLLoss</a></li>
<li class="toctree-l3"><a class="reference internal" href="nlllossgrad.html">NLLLossGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="non_max_suppression.html">NonMaxSuppression</a></li>
<li class="toctree-l3"><a class="reference internal" href="nonzero.html">NonZero</a></li>
<li class="toctree-l3"><a class="reference internal" href="not_equal.html">NotEqual</a></li>
<li class="toctree-l3"><a class="reference internal" href="onehot.html">OneHot</a></li>
<li class="toctree-l3"><a class="reference internal" href="ones_like.html">OnesLike</a></li>
<li class="toctree-l3"><a class="reference internal" href="padfusion.html">PadFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="power_grad.html">PowerGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="pow_fusion.html">PowFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="prelufusion.html">PReLUFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="priorbox.html">Priorbox</a></li>
<li class="toctree-l3"><a class="reference internal" href="quantdtypecast.html">QuantDTypeCast</a></li>
<li class="toctree-l3"><a class="reference internal" href="raggedrange.html">RaggedRange</a></li>
<li class="toctree-l3"><a class="reference internal" href="random_normal.html">RandomNormal</a></li>
<li class="toctree-l3"><a class="reference internal" href="random_standard_normal.html">RandomStandardNormal</a></li>
<li class="toctree-l3"><a class="reference internal" href="range.html">Range</a></li>
<li class="toctree-l3"><a class="reference internal" href="rank.html">Rank</a></li>
<li class="toctree-l3"><a class="reference internal" href="real_div.html">RealDiv</a></li>
<li class="toctree-l3"><a class="reference internal" href="reciprocal.html">Reciprocal</a></li>
<li class="toctree-l3"><a class="reference internal" href="reduce.html">Reduce</a></li>
<li class="toctree-l3"><a class="reference internal" href="reducescatter.html">ReduceScatter</a></li>
<li class="toctree-l3"><a class="reference internal" href="reshape.html">Reshape</a></li>
<li class="toctree-l3"><a class="reference internal" href="resize.html">Resize</a></li>
<li class="toctree-l3"><a class="reference internal" href="resizegrad.html">Resizegrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="reverse_sequence.html">ReverseSequence</a></li>
<li class="toctree-l3"><a class="reference internal" href="reversev2.html">ReverseV2</a></li>
<li class="toctree-l3"><a class="reference internal" href="rfft.html">RFFT</a></li>
<li class="toctree-l3"><a class="reference internal" href="roipooling.html">ROIPooling</a></li>
<li class="toctree-l3"><a class="reference internal" href="round.html">Round</a></li>
<li class="toctree-l3"><a class="reference internal" href="rsqrt.html">Rsqrt</a></li>
<li class="toctree-l3"><a class="reference internal" href="rsqrtgrad.html">Rsqrtgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="scale_fusion.html">ScaleFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="scatter_elements.html">ScatterElements</a></li>
<li class="toctree-l3"><a class="reference internal" href="scatter_nd.html">ScatterNd</a></li>
<li class="toctree-l3"><a class="reference internal" href="scatter_nd_update.html">ScatterNdUpdate</a></li>
<li class="toctree-l3"><a class="reference internal" href="select.html">Select</a></li>
<li class="toctree-l3"><a class="reference internal" href="sgd.html">SGD</a></li>
<li class="toctree-l3"><a class="reference internal" href="shape.html">Shape</a></li>
<li class="toctree-l3"><a class="reference internal" href="sigmoidcrossentropywithlogits.html">SigmoidCrossEntropyWithLogits</a></li>
<li class="toctree-l3"><a class="reference internal" href="sigmoidcrossentropywithlogitsgrad.html">SigmoidCrossEntropyWithLogitsGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="sin.html">Sin</a></li>
<li class="toctree-l3"><a class="reference internal" href="size.html">Size</a></li>
<li class="toctree-l3"><a class="reference internal" href="skipgram.html">Skipgram</a></li>
<li class="toctree-l3"><a class="reference internal" href="slice.html">Slice</a></li>
<li class="toctree-l3"><a class="reference internal" href="smooth1loss.html">SmoothL1Loss</a></li>
<li class="toctree-l3"><a class="reference internal" href="smoothl1lossgrad.html">Smoothl1lossgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="softmax.html">Softmax</a></li>
<li class="toctree-l3"><a class="reference internal" href="softmax_cross_entropy_with_logits.html">SoftmaxCrossEntropyWithLogits</a></li>
<li class="toctree-l3"><a class="reference internal" href="spacetobatch.html">SpaceToBatch</a></li>
<li class="toctree-l3"><a class="reference internal" href="spacetobatchnd.html">SpaceToBatchND</a></li>
<li class="toctree-l3"><a class="reference internal" href="spacetodepth.html">SpaceToDepth</a></li>
<li class="toctree-l3"><a class="reference internal" href="sparsefillemptyrows.html">SparseFillEmptyRows</a></li>
<li class="toctree-l3"><a class="reference internal" href="sparsereshape.html">Sparsereshape</a></li>
<li class="toctree-l3"><a class="reference internal" href="sparsesegmentsum.html">Sparsesegmentsum</a></li>
<li class="toctree-l3"><a class="reference internal" href="sparse_softmax_cross_entropy_with_logits.html">SparseSoftmaxCrossEntropyWithLogits</a></li>
<li class="toctree-l3"><a class="reference internal" href="sparsetodense.html">Sparsetodense</a></li>
<li class="toctree-l3"><a class="reference internal" href="splice.html">Splice</a></li>
<li class="toctree-l3"><a class="reference internal" href="split.html">Split</a></li>
<li class="toctree-l3"><a class="reference internal" href="split_with_overlap.html">SplitWithOverlap</a></li>
<li class="toctree-l3"><a class="reference internal" href="sqrt.html">Sqrt</a></li>
<li class="toctree-l3"><a class="reference internal" href="sqrt_grad.html">SqrtGrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="square.html">Square</a></li>
<li class="toctree-l3"><a class="reference internal" href="squaredifference.html">Squaredifference</a></li>
<li class="toctree-l3"><a class="reference internal" href="squeeze.html">Squeeze</a></li>
<li class="toctree-l3"><a class="reference internal" href="stack.html">Stack</a></li>
<li class="toctree-l3"><a class="reference internal" href="stridedslice.html">Stridedslice</a></li>
<li class="toctree-l3"><a class="reference internal" href="stridedslicegrad.html">Stridedslicegrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="subfusion.html">Subfusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="subgrad.html">Subgrad</a></li>
<li class="toctree-l3"><a class="reference internal" href="switch.html">Switch</a></li>
<li class="toctree-l3"><a class="reference internal" href="switchlayer.html">Switchlayer</a></li>
<li class="toctree-l3"><a class="reference internal" href="tensorarray.html">Tensorarray</a></li>
<li class="toctree-l3"><a class="reference internal" href="tensorarrayread.html">Tensorarrayread</a></li>
<li class="toctree-l3"><a class="reference internal" href="tensorarraywrite.html">TensorarrayWrite</a></li>
<li class="toctree-l3"><a class="reference internal" href="tensorlistfromtensor.html">Tensorlistfromtensor</a></li>
<li class="toctree-l3"><a class="reference internal" href="tensorlistgetitem.html">Tensorlistgetitem</a></li>
<li class="toctree-l3"><a class="reference internal" href="tensorlistreserve.html">Tensorlistreserve</a></li>
<li class="toctree-l3"><a class="reference internal" href="tensorlistsetitem.html">Tensorlistsetitem</a></li>
<li class="toctree-l3"><a class="reference internal" href="tensorliststack.html">Tensorliststack</a></li>
<li class="toctree-l3"><a class="reference internal" href="tensor_scatter_add.html">TensorScatterAdd</a></li>
<li class="toctree-l3"><a class="reference internal" href="tile.html">Tile</a></li>
<li class="toctree-l3"><a class="reference internal" href="topkfusion.html">TopkFusion</a></li>
<li class="toctree-l3"><a class="reference internal" href="transpose.html">Transpose</a></li>
<li class="toctree-l3"><a class="reference internal" href="tril.html">Tril</a></li>
<li class="toctree-l3"><a class="reference internal" href="triu.html">Triu</a></li>
<li class="toctree-l3"><a class="reference internal" href="uniform_real.html">UniformReal</a></li>
<li class="toctree-l3"><a class="reference internal" href="unique.html">Unique</a></li>
<li class="toctree-l3"><a class="reference internal" href="unsortedsegmentsum.html">UnsortedSegmentSum</a></li>
<li class="toctree-l3"><a class="reference internal" href="unstack.html">Unstack</a></li>
<li class="toctree-l3"><a class="reference internal" href="unsqueeze.html">UnSqueeze</a></li>
<li class="toctree-l3"><a class="reference internal" href="where.html">Where</a></li>
<li class="toctree-l3"><a class="reference internal" href="zeroslike.html">ZerosLike</a></li>
<li class="toctree-l3"><a class="reference internal" href="call.html">Call</a></li>
<li class="toctree-l3"><a class="reference internal" href="custom.html">Custom</a></li>
<li class="toctree-l3"><a class="reference internal" href="depend.html">Depend</a></li>
<li class="toctree-l3"><a class="reference internal" href="genop.html">GenOp</a></li>
<li class="toctree-l3"><a class="reference internal" href="partialfusion.html">PartialFusion</a></li>
</ul>
</li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../../refdoc/index.html">参考资料</a></li>
</ul>
</div>
</div>
</nav>
<section data-toggle="wy-nav-shift" class="wy-nav-content-wrap"><nav class="wy-nav-top" aria-label="移动版导航菜单" >
<i data-toggle="wy-nav-top" class="fa fa-bars"></i>
<a href="../../index.html">MindSpore Signal+ 使用手册</a>
</nav>
<div class="wy-nav-content">
<div class="rst-content">
<div role="navigation" aria-label="页面导航">
<ul class="wy-breadcrumbs">
<li><a href="../../index.html" class="icon icon-home" aria-label="Home"></a></li>
<li class="breadcrumb-item"><a href="../index.html">算子库支持</a></li>
<li class="breadcrumb-item"><a href="dsplib_index.html">DSP Library C API Reference</a></li>
<li class="breadcrumb-item active">DynamicQuant</li>
<li class="wy-breadcrumbs-aside">
<a href="../../_sources/functionlib/dsplib/dynamicquant.rst.txt" rel="nofollow"> 查看页面源码</a>
</li>
</ul>
<hr/>
</div>
<div role="main" class="document" itemscope="itemscope" itemtype="http://schema.org/Article">
<div itemprop="articleBody">
<section id="dynamicquant">
<h1>DynamicQuant<a class="headerlink" href="#dynamicquant" title="此标题的永久链接"></a></h1>
<p>将 FP32 输入张量按给定的 scale 和 zero pointzp动态量化为 INT8 输出张量。
支持按整张量量化或按指定轴分段量化per-axis dynamic quantization</p>
<div class="math notranslate nohighlight">
\[q_i = \mathrm{clip}\left( \mathrm{round}\left( \frac{x_i}{scale} + zp \right), q_{min}, q_{max} \right)\]</div>
<p>其中:</p>
<ul class="simple">
<li><p><span class="math notranslate nohighlight">\(x_i\)</span> 为输入浮点值</p></li>
<li><p><span class="math notranslate nohighlight">\(scale\)</span> 为量化比例因子</p></li>
<li><p><span class="math notranslate nohighlight">\(zp\)</span> 为零点zero point</p></li>
<li><p><span class="math notranslate nohighlight">\(q_{min} = -128\)</span></p></li>
<li><p><span class="math notranslate nohighlight">\(q_{max} = 127\)</span></p></li>
</ul>
<p>当输入为 <span class="math notranslate nohighlight">\(+\infty\)</span><span class="math notranslate nohighlight">\(-\infty\)</span> 时,输出分别饱和到最大或最小量化值。</p>
<p></p>
<dl class="simple">
<dt>输入:</dt><dd><ul class="simple">
<li><p><strong>real_values</strong> - 输入 FP32 数据地址</p></li>
<li><p><strong>element_num</strong> - 输入元素总数</p></li>
<li><p><strong>scale</strong> - 量化 scale 数组地址</p></li>
<li><p><strong>zp</strong> - 量化 zero point 数组地址</p></li>
<li><p><strong>segment_num</strong> - 分段数量(用于按轴量化)</p></li>
<li><dl class="simple">
<dt><strong>axis_num</strong> - 量化轴标识</dt><dd><ul>
<li><p><code class="docutils literal notranslate"><span class="pre">0</span></code>整张量量化per-tensor</p></li>
<li><p><code class="docutils literal notranslate"><span class="pre">!=0</span></code>按轴分段量化per-axis</p></li>
</ul>
</dd>
</dl>
</li>
</ul>
</dd>
<dt>输出:</dt><dd><ul class="simple">
<li><p><strong>quant_values</strong> - 输出 INT8 量化结果地址</p></li>
</ul>
</dd>
</dl>
<p></p>
<dl class="simple">
<dt>支持平台:</dt><dd><p><code class="docutils literal notranslate"><span class="pre">FT78NE</span></code>
<code class="docutils literal notranslate"><span class="pre">MT7004</span></code></p>
</dd>
</dl>
<p></p>
<div class="admonition note">
<p class="admonition-title">备注</p>
<ul class="simple">
<li><p>当前算子仅支持 <strong>FP32Fp16 → INT8</strong> 的动态量化</p></li>
<li><p><code class="docutils literal notranslate"><span class="pre">axis_num</span> <span class="pre">=</span> <span class="pre">0</span></code> 时,仅使用 <code class="docutils literal notranslate"><span class="pre">scale[0]</span></code><code class="docutils literal notranslate"><span class="pre">zp[0]</span></code> 进行整张量量化</p></li>
<li><p><code class="docutils literal notranslate"><span class="pre">axis_num</span> <span class="pre">!=</span> <span class="pre">0</span></code> 时,输入按 <code class="docutils literal notranslate"><span class="pre">segment_num</span></code> 进行分段,每段使用对应的 <code class="docutils literal notranslate"><span class="pre">scale[i]</span></code><code class="docutils literal notranslate"><span class="pre">zp[i]</span></code></p></li>
<li><p>分段大小通过 <code class="docutils literal notranslate"><span class="pre">UP_DIV(element_num,</span> <span class="pre">segment_num)</span></code> 计算,最后一段自动处理剩余元素</p></li>
<li><p>量化结果会被限制在 <code class="docutils literal notranslate"><span class="pre">[-128,</span> <span class="pre">127]</span></code> 范围内</p></li>
</ul>
</div>
<p></p>
<p><strong>私有存储版本:</strong></p>
<dl class="c function">
<dt class="sig sig-object c" id="c.fp_QuantData_p">
<span class="kt"><span class="pre">void</span></span><span class="w"> </span><span class="sig-name descname"><span class="n"><span class="pre">fp_QuantData_p</span></span></span><span class="sig-paren">(</span><span class="kt"><span class="pre">float</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">real_values</span></span>, <span class="n"><span class="pre">int8_t</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">quant_values</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">element_num</span></span>, <span class="kt"><span class="pre">float</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">scale</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">zp</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">segment_num</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">axis_num</span></span><span class="sig-paren">)</span><a class="headerlink" href="#c.fp_QuantData_p" title="永久链接至目标"></a><br /></dt>
<dd></dd></dl>
<dl class="c function">
<dt class="sig sig-object c" id="c.hp_QuantData_p">
<span class="kt"><span class="pre">void</span></span><span class="w"> </span><span class="sig-name descname"><span class="n"><span class="pre">hp_QuantData_p</span></span></span><span class="sig-paren">(</span><span class="n"><span class="pre">half</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">real_values</span></span>, <span class="n"><span class="pre">half</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">quant_values</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">element_num</span></span>, <span class="n"><span class="pre">half</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">scale</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">zp</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">segment_num</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">axis_num</span></span><span class="sig-paren">)</span><a class="headerlink" href="#c.hp_QuantData_p" title="永久链接至目标"></a><br /></dt>
<dd></dd></dl>
<p></p>
<p><strong>C调用示例</strong></p>
<blockquote>
<div><div class="highlight-c notranslate"><div class="highlight"><pre><span></span><span class="linenos"> 1</span><span class="cp">#include</span><span class="w"> </span><span class="cpf">&lt;stdio.h&gt;</span>
<span class="linenos"> 2</span><span class="cp">#include</span><span class="w"> </span><span class="cpf">&lt;quant.h&gt;</span>
<span class="linenos"> 3</span>
<span class="linenos"> 4</span><span class="kt">int</span><span class="w"> </span><span class="nf">main</span><span class="p">(</span><span class="kt">int</span><span class="w"> </span><span class="n">argc</span><span class="p">,</span><span class="w"> </span><span class="kt">char</span><span class="o">*</span><span class="w"> </span><span class="n">argv</span><span class="p">[])</span><span class="w"> </span><span class="p">{</span>
<span class="linenos"> 5</span><span class="w"> </span><span class="kt">float</span><span class="w"> </span><span class="o">*</span><span class="n">input</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="kt">float</span><span class="w"> </span><span class="o">*</span><span class="p">)</span><span class="mh">0x10000000</span><span class="p">;</span><span class="w"> </span><span class="c1">// FP32 输入</span>
<span class="linenos"> 6</span><span class="w"> </span><span class="kt">int8_t</span><span class="w"> </span><span class="o">*</span><span class="n">output</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="kt">int8_t</span><span class="w"> </span><span class="o">*</span><span class="p">)</span><span class="mh">0x10004000</span><span class="p">;</span><span class="w"> </span><span class="c1">// INT8 输出</span>
<span class="linenos"> 7</span><span class="w"> </span><span class="kt">float</span><span class="w"> </span><span class="n">scale</span><span class="p">[</span><span class="mi">4</span><span class="p">]</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">{</span><span class="mf">0.1f</span><span class="p">,</span><span class="w"> </span><span class="mf">0.12f</span><span class="p">,</span><span class="w"> </span><span class="mf">0.11f</span><span class="p">,</span><span class="w"> </span><span class="mf">0.09f</span><span class="p">};</span>
<span class="linenos"> 8</span><span class="w"> </span><span class="kt">int</span><span class="w"> </span><span class="n">zp</span><span class="p">[</span><span class="mi">4</span><span class="p">]</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">{</span><span class="mi">0</span><span class="p">,</span><span class="w"> </span><span class="mi">0</span><span class="p">,</span><span class="w"> </span><span class="mi">0</span><span class="p">,</span><span class="w"> </span><span class="mi">0</span><span class="p">};</span>
<span class="linenos"> 9</span><span class="w"> </span><span class="kt">int</span><span class="w"> </span><span class="n">element_num</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">1024</span><span class="p">;</span>
<span class="linenos">10</span><span class="w"> </span><span class="kt">int</span><span class="w"> </span><span class="n">segment_num</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">4</span><span class="p">;</span>
<span class="hll"><span class="linenos">11</span><span class="w"> </span><span class="kt">int</span><span class="w"> </span><span class="n">axis_num</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">1</span><span class="p">;</span>
</span><span class="linenos">12</span>
<span class="linenos">13</span><span class="w"> </span><span class="n">fp_QuantData_p</span><span class="p">(</span><span class="n">input</span><span class="p">,</span><span class="w"> </span><span class="n">output</span><span class="p">,</span><span class="w"> </span><span class="n">element_num</span><span class="p">,</span>
<span class="linenos">14</span><span class="w"> </span><span class="n">scale</span><span class="p">,</span><span class="w"> </span><span class="n">zp</span><span class="p">,</span><span class="w"> </span><span class="n">segment_num</span><span class="p">,</span><span class="w"> </span><span class="n">axis_num</span><span class="p">);</span>
<span class="linenos">15</span>
<span class="linenos">16</span><span class="w"> </span><span class="k">return</span><span class="w"> </span><span class="mi">0</span><span class="p">;</span>
<span class="linenos">17</span><span class="p">}</span>
</pre></div>
</div>
</div></blockquote>
<p></p>
<p><strong>共享存储版本:</strong></p>
<dl class="c function">
<dt class="sig sig-object c" id="c.fp_QuantData_s">
<span class="kt"><span class="pre">void</span></span><span class="w"> </span><span class="sig-name descname"><span class="n"><span class="pre">fp_QuantData_s</span></span></span><span class="sig-paren">(</span><span class="kt"><span class="pre">float</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">real_values</span></span>, <span class="n"><span class="pre">int8_t</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">quant_values</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">element_num</span></span>, <span class="kt"><span class="pre">float</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">scale</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">zp</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">segment_num</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">axis_num</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">core_mask</span></span><span class="sig-paren">)</span><a class="headerlink" href="#c.fp_QuantData_s" title="永久链接至目标"></a><br /></dt>
<dd></dd></dl>
<dl class="c function">
<dt class="sig sig-object c" id="c.hp_QuantData_s">
<span class="kt"><span class="pre">void</span></span><span class="w"> </span><span class="sig-name descname"><span class="n"><span class="pre">hp_QuantData_s</span></span></span><span class="sig-paren">(</span><span class="n"><span class="pre">half</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">real_values</span></span>, <span class="n"><span class="pre">half</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">quant_values</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">element_num</span></span>, <span class="n"><span class="pre">half</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">scale</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">zp</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">segment_num</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">axis_num</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">core_mask</span></span><span class="sig-paren">)</span><a class="headerlink" href="#c.hp_QuantData_s" title="永久链接至目标"></a><br /></dt>
<dd></dd></dl>
<p></p>
<p><strong>C调用示例</strong></p>
<blockquote>
<div><div class="highlight-c notranslate"><div class="highlight"><pre><span></span><span class="linenos"> 1</span><span class="cp">#include</span><span class="w"> </span><span class="cpf">&lt;stdio.h&gt;</span>
<span class="linenos"> 2</span><span class="cp">#include</span><span class="w"> </span><span class="cpf">&lt;quant.h&gt;</span>
<span class="linenos"> 3</span>
<span class="linenos"> 4</span><span class="kt">int</span><span class="w"> </span><span class="nf">main</span><span class="p">(</span><span class="kt">int</span><span class="w"> </span><span class="n">argc</span><span class="p">,</span><span class="w"> </span><span class="kt">char</span><span class="o">*</span><span class="w"> </span><span class="n">argv</span><span class="p">[])</span><span class="w"> </span><span class="p">{</span>
<span class="linenos"> 5</span><span class="w"> </span><span class="kt">float</span><span class="w"> </span><span class="o">*</span><span class="n">input</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="kt">float</span><span class="w"> </span><span class="o">*</span><span class="p">)</span><span class="mh">0x10000000</span><span class="p">;</span><span class="w"> </span><span class="c1">// FP32 输入</span>
<span class="linenos"> 6</span><span class="w"> </span><span class="kt">int8_t</span><span class="w"> </span><span class="o">*</span><span class="n">output</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="kt">int8_t</span><span class="w"> </span><span class="o">*</span><span class="p">)</span><span class="mh">0x10004000</span><span class="p">;</span><span class="w"> </span><span class="c1">// INT8 输出</span>
<span class="linenos"> 7</span><span class="w"> </span><span class="kt">float</span><span class="w"> </span><span class="n">scale</span><span class="p">[</span><span class="mi">4</span><span class="p">]</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">{</span><span class="mf">0.1f</span><span class="p">,</span><span class="w"> </span><span class="mf">0.12f</span><span class="p">,</span><span class="w"> </span><span class="mf">0.11f</span><span class="p">,</span><span class="w"> </span><span class="mf">0.09f</span><span class="p">};</span>
<span class="linenos"> 8</span><span class="w"> </span><span class="kt">int</span><span class="w"> </span><span class="n">zp</span><span class="p">[</span><span class="mi">4</span><span class="p">]</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">{</span><span class="mi">0</span><span class="p">,</span><span class="w"> </span><span class="mi">0</span><span class="p">,</span><span class="w"> </span><span class="mi">0</span><span class="p">,</span><span class="w"> </span><span class="mi">0</span><span class="p">};</span>
<span class="linenos"> 9</span><span class="w"> </span><span class="kt">int</span><span class="w"> </span><span class="n">element_num</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">1024</span><span class="p">;</span>
<span class="linenos">10</span><span class="w"> </span><span class="kt">int</span><span class="w"> </span><span class="n">segment_num</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">4</span><span class="p">;</span>
<span class="hll"><span class="linenos">11</span><span class="w"> </span><span class="kt">int</span><span class="w"> </span><span class="n">axis_num</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">1</span><span class="p">,</span><span class="w"> </span><span class="n">core_mask</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mh">0xff</span><span class="p">;</span>
</span><span class="linenos">12</span>
<span class="linenos">13</span><span class="w"> </span><span class="n">fp_QuantData_s</span><span class="p">(</span><span class="n">input</span><span class="p">,</span><span class="w"> </span><span class="n">output</span><span class="p">,</span><span class="w"> </span><span class="n">element_num</span><span class="p">,</span>
<span class="linenos">14</span><span class="w"> </span><span class="n">scale</span><span class="p">,</span><span class="w"> </span><span class="n">zp</span><span class="p">,</span><span class="w"> </span><span class="n">segment_num</span><span class="p">,</span><span class="w"> </span><span class="n">axis_num</span><span class="p">,</span><span class="w"> </span><span class="n">core_mask</span><span class="p">);</span>
<span class="linenos">15</span>
<span class="linenos">16</span><span class="w"> </span><span class="k">return</span><span class="w"> </span><span class="mi">0</span><span class="p">;</span>
<span class="linenos">17</span><span class="p">}</span>
</pre></div>
</div>
</div></blockquote>
<p></p>
<p><strong>实现说明:</strong></p>
<ul class="simple">
<li><p><code class="docutils literal notranslate"><span class="pre">axis_num</span> <span class="pre">==</span> <span class="pre">0</span></code> 时:</p>
<ul>
<li><p>对整个输入数组执行一次统一量化</p></li>
<li><p>等价于 per-tensor quantization</p></li>
</ul>
</li>
<li><p><code class="docutils literal notranslate"><span class="pre">axis_num</span> <span class="pre">!=</span> <span class="pre">0</span></code> 时:</p>
<ul>
<li><p>输入数据按 <code class="docutils literal notranslate"><span class="pre">segment_num</span></code> 均分为多个分段</p></li>
<li><p>每个分段使用独立的 <code class="docutils literal notranslate"><span class="pre">scale[i]</span></code><code class="docutils literal notranslate"><span class="pre">zp[i]</span></code></p></li>
<li><p>等价于 per-axis dynamic quantization</p></li>
</ul>
</li>
<li><p>核心量化过程由 <code class="docutils literal notranslate"><span class="pre">DoQuantizeFp32ToInt8</span></code> 完成,包括:</p>
<ul>
<li><p>反 scale 计算</p></li>
<li><p>四舍五入</p></li>
<li><p>饱和裁剪</p></li>
<li><p>INF 特殊值处理</p></li>
</ul>
</li>
</ul>
</section>
</div>
</div>
<div class="pageviews-container">
访问量:<span id="busuanzi_page_uv"></span>
</div>
<footer><div class="rst-footer-buttons" role="navigation" aria-label="页脚">
<a href="dropoutgrad.html" class="btn btn-neutral float-left" title="Dropoutgrad" accesskey="p" rel="prev"><span class="fa fa-arrow-circle-left" aria-hidden="true"></span> 上一页</a>
<a href="eltwise.html" class="btn btn-neutral float-right" title="Eltwise" accesskey="n" rel="next">下一页 <span class="fa fa-arrow-circle-right" aria-hidden="true"></span></a>
</div>
<hr/>
<div role="contentinfo">
<p>&#169; 版权所有 2025 - 2026, NUDT-674。</p>
</div>
利用 <a href="https://www.sphinx-doc.org/">Sphinx</a> 构建,使用的
<a href="https://github.com/readthedocs/sphinx_rtd_theme">主题</a>
<a href="https://readthedocs.org">Read the Docs</a> 开发.
</footer>
</div>
</div>
</section>
</div>
<script>
jQuery(function () {
SphinxRtdTheme.Navigation.enable(true);
});
</script>
<script src="//cdn.busuanzi.cc/busuanzi/3.6.9/busuanzi.min.js" defer></script>
</body>
</html>