forked from FT_DSP/FT_DSP.gitlink.net
236 lines
31 KiB
HTML
236 lines
31 KiB
HTML
|
||
|
||
<!DOCTYPE html>
|
||
<html class="writer-html5" lang="zh-CN" data-content_root="../../">
|
||
<head>
|
||
<meta charset="utf-8" /><meta name="viewport" content="width=device-width, initial-scale=1" />
|
||
|
||
<meta name="viewport" content="width=device-width, initial-scale=1.0" />
|
||
<title>Skipgram — MindSpore Signal+ 使用手册 alpha 文档</title>
|
||
<link rel="stylesheet" type="text/css" href="../../_static/pygments.css?v=03e43079" />
|
||
<link rel="stylesheet" type="text/css" href="../../_static/css/theme.css?v=e59714d7" />
|
||
<link rel="stylesheet" type="text/css" href="../../_static/table.css?v=72b86d3e" />
|
||
|
||
|
||
<script src="../../_static/jquery.js?v=5d32c60e"></script>
|
||
<script src="../../_static/_sphinx_javascript_frameworks_compat.js?v=2cd50e6c"></script>
|
||
<script src="../../_static/documentation_options.js?v=406e4f49"></script>
|
||
<script src="../../_static/doctools.js?v=9bcbadda"></script>
|
||
<script src="../../_static/sphinx_highlight.js?v=dc90522c"></script>
|
||
<script src="../../_static/translations.js?v=beaddf03"></script>
|
||
<script src="../../_static/table.js?v=99ed15ba"></script>
|
||
<script src="../../_static/js/theme.js"></script>
|
||
<link rel="index" title="索引" href="../../genindex.html" />
|
||
<link rel="search" title="搜索" href="../../search.html" />
|
||
<link rel="next" title="Smoothl1lossgrad" href="smoothl1lossgrad.html" />
|
||
<link rel="prev" title="Shape" href="shape.html" />
|
||
</head>
|
||
|
||
<body class="wy-body-for-nav">
|
||
<div class="wy-grid-for-nav">
|
||
<nav data-toggle="wy-nav-shift" class="wy-nav-side">
|
||
<div class="wy-side-scroll">
|
||
<div class="wy-side-nav-search" >
|
||
|
||
|
||
|
||
<a href="../../index.html" class="icon icon-home">
|
||
MindSpore Signal+ 使用手册
|
||
</a>
|
||
<div role="search">
|
||
<form id="rtd-search-form" class="wy-form" action="../../search.html" method="get">
|
||
<input type="text" name="q" placeholder="搜索文档" aria-label="搜索文档" />
|
||
<input type="hidden" name="check_keywords" value="yes" />
|
||
<input type="hidden" name="area" value="default" />
|
||
</form>
|
||
</div>
|
||
</div><div class="wy-menu wy-menu-vertical" data-spy="affix" role="navigation" aria-label="导航菜单">
|
||
<ul>
|
||
<li class="toctree-l1"><a class="reference internal" href="../../quickstart/index.html">快速入门</a></li>
|
||
<li class="toctree-l1"><a class="reference internal" href="../../appdevelop/index.html">应用开发示例</a></li>
|
||
<li class="toctree-l1"><a class="reference internal" href="../index.html">算子库支持</a></li>
|
||
<li class="toctree-l1"><a class="reference internal" href="../../refdoc/index.html">参考资料</a></li>
|
||
</ul>
|
||
|
||
</div>
|
||
</div>
|
||
</nav>
|
||
|
||
<section data-toggle="wy-nav-shift" class="wy-nav-content-wrap"><nav class="wy-nav-top" aria-label="移动版导航菜单" >
|
||
<i data-toggle="wy-nav-top" class="fa fa-bars"></i>
|
||
<a href="../../index.html">MindSpore Signal+ 使用手册</a>
|
||
</nav>
|
||
|
||
<div class="wy-nav-content">
|
||
<div class="rst-content">
|
||
<div role="navigation" aria-label="页面导航">
|
||
<ul class="wy-breadcrumbs">
|
||
<li><a href="../../index.html" class="icon icon-home" aria-label="Home"></a></li>
|
||
<li class="breadcrumb-item"><a href="../index.html">算子库支持</a></li>
|
||
<li class="breadcrumb-item"><a href="dsplib_index.html">DSP Library C API Reference</a></li>
|
||
<li class="breadcrumb-item active">Skipgram</li>
|
||
<li class="wy-breadcrumbs-aside">
|
||
<a href="../../_sources/functionlib/dsplib/skipgram.rst.txt" rel="nofollow"> 查看页面源码</a>
|
||
</li>
|
||
</ul>
|
||
<hr/>
|
||
</div>
|
||
<div role="main" class="document" itemscope="itemscope" itemtype="http://schema.org/Article">
|
||
<div itemprop="articleBody">
|
||
|
||
<section id="skipgram">
|
||
<h1>Skipgram<a class="headerlink" href="#skipgram" title="Link to this heading"></a></h1>
|
||
<p>从输入语句中生成skip-gram。skip-gram是从句子中提取的词语序列，其中相邻词语之间的距离（跳过的词语数量）不超过指定的最大值。此算子主要用于自然语言处理（NLP）任务。</p>
|
||
<dl class="simple">
|
||
<dt>输入：</dt><dd><ul class="simple">
|
||
<li><p><strong>sentence</strong> - <cite>StringPack*</cite> 类型，指向输入语句的指针。</p></li>
|
||
<li><p><strong>words</strong> - <cite>StringPack*</cite> 类型，用于存储从语句中解析出的词语的工作空间。</p></li>
|
||
<li><p><strong>ngram_size</strong> - <cite>int</cite> 类型，指定每个n-gram中的词语数量。</p></li>
|
||
<li><p><strong>max_skip_size</strong> - <cite>int</cite> 类型，指定在构成n-gram时可以跳过的最大词语数量。</p></li>
|
||
<li><p><strong>include_all_ngrams</strong> - <cite>int</cite> 类型，布尔标志。如果为非零，则生成长度从1到 <cite>ngram_size</cite> 的所有n-gram；否则，仅生成长度为 <cite>ngram_size</cite> 的n-gram。</p></li>
|
||
<li><p><strong>grams</strong> - <cite>StringPack**</cite> 类型，用于存储生成的gram的工作空间。</p></li>
|
||
<li><p><strong>grams_word_count</strong> - <cite>int*</cite> 类型，用于存储每个gram中词语数量的工作空间。</p></li>
|
||
<li><p><strong>stack</strong> - <cite>int*</cite> 类型，长度为 <cite>ngram_size</cite> 的临时工作空间。</p></li>
|
||
<li><p><strong>blank</strong> - <cite>char*</cite> 类型，指向空格字符的指针，用于连接gram中的词语。</p></li>
|
||
<li><p><strong>output_tensor</strong> - <cite>char*</cite> 类型，最终输出张量的数据地址。</p></li>
|
||
<li><p><strong>offset</strong> - <cite>int*</cite> 类型，输出参数，用于存储 <cite>output_tensor</cite> 中每个gram的偏移量。</p></li>
|
||
<li><p><strong>len</strong> - <cite>int*</cite> 类型，输出参数，用于存储 <cite>output_tensor</cite> 中每个gram的长度。</p></li>
|
||
<li><p><strong>shape</strong> - <cite>int*</cite> 类型，输出参数，用于存储输出张量的维度信息。</p></li>
|
||
<li><p><strong>core_mask</strong> - (仅限共享版本) 核掩码。</p></li>
|
||
</ul>
|
||
</dd>
|
||
<dt>输出：</dt><dd><ul class="simple">
|
||
<li><p><strong>output_tensor</strong>、<strong>offset</strong>、<strong>len</strong> 和 <strong>shape</strong> - 这些指针指向的内存区域将被填充，以表示包含生成结果的最终张量。</p></li>
|
||
</ul>
|
||
</dd>
|
||
<dt>支持平台：</dt><dd><p><code class="docutils literal notranslate"><span class="pre">FT78NE</span></code>
|
||
<code class="docutils literal notranslate"><span class="pre">MT7004</span></code></p>
|
||
</dd>
|
||
</dl>
|
||
<div class="admonition note">
|
||
<p class="admonition-title">备注</p>
|
||
<ul class="simple">
|
||
<li><p>该算子不区分数据类型，直接操作字符数据。</p></li>
|
||
</ul>
|
||
</div>
|
||
<p><strong>共享存储版本:</strong></p>
|
||
<dl class="c function">
|
||
<dt class="sig sig-object c" id="c.skipgram_s">
|
||
<span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="sig-name descname"><span class="n"><span class="pre">skipgram_s</span></span></span><span class="sig-paren">(</span><span class="n"><span class="pre">StringPack</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">sentence</span></span>, <span class="n"><span class="pre">StringPack</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">words</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">ngram_size</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">max_skip_size</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">include_all_ngrams</span></span>, <span class="n"><span class="pre">StringPack</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">grams</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">grams_word_count</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">stack</span></span>, <span class="kt"><span class="pre">char</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">blank</span></span>, <span class="kt"><span class="pre">char</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">output_tensor</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">offset</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">len</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">shape</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">core_mask</span></span><span class="sig-paren">)</span><a class="headerlink" href="#c.skipgram_s" title="Link to this definition"></a><br /></dt>
|
||
<dd></dd></dl>
|
||
|
||
<p><strong>C调用示例：</strong></p>
|
||
<div class="highlight-c notranslate"><div class="highlight"><pre><span></span><span class="linenos"> 1</span><span class="cp">#include</span><span class="w"> </span><span class="cpf"><stdio.h></span>
|
||
<span class="linenos"> 2</span><span class="cp">#include</span><span class="w"> </span><span class="cpf">"skipgram.h"</span><span class="c1"> // 假设头文件名</span>
|
||
<span class="linenos"> 3</span>
|
||
<span class="linenos"> 4</span><span class="k">typedef</span><span class="w"> </span><span class="k">struct</span><span class="w"> </span><span class="nc">StringPack</span><span class="w"> </span><span class="p">{</span>
|
||
<span class="linenos"> 5</span><span class="w"> </span><span class="kt">long</span><span class="w"> </span><span class="kt">long</span><span class="w"> </span><span class="n">len</span><span class="p">;</span>
|
||
<span class="linenos"> 6</span><span class="w"> </span><span class="kt">char</span><span class="w"> </span><span class="o">*</span><span class="n">data</span><span class="p">;</span>
|
||
<span class="linenos"> 7</span><span class="p">}</span><span class="w"> </span><span class="n">StringPack</span><span class="p">;</span>
|
||
<span class="linenos"> 8</span>
|
||
<span class="linenos"> 9</span><span class="kt">int</span><span class="w"> </span><span class="nf">main</span><span class="p">(</span><span class="kt">int</span><span class="w"> </span><span class="n">argc</span><span class="p">,</span><span class="w"> </span><span class="kt">char</span><span class="o">*</span><span class="w"> </span><span class="n">argv</span><span class="p">[])</span><span class="w"> </span><span class="p">{</span>
|
||
<span class="linenos">10</span><span class="w"> </span><span class="c1">// 假设输入和工作空间已在DDR中分配</span>
|
||
<span class="linenos">11</span><span class="w"> </span><span class="n">StringPack</span><span class="o">*</span><span class="w"> </span><span class="n">sentence</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="n">StringPack</span><span class="o">*</span><span class="p">)</span><span class="mh">0xA0000000</span><span class="p">;</span>
|
||
<span class="linenos">12</span><span class="w"> </span><span class="n">StringPack</span><span class="o">*</span><span class="w"> </span><span class="n">words</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="n">StringPack</span><span class="o">*</span><span class="p">)</span><span class="mh">0xA0010000</span><span class="p">;</span>
|
||
<span class="linenos">13</span><span class="w"> </span><span class="n">StringPack</span><span class="o">**</span><span class="w"> </span><span class="n">grams</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="n">StringPack</span><span class="o">**</span><span class="p">)</span><span class="mh">0xA0020000</span><span class="p">;</span>
|
||
<span class="linenos">14</span><span class="w"> </span><span class="kt">int</span><span class="o">*</span><span class="w"> </span><span class="n">grams_word_count</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="kt">int</span><span class="o">*</span><span class="p">)</span><span class="mh">0xA0030000</span><span class="p">;</span>
|
||
<span class="linenos">15</span><span class="w"> </span><span class="kt">int</span><span class="o">*</span><span class="w"> </span><span class="n">stack</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="kt">int</span><span class="o">*</span><span class="p">)</span><span class="mh">0xA0040000</span><span class="p">;</span>
|
||
<span class="linenos">16</span><span class="w"> </span><span class="kt">char</span><span class="o">*</span><span class="w"> </span><span class="n">output_tensor</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="kt">char</span><span class="o">*</span><span class="p">)</span><span class="mh">0xB0000000</span><span class="p">;</span>
|
||
<span class="linenos">17</span><span class="w"> </span><span class="kt">int</span><span class="o">*</span><span class="w"> </span><span class="n">offset</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="kt">int</span><span class="o">*</span><span class="p">)</span><span class="mh">0xB0010000</span><span class="p">;</span>
|
||
<span class="linenos">18</span><span class="w"> </span><span class="kt">int</span><span class="o">*</span><span class="w"> </span><span class="n">len</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="kt">int</span><span class="o">*</span><span class="p">)</span><span class="mh">0xB0020000</span><span class="p">;</span>
|
||
<span class="linenos">19</span><span class="w"> </span><span class="kt">int</span><span class="o">*</span><span class="w"> </span><span class="n">shape</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="kt">int</span><span class="o">*</span><span class="p">)</span><span class="mh">0xB0030000</span><span class="p">;</span>
|
||
<span class="linenos">20</span><span class="w"> </span><span class="kt">char</span><span class="w"> </span><span class="n">blank_char</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="sc">' '</span><span class="p">;</span>
|
||
<span class="linenos">21</span>
|
||
<span class="linenos">22</span><span class="w"> </span><span class="c1">// 填充sentence内容</span>
|
||
<span class="linenos">23</span><span class="w"> </span><span class="n">sentence</span><span class="o">-></span><span class="n">data</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s">"mindspore signal processing library"</span><span class="p">;</span>
|
||
<span class="linenos">24</span><span class="w"> </span><span class="n">sentence</span><span class="o">-></span><span class="n">len</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">33</span><span class="p">;</span>
|
||
<span class="linenos">25</span>
|
||
<span class="linenos">26</span><span class="w"> </span><span class="kt">int</span><span class="w"> </span><span class="n">ngram_size</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">2</span><span class="p">;</span>
|
||
<span class="linenos">27</span><span class="w"> </span><span class="kt">int</span><span class="w"> </span><span class="n">max_skip_size</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">1</span><span class="p">;</span>
|
||
<span class="linenos">28</span><span class="w"> </span><span class="kt">int</span><span class="w"> </span><span class="n">include_all_ngrams</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">1</span><span class="p">;</span>
|
||
<span class="linenos">29</span><span class="w"> </span><span class="kt">int</span><span class="w"> </span><span class="n">core_mask</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mh">0xff</span><span class="p">;</span>
|
||
<span class="linenos">30</span>
|
||
<span class="hll"><span class="linenos">31</span><span class="w"> </span><span class="n">skipgram_s</span><span class="p">(</span><span class="n">sentence</span><span class="p">,</span><span class="w"> </span><span class="n">words</span><span class="p">,</span><span class="w"> </span><span class="n">ngram_size</span><span class="p">,</span><span class="w"> </span><span class="n">max_skip_size</span><span class="p">,</span><span class="w"> </span><span class="n">include_all_ngrams</span><span class="p">,</span>
|
||
</span><span class="hll"><span class="linenos">32</span><span class="w"> </span><span class="n">grams</span><span class="p">,</span><span class="w"> </span><span class="n">grams_word_count</span><span class="p">,</span><span class="w"> </span><span class="n">stack</span><span class="p">,</span><span class="w"> </span><span class="o">&</span><span class="n">blank_char</span><span class="p">,</span>
|
||
</span><span class="hll"><span class="linenos">33</span><span class="w"> </span><span class="n">output_tensor</span><span class="p">,</span><span class="w"> </span><span class="n">offset</span><span class="p">,</span><span class="w"> </span><span class="n">len</span><span class="p">,</span><span class="w"> </span><span class="n">shape</span><span class="p">,</span><span class="w"> </span><span class="n">core_mask</span><span class="p">);</span>
|
||
</span><span class="linenos">34</span><span class="w"> </span><span class="k">return</span><span class="w"> </span><span class="mi">0</span><span class="p">;</span>
|
||
<span class="linenos">35</span><span class="p">}</span>
|
||
</pre></div>
|
||
</div>
|
||
<p><strong>私有存储版本:</strong></p>
|
||
<dl class="c function">
|
||
<dt class="sig sig-object c" id="c.skipgram_p">
|
||
<span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="sig-name descname"><span class="n"><span class="pre">skipgram_p</span></span></span><span class="sig-paren">(</span><span class="n"><span class="pre">StringPack</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">sentence</span></span>, <span class="n"><span class="pre">StringPack</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">words</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">ngram_size</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">max_skip_size</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="n"><span class="pre">include_all_ngrams</span></span>, <span class="n"><span class="pre">StringPack</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">grams</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">grams_word_count</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">stack</span></span>, <span class="kt"><span class="pre">char</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">blank</span></span>, <span class="kt"><span class="pre">char</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">output_tensor</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">offset</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">len</span></span>, <span class="kt"><span class="pre">int</span></span><span class="w"> </span><span class="p"><span class="pre">*</span></span><span class="n"><span class="pre">shape</span></span><span class="sig-paren">)</span><a class="headerlink" href="#c.skipgram_p" title="Link to this definition"></a><br /></dt>
|
||
<dd></dd></dl>
|
||
|
||
<p><strong>C调用示例：</strong></p>
|
||
<div class="highlight-c notranslate"><div class="highlight"><pre><span></span><span class="linenos"> 1</span><span class="cp">#include</span><span class="w"> </span><span class="cpf"><stdio.h></span>
|
||
<span class="linenos"> 2</span><span class="cp">#include</span><span class="w"> </span><span class="cpf">"skipgram.h"</span><span class="c1"> // 假设头文件名</span>
|
||
<span class="linenos"> 3</span>
|
||
<span class="linenos"> 4</span><span class="k">typedef</span><span class="w"> </span><span class="k">struct</span><span class="w"> </span><span class="nc">StringPack</span><span class="w"> </span><span class="p">{</span>
|
||
<span class="linenos"> 5</span><span class="w"> </span><span class="kt">long</span><span class="w"> </span><span class="kt">long</span><span class="w"> </span><span class="n">len</span><span class="p">;</span>
|
||
<span class="linenos"> 6</span><span class="w"> </span><span class="kt">char</span><span class="w"> </span><span class="o">*</span><span class="n">data</span><span class="p">;</span>
|
||
<span class="linenos"> 7</span><span class="p">}</span><span class="w"> </span><span class="n">StringPack</span><span class="p">;</span>
|
||
<span class="linenos"> 8</span>
|
||
<span class="linenos"> 9</span><span class="kt">int</span><span class="w"> </span><span class="nf">main</span><span class="p">(</span><span class="kt">int</span><span class="w"> </span><span class="n">argc</span><span class="p">,</span><span class="w"> </span><span class="kt">char</span><span class="o">*</span><span class="w"> </span><span class="n">argv</span><span class="p">[])</span><span class="w"> </span><span class="p">{</span>
|
||
<span class="linenos">10</span><span class="w"> </span><span class="c1">// 假设输入和工作空间已在私有内存中分配</span>
|
||
<span class="linenos">11</span><span class="w"> </span><span class="n">StringPack</span><span class="o">*</span><span class="w"> </span><span class="n">sentence</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="n">StringPack</span><span class="o">*</span><span class="p">)</span><span class="mh">0x10001000</span><span class="p">;</span>
|
||
<span class="linenos">12</span><span class="w"> </span><span class="n">StringPack</span><span class="o">*</span><span class="w"> </span><span class="n">words</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="n">StringPack</span><span class="o">*</span><span class="p">)</span><span class="mh">0x10002000</span><span class="p">;</span>
|
||
<span class="linenos">13</span><span class="w"> </span><span class="n">StringPack</span><span class="o">**</span><span class="w"> </span><span class="n">grams</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="n">StringPack</span><span class="o">**</span><span class="p">)</span><span class="mh">0x10003000</span><span class="p">;</span>
|
||
<span class="linenos">14</span><span class="w"> </span><span class="kt">int</span><span class="o">*</span><span class="w"> </span><span class="n">grams_word_count</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="kt">int</span><span class="o">*</span><span class="p">)</span><span class="mh">0x10004000</span><span class="p">;</span>
|
||
<span class="linenos">15</span><span class="w"> </span><span class="kt">int</span><span class="o">*</span><span class="w"> </span><span class="n">stack</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="kt">int</span><span class="o">*</span><span class="p">)</span><span class="mh">0x10005000</span><span class="p">;</span>
|
||
<span class="linenos">16</span><span class="w"> </span><span class="kt">char</span><span class="o">*</span><span class="w"> </span><span class="n">output_tensor</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="kt">char</span><span class="o">*</span><span class="p">)</span><span class="mh">0x10006000</span><span class="p">;</span>
|
||
<span class="linenos">17</span><span class="w"> </span><span class="kt">int</span><span class="o">*</span><span class="w"> </span><span class="n">offset</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="kt">int</span><span class="o">*</span><span class="p">)</span><span class="mh">0x10007000</span><span class="p">;</span>
|
||
<span class="linenos">18</span><span class="w"> </span><span class="kt">int</span><span class="o">*</span><span class="w"> </span><span class="n">len</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="kt">int</span><span class="o">*</span><span class="p">)</span><span class="mh">0x10008000</span><span class="p">;</span>
|
||
<span class="linenos">19</span><span class="w"> </span><span class="kt">int</span><span class="o">*</span><span class="w"> </span><span class="n">shape</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="kt">int</span><span class="o">*</span><span class="p">)</span><span class="mh">0x10009000</span><span class="p">;</span>
|
||
<span class="linenos">20</span><span class="w"> </span><span class="kt">char</span><span class="w"> </span><span class="n">blank_char</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="sc">' '</span><span class="p">;</span>
|
||
<span class="linenos">21</span>
|
||
<span class="linenos">22</span><span class="w"> </span><span class="c1">// 填充sentence内容</span>
|
||
<span class="linenos">23</span><span class="w"> </span><span class="n">sentence</span><span class="o">-></span><span class="n">data</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s">"mindspore signal processing library"</span><span class="p">;</span>
|
||
<span class="linenos">24</span><span class="w"> </span><span class="n">sentence</span><span class="o">-></span><span class="n">len</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">33</span><span class="p">;</span>
|
||
<span class="linenos">25</span>
|
||
<span class="linenos">26</span><span class="w"> </span><span class="kt">int</span><span class="w"> </span><span class="n">ngram_size</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">2</span><span class="p">;</span>
|
||
<span class="linenos">27</span><span class="w"> </span><span class="kt">int</span><span class="w"> </span><span class="n">max_skip_size</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">1</span><span class="p">;</span>
|
||
<span class="linenos">28</span><span class="w"> </span><span class="kt">int</span><span class="w"> </span><span class="n">include_all_ngrams</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="mi">1</span><span class="p">;</span>
|
||
<span class="linenos">29</span>
|
||
<span class="hll"><span class="linenos">30</span><span class="w"> </span><span class="n">skipgram_p</span><span class="p">(</span><span class="n">sentence</span><span class="p">,</span><span class="w"> </span><span class="n">words</span><span class="p">,</span><span class="w"> </span><span class="n">ngram_size</span><span class="p">,</span><span class="w"> </span><span class="n">max_skip_size</span><span class="p">,</span><span class="w"> </span><span class="n">include_all_ngrams</span><span class="p">,</span>
|
||
</span><span class="hll"><span class="linenos">31</span><span class="w"> </span><span class="n">grams</span><span class="p">,</span><span class="w"> </span><span class="n">grams_word_count</span><span class="p">,</span><span class="w"> </span><span class="n">stack</span><span class="p">,</span><span class="w"> </span><span class="o">&</span><span class="n">blank_char</span><span class="p">,</span>
|
||
</span><span class="hll"><span class="linenos">32</span><span class="w"> </span><span class="n">output_tensor</span><span class="p">,</span><span class="w"> </span><span class="n">offset</span><span class="p">,</span><span class="w"> </span><span class="n">len</span><span class="p">,</span><span class="w"> </span><span class="n">shape</span><span class="p">);</span>
|
||
</span><span class="linenos">33</span><span class="w"> </span><span class="k">return</span><span class="w"> </span><span class="mi">0</span><span class="p">;</span>
|
||
<span class="linenos">34</span><span class="p">}</span>
|
||
</pre></div>
|
||
</div>
|
||
</section>
|
||
|
||
|
||
</div>
|
||
</div>
|
||
<footer><div class="rst-footer-buttons" role="navigation" aria-label="页脚">
|
||
<a href="shape.html" class="btn btn-neutral float-left" title="Shape" accesskey="p" rel="prev"><span class="fa fa-arrow-circle-left" aria-hidden="true"></span> 上一页</a>
|
||
<a href="smoothl1lossgrad.html" class="btn btn-neutral float-right" title="Smoothl1lossgrad" accesskey="n" rel="next">下一页 <span class="fa fa-arrow-circle-right" aria-hidden="true"></span></a>
|
||
</div>
|
||
|
||
<hr/>
|
||
|
||
<div role="contentinfo">
|
||
<p>© 版权所有 2025 - 2026, NUDT-674。</p>
|
||
</div>
|
||
|
||
利用 <a href="https://www.sphinx-doc.org/">Sphinx</a> 构建，使用的
|
||
<a href="https://github.com/readthedocs/sphinx_rtd_theme">主题</a>
|
||
由 <a href="https://readthedocs.org">Read the Docs</a> 开发.
|
||
|
||
|
||
</footer>
|
||
</div>
|
||
</div>
|
||
</section>
|
||
</div>
|
||
<script>
|
||
jQuery(function () {
|
||
SphinxRtdTheme.Navigation.enable(true);
|
||
});
|
||
</script>
|
||
|
||
</body>
|
||
</html> |