Skip to content
项目
群组
代码片段
帮助
当前项目
正在载入...
登录 / 注册
切换导航面板
M
mtbookv2
概览
Overview
Details
Activity
Cycle Analytics
版本库
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
问题
0
Issues
0
列表
Board
标记
里程碑
合并请求
0
Merge Requests
0
CI / CD
CI / CD
流水线
作业
日程表
图表
维基
Wiki
代码片段
Snippets
成员
Collapse sidebar
Close sidebar
活动
图像
聊天
创建新问题
作业
提交
Issue Boards
Open sidebar
NiuTrans
mtbookv2
Commits
49258cc9
Commit
49258cc9
authored
Dec 09, 2020
by
曹润柘
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
update
parent
a185cd71
显示空白字符变更
内嵌
并排
正在显示
5 个修改的文件
包含
130 行增加
和
129 行删除
+130
-129
Chapter16/Figures/figure-application-process-of-back-translation.tex
+23
-23
Chapter16/Figures/figure-comparison-of-structure-between-gpt-and-bert-model.tex
+5
-0
Chapter16/Figures/figure-example-of-iterative-back-translation.tex
+19
-19
Chapter16/Figures/figure-mass.tex
+30
-23
Chapter16/chapter16.tex
+53
-64
没有找到文件。
Chapter16/Figures/figure-application-process-of-back-translation.tex
查看文件 @
49258cc9
...
...
@@ -4,9 +4,9 @@
\tikzstyle
{
bignode
}
= [,inner sep=0.3em,draw=black,line width=0.6pt,rounded corners=2pt,minimum width=3.0em]
\node
[anchor=center] (node1-1) at (0,0)
{{
汉语
}}
;
\node
[anchor=west] (node1-2) at ([xshift=0.8em]node1-1.east)
{{
英语
}}
;
\node
[anchor=north] (node1-3) at ([xshift=1.75em]node1-1.south)
{{
反向翻译模型
}}
;
\node
[anchor=center] (node1-1) at (0,0)
{
\small
{
汉语
}}
;
\node
[anchor=west] (node1-2) at ([xshift=0.8em]node1-1.east)
{
\small
{
英语
}}
;
\node
[anchor=north] (node1-3) at ([xshift=1.75em]node1-1.south)
{
\small
{
反向翻译模型
}}
;
\draw
[->,thick](node1-1.east)--(node1-2.west);
\begin{pgfonlayer}
{
background
}
...
...
@@ -16,16 +16,16 @@
\end{pgfonlayer}
\node
[anchor=north,fill=green!20,bignode](node2-1) at ([yshift=-3em]node1-3.south)
{{
汉语
}}
;
\node
[anchor=north,fill=green!20,bignode](node2-2) at (node2-1.south)
{{
英语
}}
;
\draw
[->,thick](node2-1.north)--(remark1.south) node [pos=0.5,right] (pos1)
{{
训练
}}
;
\node
[anchor=north,fill=green!20,bignode](node2-1) at ([yshift=-3em]node1-3.south)
{
\small
{
汉语
}}
;
\node
[anchor=north,fill=green!20,bignode](node2-2) at (node2-1.south)
{
\small
{
英语
}}
;
\draw
[->,thick](node2-1.north)--(remark1.south) node [pos=0.5,right] (pos1)
{
\small
{
训练
}}
;
\node
[anchor=west,fill=yellow!20,bignode](node3-1) at ([xshift=6.5em,yshift=0.0em]node1-2.east)
{{
汉语
}}
;
\node
[anchor=north,fill=red!20,bignode](node3-2) at ([yshift=-2.5em]node3-1.south)
{{
英语
}}
;
\node
[anchor=west,fill=yellow!20,bignode](node3-1) at ([xshift=6.5em,yshift=0.0em]node1-2.east)
{
\small
{
汉语
}}
;
\node
[anchor=north,fill=red!20,bignode](node3-2) at ([yshift=-2.5em]node3-1.south)
{
\small
{
英语
}}
;
\node
[anchor=center](node3-3) at ([xshift=0.4em]node3-2.east)
{}
;
\draw
[->,thick](node3-1.south)--(node3-2.north) node [pos=0.5,right] (pos2)
{{
翻译
}}
;
\draw
[->,thick](node3-1.south)--(node3-2.north) node [pos=0.5,right] (pos2)
{
\small
{
翻译
}}
;
\begin{pgfonlayer}
{
background
}
{
...
...
@@ -33,21 +33,21 @@
}
\end{pgfonlayer}
\draw
[->,thick](remark1.east)--([xshift=5.5em]remark1.east) node [pos=0.5,above] (pos2)
{{
模型翻译
}}
;
\node
[anchor=south](pos2-2) at ([yshift=-0.5em]pos2.north)
{{
使用反向
}}
;
\draw
[->,thick](remark1.east)--([xshift=5.5em]remark1.east) node [pos=0.5,above] (pos2)
{
\small
{
模型翻译
}}
;
\node
[anchor=south](pos2-2) at ([yshift=-0.5em]pos2.north)
{
\small
{
使用反向
}}
;
\draw
[decorate,thick,decoration={brace,amplitude=5pt}]
([yshift=1.5em,xshift=1.5em]node3-1.east) -- ([yshift=-8.6em,xshift=1.5em]node3-1.east) node [pos=0.1,right,xshift=0.0em,yshift=0.0em] (label1)
{{{
混合
}}}
;
\draw
[decorate,thick,decoration={brace,amplitude=5pt}]
([yshift=1.5em,xshift=1.5em]node3-1.east) -- ([yshift=-8.6em,xshift=1.5em]node3-1.east) node [pos=0.1,right,xshift=0.0em,yshift=0.0em] (label1)
{
\small
{{
混合
}}}
;
\node
[anchor=west,fill=red!20,bignode](node4-1) at ([xshift=2.5em,yshift=1.3em]node3-2.east)
{{
英语
}}
;
\node
[anchor=north,fill=yellow!20,bignode](node4-2) at (node4-1.south)
{{
汉语
}}
;
\node
[anchor=west,fill=green!20,bignode](node4-3) at (node4-1.east)
{{
英语
}}
;
\node
[anchor=north,fill=green!20,bignode](node4-4) at (node4-3.south)
{{
汉语
}}
;
\node
[anchor=west,fill=red!20,bignode](node4-1) at ([xshift=2.5em,yshift=1.3em]node3-2.east)
{
\small
{
英语
}}
;
\node
[anchor=north,fill=yellow!20,bignode](node4-2) at (node4-1.south)
{
\small
{
汉语
}}
;
\node
[anchor=west,fill=green!20,bignode](node4-3) at (node4-1.east)
{
\small
{
英语
}}
;
\node
[anchor=north,fill=green!20,bignode](node4-4) at (node4-3.south)
{
\small
{
汉语
}}
;
\node
[anchor=center] (node5-1) at ([xshift=5em,yshift=0.02em]node4-3.east)
{{
英语
}}
;
\node
[anchor=west] (node5-2) at ([xshift=0.8em]node5-1.east)
{{
汉语
}}
;
\node
[anchor=north] (node5-3) at ([xshift=1.65em]node5-1.south)
{{
正向翻译模型
}}
;
\node
[anchor=center] (node5-1) at ([xshift=5em,yshift=0.02em]node4-3.east)
{
\small
{
英语
}}
;
\node
[anchor=west] (node5-2) at ([xshift=0.8em]node5-1.east)
{
\small
{
汉语
}}
;
\node
[anchor=north] (node5-3) at ([xshift=1.65em]node5-1.south)
{
\small
{
正向翻译模型
}}
;
\draw
[->,thick](node5-1.east)--(node5-2.west);
\begin{pgfonlayer}
{
background
}
...
...
@@ -56,11 +56,11 @@
}
\end{pgfonlayer}
\draw
[->,thick]([xshift=-3.2em]remark3.west)--(remark3.west) node [pos=0.5,above] (pos3)
{{
训练
}}
;
\draw
[->,thick]([xshift=-3.2em]remark3.west)--(remark3.west) node [pos=0.5,above] (pos3)
{
\small
{
训练
}}
;
\node
[anchor=south](d1) at ([xshift=-1.5em,yshift=1em]remark1.north)
{{
真实数据:
}}
;
\node
[anchor=west](d2) at ([xshift=2.0em]d1.east)
{{
伪数据:
}}
;
\node
[anchor=west](d3) at ([xshift=2.0em]d2.east)
{{
额外数据:
}}
;
\node
[anchor=south](d1) at ([xshift=-1.5em,yshift=1em]remark1.north)
{
\small
{
真实数据:
}}
;
\node
[anchor=west](d2) at ([xshift=2.0em]d1.east)
{
\small
{
伪数据:
}}
;
\node
[anchor=west](d3) at ([xshift=2.0em]d2.east)
{
\small
{
额外数据:
}}
;
\node
[anchor=west,fill=green!20,minimum width=1.5em](d1-1) at ([xshift=-0.0em]d1.east)
{}
;
\node
[anchor=west,fill=red!20,minimum width=1.5em](d2-1) at ([xshift=-0.0em]d2.east)
{}
;
\node
[anchor=west,fill=yellow!20,minimum width=1.5em](d3-1) at ([xshift=-0.0em]d3.east)
{}
;
...
...
Chapter16/Figures/figure-comparison-of-structure-between-gpt-and-bert-model.tex
查看文件 @
49258cc9
...
...
@@ -103,4 +103,8 @@
\node
[anchor=north] (pos1) at ([xshift=1.5em,yshift=-1.0em]node0-2.south)
{
\small
{
(a) GPT模型结构
}}
;
\node
[anchor=north] (pos2) at ([xshift=1.5em,yshift=-1.0em]node0-6.south)
{
\small
{
(b) BERT模型结构
}}
;
\node
[anchor=south] (ex) at ([xshift=2.1em,yshift=0.5em]node3-1.north)
{
\small
{
TRM:transformer
}}
;
\end{tikzpicture}
\ No newline at end of file
Chapter16/Figures/figure-example-of-iterative-back-translation.tex
查看文件 @
49258cc9
\begin{tikzpicture}
\tikzstyle
{
rec
}
= [inner sep=0.3em,minimum width=4em,draw=black,line width=0.6pt,rounded corners=2pt]
\node
[anchor=north,fill=green!20,rec](node1-1) at (0,0)
{{
汉语
}}
;
\node
[anchor=north,fill=green!20,rec](node1-2) at (node1-1.south)
{{
英语
}}
;
\node
[anchor=north,fill=yellow!20,rec](node2-1) at ([yshift=-5.0em]node1-1.south)
{{
汉语
}}
;
\node
[anchor=north,fill=red!20,rec](node2-2) at (node2-1.south)
{{
英语
}}
;
\node
[anchor=east] (node3-1) at ([xshift=-4.0em,yshift=-3.5em]node1-1.west)
{{
正向
}}
;
\node
[anchor=north] (node3-2) at ([yshift=0.5em]node3-1.south)
{{
翻译模型
}}
;
\node
[anchor=north,fill=green!20,rec](node1-1) at (0,0)
{
\small
{
汉语
}}
;
\node
[anchor=north,fill=green!20,rec](node1-2) at (node1-1.south)
{
\small
{
英语
}}
;
\node
[anchor=north,fill=yellow!20,rec](node2-1) at ([yshift=-5.0em]node1-1.south)
{
\small
{
汉语
}}
;
\node
[anchor=north,fill=red!20,rec](node2-2) at (node2-1.south)
{
\small
{
英语
}}
;
\node
[anchor=east] (node3-1) at ([xshift=-4.0em,yshift=-3.5em]node1-1.west)
{
\small
{
正向
}}
;
\node
[anchor=north] (node3-2) at ([yshift=0.5em]node3-1.south)
{
\small
{
翻译模型
}}
;
\begin{pgfonlayer}
{
background
}
{
\node
[fill=blue!20,inner sep=0.3em,draw=black,line width=0.6pt,minimum width=3.0em,drop shadow,rounded corners=2pt]
[fit =(node3-1)(node3-2)] (remark1)
{}
;
...
...
@@ -14,8 +14,8 @@
\draw
[->,thick]([yshift=-0.75em]node1-1.west)--(remark1.north east);
\draw
[->,thick,dashed](remark1.south east)--([yshift=-0.75em]node2-1.west);
\node
[anchor=west] (node4-1) at ([xshift=4.0em,yshift=-3.5em]node1-1.east)
{{
反向
}}
;
\node
[anchor=north] (node4-2) at ([yshift=0.5em]node4-1.south)
{{
翻译模型
}}
;
\node
[anchor=west] (node4-1) at ([xshift=4.0em,yshift=-3.5em]node1-1.east)
{
\small
{
反向
}}
;
\node
[anchor=north] (node4-2) at ([yshift=0.5em]node4-1.south)
{
\small
{
翻译模型
}}
;
\begin{pgfonlayer}
{
background
}
{
\node
[fill=blue!20,inner sep=0.3em,draw=black,line width=0.6pt,minimum width=3.0em,drop shadow,rounded corners=2pt]
[fit =(node4-1)(node4-2)] (remark2)
{}
;
...
...
@@ -24,15 +24,15 @@
\draw
[->,thick]([yshift=-0.75em]node1-1.east)--(remark2.north west);
\draw
[->,thick]([yshift=-0.75em]node2-1.east)--(remark2.south west);
\node
[anchor=west,fill=green!20,rec](node5-1) at ([xshift=4.0em,yshift=3.48em]node4-1.east)
{{
英语
}}
;
\node
[anchor=north,fill=green!20,rec](node5-2) at (node5-1.south)
{
{
汉语
}}
;
\node
[anchor=north,fill=yellow!20,rec](node6-1) at ([yshift=-5.0em]node5-1.south)
{{
英语
}}
;
\node
[anchor=north,fill=red!20,rec](node6-2) at (node6-1.south)
{{
汉语
}}
;
\node
[anchor=west,fill=green!20,rec](node5-1) at ([xshift=4.0em,yshift=3.48em]node4-1.east)
{
\small
{
英语
}}
;
\node
[anchor=north,fill=green!20,rec](node5-2) at (node5-1.south)
{
\small
{
汉语
}}
;
\node
[anchor=north,fill=yellow!20,rec](node6-1) at ([yshift=-5.0em]node5-1.south)
{
\small
{
英语
}}
;
\node
[anchor=north,fill=red!20,rec](node6-2) at (node6-1.south)
{
\small
{
汉语
}}
;
\draw
[->,thick,dashed](remark2.south east)--([yshift=-0.75em]node6-1.west);
\node
[anchor=west] (node7-1) at ([xshift=4.0em,yshift=-3.5em]node5-1.east)
{{
正向
}}
;
\node
[anchor=north] (node7-2) at ([yshift=0.5em]node7-1.south)
{{
翻译模型
}}
;
\node
[anchor=west] (node7-1) at ([xshift=4.0em,yshift=-3.5em]node5-1.east)
{
\small
{
正向
}}
;
\node
[anchor=north] (node7-2) at ([yshift=0.5em]node7-1.south)
{
\small
{
翻译模型
}}
;
\begin{pgfonlayer}
{
background
}
{
\node
[fill=blue!20,inner sep=0.3em,draw=black,line width=0.6pt,minimum width=3.0em,drop shadow,rounded corners=2pt]
[fit =(node7-1)(node7-2)] (remark3)
{}
;
...
...
@@ -42,14 +42,14 @@
\draw
[->,thick]([yshift=-0.75em]node5-1.east)--(remark3.north west);
\draw
[->,thick]([yshift=-0.75em]node6-1.east)--(remark3.south west);
\node
[anchor=south](d1) at ([xshift=-0.7em,yshift=4em]remark1.north)
{{
真实数据:
}}
;
\node
[anchor=west](d2) at ([xshift=2.0em]d1.east)
{{
伪数据:
}}
;
\node
[anchor=west](d3) at ([xshift=2.0em]d2.east)
{{
额外数据:
}}
;
\node
[anchor=south](d1) at ([xshift=-0.7em,yshift=4em]remark1.north)
{
\small
{
真实数据:
}}
;
\node
[anchor=west](d2) at ([xshift=2.0em]d1.east)
{
\small
{
伪数据:
}}
;
\node
[anchor=west](d3) at ([xshift=2.0em]d2.east)
{
\small
{
额外数据:
}}
;
\node
[anchor=west,fill=green!20,minimum width=1.5em](d1-1) at ([xshift=-0.0em]d1.east)
{}
;
\node
[anchor=west,fill=red!20,minimum width=1.5em](d2-1) at ([xshift=-0.0em]d2.east)
{}
;
\node
[anchor=west,fill=yellow!20,minimum width=1.5em](d3-1) at ([xshift=-0.0em]d3.east)
{}
;
\node
[anchor=south] (d4) at ([xshift=1em]d1.north)
{{
训练:
}}
;
\node
[anchor=south] (d5) at ([xshift=0.5em]d2.north)
{{
推理:
}}
;
\node
[anchor=south] (d4) at ([xshift=1em]d1.north)
{
\small
{
训练:
}}
;
\node
[anchor=south] (d5) at ([xshift=0.5em]d2.north)
{
\small
{
推理:
}}
;
\draw
[->,thick] ([xshift=0em]d4.east)--([xshift=1.5em]d4.east);
\draw
[->,thick,dashed] ([xshift=0em]d5.east)--([xshift=1.5em]d5.east);
...
...
Chapter16/Figures/figure-mass.tex
查看文件 @
49258cc9
\begin{tikzpicture}
\begin{scope}
\tikzstyle
{
word
}
= [font=
\scriptsize
]
\tikzstyle
{
model
}
= [rectangle,draw,minimum height=3em,minimum width=6em,rounded corners=4pt,fill=red!15!white]
\tikzstyle
{
word
}
= [font=
\scriptsize
,minimum height=1.4em]
\tikzstyle
{
model
}
= [rectangle,line width=0.7pt,draw,minimum height=3em,minimum width=13em,rounded corners=4pt,fill=red!20]
\node
[anchor=center] (ate) at (0,0)
{}
;
%decoder
\node
[anchor=center,model,fill=blue!20] (decoder) at ([xshift=7.5em]ate.east)
{
解码器
}
;
\node
[anchor=north,word] (w1) at ([yshift=-1.5em,xshift=0em]decoder.south)
{
\small
{$
x
_
3
$}}
;
\node
[anchor=west,word] (w2) at ([xshift=0em]w1.east)
{
\small
{$
x
_
4
$}}
;
\node
[anchor=west,word] (w3) at ([xshift=0em]w2.east)
{
[M]
}
;
\node
[model,minimum width=10.5em,line width=0.7pt] (decoder) at ([xshift=6em]ate.east)
{
Decoder
}
;
\node
[word] (w1) at ([yshift=-2em,xshift=1em]decoder.south)
{
\small
{$
x
_
3
$}}
;
\node
[word] (w2) at ([xshift=-1em]w1.west)
{
\#
}
;
\node
[word] (w3) at ([xshift=-1em]w2.west)
{
\#
}
;
\node
[word] (w4) at ([xshift=-1em]w3.west)
{
\#
}
;
\node
[word] (w5) at ([xshift=1em]w1.east)
{
\small
{$
x
_
4
$}}
;
\node
[word] (w6) at ([xshift=1em]w5.east)
{
\#
}
;
\node
[anchor=east,word] (w4) at ([xshift=0em]w1.west)
{
[M]
}
;
\node
[anchor=east,word] (w5) at ([xshift=0em]w4.west)
{
[M]
}
;
\node
[anchor=east,word] (w6) at ([xshift=0em]w5.west)
{
[M]
}
;
\node
[anchor=west,word] (w7) at ([xshift=0em]w3.east)
{
[M]
}
;
\node
[
word] (w7) at ([yshift=2em,xshift=1
em]decoder.north)
{
\small
{$
x
_
4
$}}
;
\node
[
word] (w8) at ([yshift=0em,xshift=-1em]w7
.west)
{
\small
{$
x
_
3
$}}
;
\node
[
word] (w9) at ([yshift=0em,xshift=1em]w7
.east)
{
\small
{$
x
_
5
$}}
;
\node
[
anchor=south,word] (w8) at ([yshift=1.5em,xshift=0
em]decoder.north)
{
\small
{$
x
_
4
$}}
;
\node
[
anchor=east,word] (w9) at (w8
.west)
{
\small
{$
x
_
3
$}}
;
\node
[
anchor=west,word] (w10) at (w8
.east)
{
\small
{$
x
_
5
$}}
;
\draw
[->,thick] (w1.north) -- ([yshift=1.35em]w1.north);
\draw
[->,thick] (w2.north) -- ([yshift=1.35em]w2.north);
...
...
@@ -23,19 +24,23 @@
\draw
[->,thick] (w4.north) -- ([yshift=1.35em]w4.north);
\draw
[->,thick] (w5.north) -- ([yshift=1.35em]w5.north);
\draw
[->,thick] (w6.north) -- ([yshift=1.35em]w6.north);
\draw
[->,thick] (w7.north) -- ([yshift=1.35em]w7.north);
\draw
[->,thick] ([yshift=-1.4em]w7.south) -- (w7.south);
\draw
[->,thick] ([yshift=-1.4em]w8.south) -- (w8.south);
\draw
[->,thick] ([yshift=-1.4em]w9.south) -- (w9.south);
\draw
[->,thick] ([yshift=-1.4em]w10.south) -- (w10.south);
%encoder
\node
[model,minimum width=10.5em,line width=0.7pt] (encoder) at ([xshift=-6em]ate.west)
{
Encoder
}
;
\node
[word] (we1) at ([yshift=-2em,xshift=1em]encoder.south)
{
\#
}
;
\node
[word] (we2) at ([xshift=-1em]we1.west)
{
\#
}
;
\node
[word] (we3) at ([xshift=-1em]we2.west)
{
\small
{$
x
_
2
$}}
;
\node
[word] (we4) at ([xshift=-1em]we3.west)
{
\small
{$
x
_
3
$}}
;
\node
[word] (we5) at ([xshift=1em]we1.east)
{
\#
}
;
\node
[word] (we6) at ([xshift=1em]we5.east)
{
\small
{$
x
_
6
$}}
;
\node
[model] (encoder) at ([xshift=-7.5em]ate.west)
{
编码器
}
;
\node
[anchor=north,word] (we1) at ([yshift=-1.5em,xshift=0em]encoder.south)
{
[M]
}
;
\node
[anchor=west,word] (we2) at ([xshift=0em]we1.east)
{
[M]
}
;
\node
[anchor=west,word] (we3) at ([xshift=0em]we2.east)
{
\small
{$
x
_
6
$}}
;
\node
[anchor=east,word] (we4) at ([xshift=0em]we1.west)
{
[M]
}
;
\node
[anchor=east,word] (we5) at ([xshift=0em]we4.west)
{
\small
{$
x
_
2
$}}
;
\node
[anchor=east,word] (we6) at ([xshift=0em]we5.west)
{
\small
{$
x
_
1
$}}
;
\node
[anchor=west,word] (we7) at ([xshift=0em]we3.east)
{
\small
{$
x
_
7
$}}
;
\draw
[->,thick] (we1.north) -- ([yshift=1.35em]we1.north);
\draw
[->,thick] (we2.north) -- ([yshift=1.35em]we2.north);
...
...
@@ -43,7 +48,8 @@
\draw
[->,thick] (we4.north) -- ([yshift=1.35em]we4.north);
\draw
[->,thick] (we5.north) -- ([yshift=1.35em]we5.north);
\draw
[->,thick] (we6.north) -- ([yshift=1.35em]we6.north);
\draw
[->,thick] (we7.north) -- ([yshift=1.35em]we7.north);
\draw
[->,
line width=2pt] ([xshift=0.5em]encoder)--([xshift=-0.5
em]decoder);
\
end{scope}
\draw
[->,
very thick] ([xshift=0.5em]encoder)--([xshift=-0.3
em]decoder);
\
node
[anchor=south] (ex) at ([xshift=-4.0em,yshift=1.0em]encoder.north)
{
\small
{
[M]:Mask
}}
;
\end{tikzpicture}
\ No newline at end of file
Chapter16/chapter16.tex
查看文件 @
49258cc9
This source diff could not be displayed because it is too large. You can
view the blob
instead.
编写
预览
Markdown
格式
0%
重试
或
添加新文件
添加附件
取消
您添加了
0
人
到此讨论。请谨慎行事。
请先完成此评论的编辑!
取消
请
注册
或者
登录
后发表评论