Skip to content
项目
群组
代码片段
帮助
当前项目
正在载入...
登录 / 注册
切换导航面板
M
mtbookv2
概览
Overview
Details
Activity
Cycle Analytics
版本库
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
问题
0
Issues
0
列表
Board
标记
里程碑
合并请求
0
Merge Requests
0
CI / CD
CI / CD
流水线
作业
日程表
图表
维基
Wiki
代码片段
Snippets
成员
Collapse sidebar
Close sidebar
活动
图像
聊天
创建新问题
作业
提交
Issue Boards
Open sidebar
NiuTrans
mtbookv2
Commits
3eb99a54
Commit
3eb99a54
authored
Dec 09, 2020
by
曹润柘
Browse files
Options
Browse Files
Download
Plain Diff
合并分支 'caorunzhe' 到 'master'
update 查看合并请求
!566
parents
74671d53
46be0f99
全部展开
隐藏空白字符变更
内嵌
并排
正在显示
8 个修改的文件
包含
241 行增加
和
40 行删除
+241
-40
Chapter16/Figures/figure-comparison-of-structure-between-gpt-and-bert-model.tex
+107
-0
Chapter16/Figures/figure-elmo-model-structure.tex
+93
-0
Chapter16/Figures/figure-optimization-of-the-model-initialization-method.tex
+12
-12
Chapter16/Figures/figure-parameter-initialization-method-diagram.tex
+2
-2
Chapter16/Figures/figure-schematic-of-the-domain-discriminator.tex
+7
-6
Chapter16/Figures/figure-the-iterative-process-of-bidirectional-training.tex
+9
-9
Chapter16/Figures/figure-unmt-process.tex
+11
-11
Chapter16/chapter16.tex
+0
-0
没有找到文件。
Chapter16/Figures/figure-comparison-of-structure-between-gpt-and-bert-model.tex
0 → 100644
查看文件 @
3eb99a54
\begin{tikzpicture}
\tikzstyle
{
embedding
}
= [line width=0.6pt,draw=black,minimum width=2.5em,minimum height=1.6em,fill=green!20]
\tikzstyle
{
model
}
= [line width=0.6pt,draw=black,minimum width=3.0em,minimum height=1.6em,fill=blue!20,rounded corners=2pt]
\node
[anchor=center,model] (node1-1) at (0,0)
{
\footnotesize
{
TRM
}}
;
\node
[anchor=west,model] (node1-2) at ([xshift=1.8em]node1-1.east)
{
\footnotesize
{
TRM
}}
;
\node
[anchor=west,scale=1.8] (node1-3) at ([xshift=1.0em]node1-2.east)
{
...
}
;
\node
[anchor=west,model] (node1-4) at ([xshift=1.0em]node1-3.east)
{
\footnotesize
{
TRM
}}
;
\node
[anchor=west,model] (node1-5) at ([xshift=2.0em]node1-4.east)
{
\footnotesize
{
TRM
}}
;
\node
[anchor=west,model] (node1-6) at ([xshift=1.8em]node1-5.east)
{
\footnotesize
{
TRM
}}
;
\node
[anchor=west,scale=1.8] (node1-7) at ([xshift=1.0em]node1-6.east)
{
...
}
;
\node
[anchor=west,model] (node1-8) at ([xshift=1.0em]node1-7.east)
{
\footnotesize
{
TRM
}}
;
\node
[anchor=north,embedding] (node0-1) at ([yshift=-2em]node1-1.south)
{
\footnotesize
{$
\mathbi
{
e
}_
1
$}}
;
\node
[anchor=north,embedding] (node0-2) at ([yshift=-2em]node1-2.south)
{
\footnotesize
{$
\mathbi
{
e
}_
2
$}}
;
\node
[anchor=west,scale=1.8] (node0-3) at ([xshift=1.25em]node0-2.east)
{
...
}
;
\node
[anchor=north,embedding] (node0-4) at ([yshift=-2em]node1-4.south)
{
\footnotesize
{$
\mathbi
{
e
}_
n
$}}
;
\node
[anchor=south,model](node2-1) at ([yshift=1.8em]node1-1.north)
{
\footnotesize
{
TRM
}}
;
\node
[anchor=south,model](node2-2) at ([yshift=1.8em]node1-2.north)
{
\footnotesize
{
TRM
}}
;
\node
[anchor=west,scale=1.8](node2-3) at ([xshift=1.0em]node2-2.east)
{
...
}
;
\node
[anchor=south,model](node2-4) at ([yshift=1.8em]node1-4.north)
{
\footnotesize
{
TRM
}}
;
\node
[anchor=south,model](node2-5) at ([yshift=1.8em]node1-5.north)
{
\footnotesize
{
TRM
}}
;
\node
[anchor=south,model](node2-6) at ([yshift=1.8em]node1-6.north)
{
\footnotesize
{
TRM
}}
;
\node
[anchor=west,scale=1.8](node2-7) at ([xshift=1.0em]node2-6.east)
{
...
}
;
\node
[anchor=south,model](node2-8) at ([yshift=1.8em]node1-8.north)
{
\footnotesize
{
TRM
}}
;
\draw
[->,thick](node1-1.north)--(node2-1.south);
\draw
[->,thick](node1-2.north)--(node2-2.south);
\draw
[->,thick](node1-4.north)--(node2-4.south);
\begin{pgfonlayer}
{
background
}
{
\node
[fill=white,inner sep=0.5em,draw=black,line width=0.6pt,minimum width=6.0em,rounded corners=2pt,dashed]
[fit =(node1-1)(node1-2)(node1-3)(node1-4)(node2-1)] (remark1)
{}
;
}
\end{pgfonlayer}
\begin{pgfonlayer}
{
background
}
{
\node
[fill=white,inner sep=0.5em,draw=black,line width=0.6pt,minimum width=6.0em,rounded corners=2pt,dashed]
[fit =(node1-5)(node1-6)(node1-7)(node1-8)(node2-8)] (remark2)
{}
;
}
\end{pgfonlayer}
\draw
[->,thick](node0-1.north)--(node1-1.south);
\draw
[->,thick](node0-1.north)--(node1-2.south);
\draw
[->,thick](node0-1.north)--(node1-4.south);
\draw
[->,thick](node0-2.north)--(node1-2.south);
\draw
[->,thick](node0-2.north)--(node1-4.south);
\draw
[->,thick](node0-4.north)--(node1-4.south);
\draw
[->,thick](node1-1.north)--(node2-1.south);
\draw
[->,thick](node1-1.north)--(node2-2.south);
\draw
[->,thick](node1-1.north)--(node2-4.south);
\draw
[->,thick](node1-2.north)--(node2-2.south);
\draw
[->,thick](node1-2.north)--(node2-4.south);
\draw
[->,thick](node1-4.north)--(node2-4.south);
\node
[anchor=south,embedding,fill=yellow!20](node3-1) at ([yshift=2em]node2-1.north)
{
\footnotesize
{$
\seq
{
P
}_
1
$}}
;
\node
[anchor=south,embedding,fill=yellow!20] (node3-2) at ([yshift=2em]node2-2.north)
{
\footnotesize
{$
\seq
{
P
}_
2
$}}
;
\node
[anchor=west,scale=1.8] (node3-3) at ([xshift=1.25em]node3-2.east)
{
...
}
;
\node
[anchor=south,embedding,fill=yellow!20](node3-4) at ([yshift=2em]node2-4.north)
{
\footnotesize
{$
\seq
{
P
}_
n
$}}
;
\draw
[<-,thick](node3-1.south)--(node2-1.north);
\draw
[<-,thick](node3-2.south)--(node2-2.north);
\draw
[<-,thick](node3-4.south)--(node2-4.north);
%%%%%%%%%bert
\node
[anchor=north,embedding] (node0-5) at ([yshift=-2em]node1-5.south)
{
\footnotesize
{$
\mathbi
{
e
}_
1
$}}
;
\node
[anchor=north,embedding] (node0-6) at ([yshift=-2em]node1-6.south)
{
\footnotesize
{$
\mathbi
{
e
}_
2
$}}
;
\node
[anchor=west,scale=1.8] (node0-7) at ([xshift=1.25em]node0-6.east)
{
...
}
;
\node
[anchor=north,embedding] (node0-8) at ([yshift=-2em]node1-8.south)
{
\footnotesize
{$
\mathbi
{
e
}_
n
$}}
;
\node
[anchor=south,embedding,fill=yellow!20](node3-5) at ([yshift=2em]node2-5.north)
{
\footnotesize
{$
\seq
{
P
}_
1
$}}
;
\node
[anchor=south,embedding,fill=yellow!20] (node3-6) at ([yshift=2em]node2-6.north)
{
\footnotesize
{$
\seq
{
P
}_
2
$}}
;
\node
[anchor=west,scale=1.8] (node3-7) at ([xshift=1.25em]node3-6.east)
{
...
}
;
\node
[anchor=south,embedding,fill=yellow!20](node3-8) at ([yshift=2em]node2-8.north)
{
\footnotesize
{$
\seq
{
P
}_
n
$}}
;
\draw
[->,thick](node0-5.north)--(node1-5.south);
\draw
[->,thick](node0-5.north)--(node1-6.south);
\draw
[->,thick](node0-5.north)--(node1-8.south);
\draw
[->,thick](node0-6.north)--(node1-5.south);
\draw
[->,thick](node0-6.north)--(node1-6.south);
\draw
[->,thick](node0-6.north)--(node1-8.south);
\draw
[->,thick](node0-8.north)--(node1-5.south);
\draw
[->,thick](node0-8.north)--(node1-6.south);
\draw
[->,thick](node0-8.north)--(node1-8.south);
\draw
[->,thick](node1-5.north)--(node2-5.south);
\draw
[->,thick](node1-5.north)--(node2-6.south);
\draw
[->,thick](node1-5.north)--(node2-8.south);
\draw
[->,thick](node1-6.north)--(node2-5.south);
\draw
[->,thick](node1-6.north)--(node2-6.south);
\draw
[->,thick](node1-6.north)--(node2-8.south);
\draw
[->,thick](node1-8.north)--(node2-5.south);
\draw
[->,thick](node1-8.north)--(node2-6.south);
\draw
[->,thick](node1-8.north)--(node2-8.south);
\draw
[<-,thick](node3-5.south)--(node2-5.north);
\draw
[<-,thick](node3-6.south)--(node2-6.north);
\draw
[<-,thick](node3-8.south)--(node2-8.north);
\node
[anchor=north] (pos1) at ([xshift=1.5em,yshift=-1.0em]node0-2.south)
{
\small
{
(a) GPT模型结构
}}
;
\node
[anchor=north] (pos2) at ([xshift=1.5em,yshift=-1.0em]node0-6.south)
{
\small
{
(b) BERT模型结构
}}
;
\end{tikzpicture}
\ No newline at end of file
Chapter16/Figures/figure-elmo-model-structure.tex
0 → 100644
查看文件 @
3eb99a54
\begin{tikzpicture}
\tikzstyle
{
embedding
}
= [line width=0.6pt,draw=black,minimum width=2.5em,minimum height=1.6em,fill=green!20]
\tikzstyle
{
model
}
= [line width=0.6pt,draw=black,minimum width=3.0em,minimum height=1.6em,fill=blue!20,rounded corners=2pt]
\node
[anchor=center,model] (node1-1) at (0,0)
{
\footnotesize
{
LSTM
}}
;
\node
[anchor=west,model] (node1-2) at ([xshift=1.8em]node1-1.east)
{
\footnotesize
{
LSTM
}}
;
\node
[anchor=west,scale=1.8] (node1-3) at ([xshift=1.0em]node1-2.east)
{
...
}
;
\node
[anchor=west,model] (node1-4) at ([xshift=1.0em]node1-3.east)
{
\footnotesize
{
LSTM
}}
;
\node
[anchor=west,model] (node1-5) at ([xshift=2.0em]node1-4.east)
{
\footnotesize
{
LSTM
}}
;
\node
[anchor=west,model] (node1-6) at ([xshift=1.8em]node1-5.east)
{
\footnotesize
{
LSTM
}}
;
\node
[anchor=west,scale=1.8] (node1-7) at ([xshift=1.0em]node1-6.east)
{
...
}
;
\node
[anchor=west,model] (node1-8) at ([xshift=1.0em]node1-7.east)
{
\footnotesize
{
LSTM
}}
;
\node
[anchor=south,model](node2-1) at ([yshift=1.8em]node1-1.north)
{
\footnotesize
{
LSTM
}}
;
\node
[anchor=south,model](node2-2) at ([yshift=1.8em]node1-2.north)
{
\footnotesize
{
LSTM
}}
;
\node
[anchor=west,scale=1.8](node2-3) at ([xshift=1.0em]node2-2.east)
{
...
}
;
\node
[anchor=south,model](node2-4) at ([yshift=1.8em]node1-4.north)
{
\footnotesize
{
LSTM
}}
;
\node
[anchor=south,model](node2-5) at ([yshift=1.8em]node1-5.north)
{
\footnotesize
{
LSTM
}}
;
\node
[anchor=south,model](node2-6) at ([yshift=1.8em]node1-6.north)
{
\footnotesize
{
LSTM
}}
;
\node
[anchor=west,scale=1.8](node2-7) at ([xshift=1.0em]node2-6.east)
{
...
}
;
\node
[anchor=south,model](node2-8) at ([yshift=1.8em]node1-8.north)
{
\footnotesize
{
LSTM
}}
;
\draw
[->,thick](node1-1.east)--(node1-2.west);
\draw
[->,thick](node1-2.east)--([xshift=0.5em]node1-3.west);
\draw
[->,thick]([xshift=-0.5em]node1-3.east)--(node1-4.west);
\draw
[<-,thick](node1-5.east)--(node1-6.west);
\draw
[<-,thick](node1-6.east)--([xshift=0.5em]node1-7.west);
\draw
[<-,thick]([xshift=-0.5em]node1-7.east)--(node1-8.west);
\draw
[->,thick](node1-1.north)--(node2-1.south);
\draw
[->,thick](node1-2.north)--(node2-2.south);
\draw
[->,thick](node1-4.north)--(node2-4.south);
\draw
[->,thick](node1-5.north)--(node2-5.south);
\draw
[->,thick](node1-6.north)--(node2-6.south);
\draw
[->,thick](node1-8.north)--(node2-8.south);
\draw
[->,thick](node2-1.east)--(node2-2.west);
\draw
[->,thick](node2-2.east)--([xshift=0.5em]node2-3.west);
\draw
[->,thick]([xshift=-0.5em]node2-3.east)--(node2-4.west);
\draw
[<-,thick](node2-5.east)--(node2-6.west);
\draw
[<-,thick](node2-6.east)--([xshift=0.5em]node2-7.west);
\draw
[<-,thick]([xshift=-0.5em]node2-7.east)--(node2-8.west);
\begin{pgfonlayer}
{
background
}
{
\node
[fill=white,inner sep=0.5em,draw=black,line width=0.6pt,minimum width=6.0em,rounded corners=2pt,dashed]
[fit =(node1-1)(node1-2)(node1-3)(node1-4)(node2-1)] (remark1)
{}
;
}
\end{pgfonlayer}
\begin{pgfonlayer}
{
background
}
{
\node
[fill=white,inner sep=0.5em,draw=black,line width=0.6pt,minimum width=6.0em,rounded corners=2pt,dashed]
[fit =(node1-5)(node1-6)(node1-7)(node1-8)(node2-8)] (remark1)
{}
;
}
\end{pgfonlayer}
\node
[anchor=north,embedding] (node0-2) at ([yshift=-2em]node1-4.south)
{
\footnotesize
{$
\mathbi
{
e
}_
2
$}}
;
\node
[anchor=east,embedding] (node0-1) at ([xshift=-1.4em]node0-2.west)
{
\footnotesize
{$
\mathbi
{
e
}_
1
$}}
;
\node
[anchor=north,scale=1.8] (node0-3) at ([yshift=-2em]node1-5.south)
{
...
}
;
\node
[anchor=north,embedding] (node0-4) at ([yshift=-2em]node1-6.south)
{
\footnotesize
{$
\mathbi
{
e
}_
n
$}}
;
\draw
[->,thick](node0-1.north)--(node1-1.south);
\draw
[->,thick](node0-1.north)--(node1-5.south);
\draw
[->,thick](node0-2.north)--(node1-2.south);
\draw
[->,thick](node0-2.north)--(node1-6.south);
\draw
[->,thick](node0-4.north)--(node1-4.south);
\draw
[->,thick](node0-4.north)--(node1-8.south);
\node
[anchor=south,embedding,fill=yellow!20](node3-2) at ([yshift=2em]node2-4.north)
{
\footnotesize
{$
\seq
{
P
}_
2
$}}
;
\node
[anchor=east,embedding,fill=yellow!20] (node3-1) at ([xshift=-1.4em]node3-2.west)
{
\footnotesize
{$
\seq
{
P
}_
1
$}}
;
\node
[anchor=south,scale=1.8] (node3-3) at ([yshift=2em]node2-5.north)
{
...
}
;
\node
[anchor=south,embedding,fill=yellow!20](node3-4) at ([yshift=2em]node2-6.north)
{
\footnotesize
{$
\seq
{
P
}_
n
$}}
;
\draw
[<-,thick](node3-1.south)--(node2-1.north);
\draw
[<-,thick](node3-1.south)--(node2-5.north);
\draw
[<-,thick](node3-2.south)--(node2-2.north);
\draw
[<-,thick](node3-2.south)--(node2-6.north);
\draw
[<-,thick](node3-4.south)--(node2-4.north);
\draw
[<-,thick](node3-4.south)--(node2-8.north);
\end{tikzpicture}
Chapter16/Figures/figure-optimization-of-the-model-initialization-method.tex
查看文件 @
3eb99a54
...
@@ -6,15 +6,15 @@
...
@@ -6,15 +6,15 @@
\tikzstyle
{
circle
}
= [draw,black,line width=0.6pt,inner sep=3.5pt,rounded corners=4pt,minimum width=2em]
\tikzstyle
{
circle
}
= [draw,black,line width=0.6pt,inner sep=3.5pt,rounded corners=4pt,minimum width=2em]
\tikzstyle
{
word
}
= [inner sep=3.5pt]
\tikzstyle
{
word
}
= [inner sep=3.5pt]
\node
[circle,fill=red!20]
(data) at (0,0)
{
数据
}
;
\node
[circle,fill=red!20]
(data) at (0,0)
{
\small
{
数据
}
}
;
\node
[circle,fill=blue!20]
(model) at ([xshift=5em]data.east)
{
模型
}
;
\node
[circle,fill=blue!20]
(model) at ([xshift=5em]data.east)
{
\small
{
模型
}
}
;
\node
[word]
(init) at ([xshift=-5em]data.west)
{
初始化
}
;
\node
[word]
(init) at ([xshift=-5em]data.west)
{
\small
{
初始化
}
}
;
\draw
[->,thick]
(init.east) -- ([xshift=-0.2em]data.west);
\draw
[->,thick]
(init.east) -- ([xshift=-0.2em]data.west);
\draw
[->,thick] ([yshift=1pt]data.north) .. controls +(90:2em) and +(90:2em) .. ([yshift=1pt]model.north) node[above,midway]
{
参数优化
}
;
\draw
[->,thick] ([yshift=1pt]data.north) .. controls +(90:2em) and +(90:2em) .. ([yshift=1pt]model.north) node[above,midway]
{
\small
{
参数优化
}
}
;
\draw
[->,thick] ([yshift=1pt]model.south) .. controls +(-90:2em) and +(-90:2em) .. ([yshift=1pt]data.south) node[below,midway]
{
数据优化
}
;
\draw
[->,thick] ([yshift=1pt]model.south) .. controls +(-90:2em) and +(-90:2em) .. ([yshift=1pt]data.south) node[below,midway]
{
\small
{
数据优化
}
}
;
\node
[word]
at ([xshift=-0.5em,yshift=-
5em]data.south)
{
(a)思路1
}
;
\node
[word]
at ([xshift=-0.5em,yshift=-
4em]data.south)
{
\small
{
(a) 思路1
}
}
;
\end{scope}
\end{scope}
\end{tikzpicture}
\end{tikzpicture}
...
@@ -25,15 +25,15 @@
...
@@ -25,15 +25,15 @@
\tikzstyle
{
circle
}
= [draw,black,line width=0.6pt,inner sep=3.5pt,rounded corners=4pt,minimum width=2em]
\tikzstyle
{
circle
}
= [draw,black,line width=0.6pt,inner sep=3.5pt,rounded corners=4pt,minimum width=2em]
\tikzstyle
{
word
}
= [inner sep=3.5pt]
\tikzstyle
{
word
}
= [inner sep=3.5pt]
\node
[circle,fill=red!20]
(data) at (0,0)
{
数据
}
;
\node
[circle,fill=red!20]
(data) at (0,0)
{
\small
{
数据
}
}
;
\node
[circle,fill=blue!20]
(model) at ([xshift=5em]data.east)
{
模型
}
;
\node
[circle,fill=blue!20]
(model) at ([xshift=5em]data.east)
{
\small
{
模型
}
}
;
\node
[word]
(init) at ([xshift=5em]model.east)
{
初始化
}
;
\node
[word]
(init) at ([xshift=5em]model.east)
{
\small
{
初始化
}
}
;
\draw
[->,thick]
(init.west) -- ([xshift=0.2em]model.east);
\draw
[->,thick]
(init.west) -- ([xshift=0.2em]model.east);
\draw
[->,thick] ([yshift=1pt]data.north) .. controls +(90:2em) and +(90:2em) .. ([yshift=1pt]model.north) node[above,midway]
{
参数优化
}
;
\draw
[->,thick] ([yshift=1pt]data.north) .. controls +(90:2em) and +(90:2em) .. ([yshift=1pt]model.north) node[above,midway]
{
\small
{
参数优化
}
}
;
\draw
[->,thick] ([yshift=1pt]model.south) .. controls +(-90:2em) and +(-90:2em) .. ([yshift=1pt]data.south) node[below,midway]
{
数据优化
}
;
\draw
[->,thick] ([yshift=1pt]model.south) .. controls +(-90:2em) and +(-90:2em) .. ([yshift=1pt]data.south) node[below,midway]
{
\small
{
数据优化
}
}
;
\node
[word]
at ([xshift=-0.5em,yshift=-
5em]model.south)
{
(b)思路2
}
;
\node
[word]
at ([xshift=-0.5em,yshift=-
4em]model.south)
{
\small
{
(b) 思路2
}
}
;
\end{scope}
\end{scope}
\end{tikzpicture}
\end{tikzpicture}
...
...
Chapter16/Figures/figure-parameter-initialization-method-diagram.tex
查看文件 @
3eb99a54
...
@@ -6,11 +6,11 @@
...
@@ -6,11 +6,11 @@
\node
[node,minimum width=6em,minimum height=2.4em,fill=red!20,line width=0.6pt]
(encoder1) at (0,0)
{
\small
编码器
}
;
\node
[node,minimum width=6em,minimum height=2.4em,fill=red!20,line width=0.6pt]
(encoder1) at (0,0)
{
\small
编码器
}
;
\node
[node,anchor=west,minimum width=6em,minimum height=2.4em,fill=red!20,line width=0.6pt]
(encoder2) at ([xshift=4em,yshift=0em]encoder1.east)
{
\small
编码器
}
;
\node
[node,anchor=west,minimum width=6em,minimum height=2.4em,fill=red!20,line width=0.6pt]
(encoder2) at ([xshift=4em,yshift=0em]encoder1.east)
{
\small
编码器
}
;
\node
[node,anchor=west,minimum width=6em,minimum height=2.4em,fill=red!
4
0,line width=0.6pt]
(encoder3) at ([xshift=3em]encoder2.east)
{
\small
编码器
}
;
\node
[node,anchor=west,minimum width=6em,minimum height=2.4em,fill=red!
3
0,line width=0.6pt]
(encoder3) at ([xshift=3em]encoder2.east)
{
\small
编码器
}
;
\node
[node,anchor=north,minimum width=6em,minimum height=2.4em,fill=blue!20,line width=0.6pt]
(decoder1) at ([yshift=-3em]encoder1.south)
{
\small
解码器
}
;
\node
[node,anchor=north,minimum width=6em,minimum height=2.4em,fill=blue!20,line width=0.6pt]
(decoder1) at ([yshift=-3em]encoder1.south)
{
\small
解码器
}
;
\node
[node,anchor=west,minimum width=6em,minimum height=2.4em,fill=blue!20,line width=0.6pt]
(decoder2) at ([xshift=4em,yshift=0em]decoder1.east)
{
\small
解码器
}
;
\node
[node,anchor=west,minimum width=6em,minimum height=2.4em,fill=blue!20,line width=0.6pt]
(decoder2) at ([xshift=4em,yshift=0em]decoder1.east)
{
\small
解码器
}
;
\node
[node,anchor=west,minimum width=6em,minimum height=2.4em,fill=blue!
4
0,line width=0.6pt]
(decoder3) at ([xshift=3em]decoder2.east)
{
\small
解码器
}
;
\node
[node,anchor=west,minimum width=6em,minimum height=2.4em,fill=blue!
3
0,line width=0.6pt]
(decoder3) at ([xshift=3em]decoder2.east)
{
\small
解码器
}
;
\node
[anchor=north,font=\scriptsize,fill=yellow!20]
(w1) at ([yshift=-1.6em]decoder1.south)
{
知识
\
就是
\
力量
\
。
\
<EOS>
}
;
\node
[anchor=north,font=\scriptsize,fill=yellow!20]
(w1) at ([yshift=-1.6em]decoder1.south)
{
知识
\
就是
\
力量
\
。
\
<EOS>
}
;
\node
[anchor=north,font=\scriptsize,fill=green!20]
(w3) at ([yshift=-1.6em]decoder3.south)
{
Wissen
\
ist
\
Machit
\
.
\
<EOS>
}
;
\node
[anchor=north,font=\scriptsize,fill=green!20]
(w3) at ([yshift=-1.6em]decoder3.south)
{
Wissen
\
ist
\
Machit
\
.
\
<EOS>
}
;
...
...
Chapter16/Figures/figure-schematic-of-the-domain-discriminator.tex
查看文件 @
3eb99a54
\begin{tikzpicture}
\begin{tikzpicture}
\tikzstyle
{
rec
}
= [,line width=0.6pt,draw,rounded corners,minimum height=2.2em,minimum width=4.3em,fill=blue!20]
\tikzstyle
{
rec
}
= [,line width=0.6pt,draw,rounded corners,minimum height=2.2em,minimum width=4.3em,fill=blue!20]
\node
[anchor=center](node1) at (0,0)
{
源语言
}
;
\node
[anchor=center](node1) at (0,0)
{
\small
{
源语言
}
}
;
\node
[anchor=west,rec,fill=red!20](node2) at ([xshift=2.0em]node1.east)
{
编码器
}
;
\node
[anchor=west,rec,fill=red!20](node2) at ([xshift=2.0em]node1.east)
{
\small
{
编码器
}
}
;
\node
[anchor=west,rec](node3) at ([xshift=3.0em,yshift=2.0em]node2.east)
{
解码器
}
;
\node
[anchor=west,rec](node3) at ([xshift=3.0em,yshift=2.0em]node2.east)
{
\small
{
解码器
}
}
;
\node
[anchor=west,rec,fill=yellow!20](node4) at ([xshift=3.0em,yshift=-2.0em]node2.east)
{
鉴别器
}
;
\node
[anchor=west,rec,fill=yellow!20](node4) at ([xshift=3.0em,yshift=-2.0em]node2.east)
{
\small
{
鉴别器
}
}
;
\draw
[->,thick](node1.east)--(node2.west);
\draw
[->,thick](node1.east)--(node2.west);
\draw
[->,thick](node2.east)--([xshift=1.5em]node2.east)--([xshift=1.5em,yshift=2.0em]node2.east)--(node3.west);
\draw
[->,thick](node2.east)--([xshift=1.5em]node2.east)--([xshift=1.5em,yshift=2.0em]node2.east)--(node3.west);
\draw
[->,thick](node2.east)--([xshift=1.5em]node2.east)--([xshift=1.5em,yshift=-2.0em]node2.east)--(node4.west);
\draw
[->,thick](node2.east)--([xshift=1.5em]node2.east)--([xshift=1.5em,yshift=-2.0em]node2.east)--(node4.west);
\node
[anchor=west,minimum width=5.0em](node5) at ([xshift=2.0em]node3.east)
{
目标语言
}
;
\node
[anchor=west,minimum width=5.0em](node5) at ([xshift=2.0em]node3.east)
{
\small
{
目标语言
}
}
;
\node
[anchor=west,minimum width=5.0em](node6) at ([xshift=2.0em]node4.east)
{
< 领域 >
}
;
\node
[anchor=west,minimum width=5.0em](node6) at ([xshift=2.0em]node4.east)
{
\small
{
< 领域 >
}
}
;
\draw
[->,thick](node3.east)--(node5.west);
\draw
[->,thick](node3.east)--(node5.west);
\draw
[->,thick](node4.east)--(node6.west);
\draw
[->,thick](node4.east)--(node6.west);
\end{tikzpicture}
\end{tikzpicture}
\ No newline at end of file
Chapter16/Figures/figure-the-iterative-process-of-bidirectional-training.tex
查看文件 @
3eb99a54
...
@@ -9,7 +9,7 @@
...
@@ -9,7 +9,7 @@
\node
(bilingual
_
D
_
shadow)[data
_
shadow, right of = monolingual
_
X
_
shadow, xshift=5cm]
{}
;
\node
(bilingual
_
D
_
shadow)[data
_
shadow, right of = monolingual
_
X
_
shadow, xshift=5cm]
{}
;
\node
(monolingual
_
Y
_
shadow)[data
_
shadow, right of = bilingual
_
D
_
shadow, xshift=5cm]
{}
;
\node
(monolingual
_
Y
_
shadow)[data
_
shadow, right of = bilingual
_
D
_
shadow, xshift=5cm]
{}
;
\node
(monolingual
_
X)[data,right of = monolingual
_
X
_
shadow,xshift=-0.08cm,yshift=0.08cm]
{
单语语料X
}
;
\node
(monolingual
_
X)[data,right of = monolingual
_
X
_
shadow,xshift=-0.08cm,yshift=0.08cm]
{
单语语料X
}
;
\node
(bilingual
_
D)[data, right of = monolingual
_
X, xshift=5cm, fill=
ugreen!25
]
{
双语语料D
}
;
\node
(bilingual
_
D)[data, right of = monolingual
_
X, xshift=5cm, fill=
green!30
]
{
双语语料D
}
;
\node
(monolingual
_
Y)[data, right of = bilingual
_
D, xshift=5cm, fill=blue!25]
{
单语语料Y
}
;
\node
(monolingual
_
Y)[data, right of = bilingual
_
D, xshift=5cm, fill=blue!25]
{
单语语料Y
}
;
\node
(process
_
1
_
1)[process, right of = monolingual
_
X, xshift=2.5cm, yshift=-1.5cm]
{
\textbf
{$
M
^
0
_{
x
\to
y
}$}}
;
\node
(process
_
1
_
1)[process, right of = monolingual
_
X, xshift=2.5cm, yshift=-1.5cm]
{
\textbf
{$
M
^
0
_{
x
\to
y
}$}}
;
...
@@ -35,7 +35,7 @@
...
@@ -35,7 +35,7 @@
\node
(text
_
2)[left of = process
_
5
_
1, xshift=-4cm,scale=0.8]
{
第1轮迭代
}
;
\node
(text
_
2)[left of = process
_
5
_
1, xshift=-4cm,scale=0.8]
{
第1轮迭代
}
;
\node
(text
_
3)[left of = ellipsis
_
2, xshift=-4cm, scale=0.8]
{
第2轮迭代
}
;
\node
(text
_
3)[left of = ellipsis
_
2, xshift=-4cm, scale=0.8]
{
第2轮迭代
}
;
\draw
[->, very thick, color=color1!40]
(monolingual
_
X.south)--(ellipsis
_
1.north);
\draw
[->, very thick, color=color1!40]
(monolingual
_
X.south)--(ellipsis
_
1.north);
\draw
[->, very thick, color=
ugreen!55
]
(bilingual
_
D.south)--(ellipsis
_
3.north);
\draw
[->, very thick, color=
green!30
]
(bilingual
_
D.south)--(ellipsis
_
3.north);
\draw
[->, very thick, color=blue!55]
(monolingual
_
Y.south)--(ellipsis
_
5.north);
\draw
[->, very thick, color=blue!55]
(monolingual
_
Y.south)--(ellipsis
_
5.north);
\draw
[->, very thick, color=color1!40]
([xshift=-1.5cm]process
_
2
_
1.west)--(process
_
2
_
1.west);
\draw
[->, very thick, color=color1!40]
([xshift=-1.5cm]process
_
2
_
1.west)--(process
_
2
_
1.west);
\draw
[->, very thick, color=color1!40]
([xshift=-1.5cm]process
_
5
_
1.west)--(process
_
5
_
1.west);
\draw
[->, very thick, color=color1!40]
([xshift=-1.5cm]process
_
5
_
1.west)--(process
_
5
_
1.west);
...
@@ -55,13 +55,13 @@
...
@@ -55,13 +55,13 @@
\draw
[->, very thick, color=color1!40]
(process
_
3
_
2.west)--([yshift=0.35cm]process
_
4
_
1.east);
\draw
[->, very thick, color=color1!40]
(process
_
3
_
2.west)--([yshift=0.35cm]process
_
4
_
1.east);
\draw
[->, very thick, color=color1!40]
(process
_
6
_
1.east)--([yshift=0.35cm]process
_
7
_
2.west);
\draw
[->, very thick, color=color1!40]
(process
_
6
_
1.east)--([yshift=0.35cm]process
_
7
_
2.west);
\draw
[->, very thick, color=color1!40]
(process
_
6
_
2.west)--([yshift=0.35cm]process
_
7
_
1.east);
\draw
[->, very thick, color=color1!40]
(process
_
6
_
2.west)--([yshift=0.35cm]process
_
7
_
1.east);
\draw
[->, very thick, color=
ugreen!55
,in=0,out=270]
([xshift=-0.3cm]bilingual
_
D.south)to(process
_
1
_
1.east);
\draw
[->, very thick, color=
green!30
,in=0,out=270]
([xshift=-0.3cm]bilingual
_
D.south)to(process
_
1
_
1.east);
\draw
[->, very thick, color=
ugreen!55
,in=180,out=270]
([xshift=0.3cm]bilingual
_
D.south)to(process
_
1
_
2.west);
\draw
[->, very thick, color=
green!30
,in=180,out=270]
([xshift=0.3cm]bilingual
_
D.south)to(process
_
1
_
2.west);
\draw
[->, very thick, color=
ugreen!55
,in=0,out=270]
([yshift=-3.7cm]bilingual
_
D.south)to(process
_
4
_
1.east);
\draw
[->, very thick, color=
green!30
,in=0,out=270]
([yshift=-3.7cm]bilingual
_
D.south)to(process
_
4
_
1.east);
\draw
[->, very thick, color=
ugreen!55
,in=180,out=270]
([yshift=-3.7cm]bilingual
_
D.south)to(process
_
4
_
2.west);
\draw
[->, very thick, color=
green!30
,in=180,out=270]
([yshift=-3.7cm]bilingual
_
D.south)to(process
_
4
_
2.west);
\draw
[->, very thick, color=
ugreen!55
,in=0,out=270]
([yshift=-7.3cm]bilingual
_
D.south)to(process
_
7
_
1.east);
\draw
[->, very thick, color=
green!30
,in=0,out=270]
([yshift=-7.3cm]bilingual
_
D.south)to(process
_
7
_
1.east);
\draw
[->, very thick, color=
ugreen!55
,in=180,out=270]
([yshift=-7.3cm]bilingual
_
D.south)to(process
_
7
_
2.west);
\draw
[->, very thick, color=
green!30
,in=180,out=270]
([yshift=-7.3cm]bilingual
_
D.south)to(process
_
7
_
2.west);
\draw
[->, very thick, color=
ugreen!55
,in=180,out=270]
([yshift=-7.3cm]bilingual
_
D.south)to(process
_
7
_
2.west);
\draw
[->, very thick, color=
green!30
,in=180,out=270]
([yshift=-7.3cm]bilingual
_
D.south)to(process
_
7
_
2.west);
\draw
[-, very thick, dashed, color=blue!55]
([xshift=-1cm,yshift=-0.35cm]text
_
1.south)--([xshift=12.7cm,yshift=-0.35cm]text
_
1.south);
\draw
[-, very thick, dashed, color=blue!55]
([xshift=-1cm,yshift=-0.35cm]text
_
1.south)--([xshift=12.7cm,yshift=-0.35cm]text
_
1.south);
\draw
[-, very thick, dashed, color=blue!55]
([xshift=-1cm,yshift=-0.35cm]text
_
2.south)--([xshift=12.7cm,yshift=-0.35cm]text
_
2.south);
\draw
[-, very thick, dashed, color=blue!55]
([xshift=-1cm,yshift=-0.35cm]text
_
2.south)--([xshift=12.7cm,yshift=-0.35cm]text
_
2.south);
...
...
Chapter16/Figures/figure-unmt-process.tex
查看文件 @
3eb99a54
...
@@ -7,24 +7,24 @@
...
@@ -7,24 +7,24 @@
\node
[circle]
(center) at (0,0)
{
\node
[circle]
(center) at (0,0)
{
\begin{tabular}
{
c | c
}
\begin{tabular}
{
c | c
}
$
x
\rightarrow
y
$
&
$
y
\rightarrow
x
$
\\
$
x
\rightarrow
y
$
&
$
y
\rightarrow
x
$
\\
模型
&
模型
\small
{
模型
}
&
\small
{
模型
}
\end{tabular}
\end{tabular}
}
;
}
;
\node
[circle,fill=red!20]
(left) at ([xshift=-9em]center.west)
{$
x
\rightarrow
y
$
\\
数据
}
;
\node
[circle,fill=red!20]
(left) at ([xshift=-9em]center.west)
{$
x
\rightarrow
y
$
\\
\small
{
数据
}
}
;
\node
[circle,fill=red!20]
(right) at ([xshift=9em]center.east)
{$
y
\rightarrow
x
$
\\
数据
}
;
\node
[circle,fill=red!20]
(right) at ([xshift=9em]center.east)
{$
y
\rightarrow
x
$
\\
\small
{
数据
}
}
;
\node
[word]
(init) at ([yshift=6em]center.north)
{
初始化
}
;
\node
[word]
(init) at ([yshift=6em]center.north)
{
\small
{
初始化
}
}
;
\node
[circle,fill=red!20]
(down) at ([yshift=-8em]center.south)
{$
x,y
$
\\
数据
}
;
\node
[circle,fill=red!20]
(down) at ([yshift=-8em]center.south)
{$
x,y
$
\\
\small
{
数据
}
}
;
\draw
[->,thick]
(init.south) -- ([yshift=0.2em]center.north);
\draw
[->,thick]
(init.south) -- ([yshift=0.2em]center.north);
\draw
[->,thick]
([yshift=0.2em]down.north) -- ([yshift=-0.2em]center.south) node[pos=0.6,midway,align=left,xshift=-2.5em,yshift=0.5em]
{
语言模型
\\
目标函数
}
;
\draw
[->,thick]
([yshift=0.2em]down.north) -- ([yshift=-0.2em]center.south) node[pos=0.6,midway,align=left,xshift=-2.5em,yshift=0.5em]
{
\small
{
语言模型
}
\\\small
{
目标函数
}
}
;
\node
[anchor=center] at ([yshift=2.0em,xshift=-2.5em]down.north)
{
(模型优化)
}
;
\node
[anchor=center] at ([yshift=2.0em,xshift=-2.5em]down.north)
{
\small
{
(模型优化)
}
}
;
\draw
[->,thick]
([yshift=1pt]left.north) .. controls +(90:2em) and +(90:2em) .. ([yshift=1pt,xshift=-2.2em]center.north) node[above,midway,align=center]
{
翻译模型目标函数
\\
(模型优化)
}
;
\draw
[->,thick]
([yshift=1pt]left.north) .. controls +(90:2em) and +(90:2em) .. ([yshift=1pt,xshift=-2.2em]center.north) node[above,midway,align=center]
{
\small
{
翻译模型目标函数
}
\\\small
{
(模型优化)
}
}
;
\draw
[->,thick]
([yshift=1pt,xshift=-1.8em]center.north) .. controls +(90:2em) and +(90:2em) .. ([yshift=1pt]right.north) node[above,pos=0.6,align=center]
{
回译
\\
(数据优化)
}
;
\draw
[->,thick]
([yshift=1pt,xshift=-1.8em]center.north) .. controls +(90:2em) and +(90:2em) .. ([yshift=1pt]right.north) node[above,pos=0.6,align=center]
{
\small
{
回译
}
\\\small
{
(数据优化)
}
}
;
\draw
[->,thick] ([yshift=1pt]right.south) .. controls +(-90:2em) and +(-90:2em) .. ([yshift=1pt,xshift=2.2em]center.south) node[below,midway,align=center]
{
翻译模型目标函数
\\
(模型优化)
}
;
\draw
[->,thick] ([yshift=1pt]right.south) .. controls +(-90:2em) and +(-90:2em) .. ([yshift=1pt,xshift=2.2em]center.south) node[below,midway,align=center]
{
\small
{
翻译模型目标函数
}
\\\small
{
(模型优化)
}
}
;
\draw
[->,thick] ([yshift=1pt,xshift=1.8em]center.south) .. controls +(-90:2em) and +(-90:2em) .. ([yshift=1pt]left.south) node[below,pos=0.6,align=center]
{
回译
\\
(数据优化)
}
;
\draw
[->,thick] ([yshift=1pt,xshift=1.8em]center.south) .. controls +(-90:2em) and +(-90:2em) .. ([yshift=1pt]left.south) node[below,pos=0.6,align=center]
{
\small
{
回译
}
\\\small
{
(数据优化)
}
}
;
\end{scope}
\end{scope}
\end{tikzpicture}
\end{tikzpicture}
Chapter16/chapter16.tex
查看文件 @
3eb99a54
差异被折叠。
点击展开。
编写
预览
Markdown
格式
0%
重试
或
添加新文件
添加附件
取消
您添加了
0
人
到此讨论。请谨慎行事。
请先完成此评论的编辑!
取消
请
注册
或者
登录
后发表评论