Skip to content
项目
群组
代码片段
帮助
当前项目
正在载入...
登录 / 注册
切换导航面板
M
mtbookv2
概览
Overview
Details
Activity
Cycle Analytics
版本库
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
问题
0
Issues
0
列表
Board
标记
里程碑
合并请求
0
Merge Requests
0
CI / CD
CI / CD
流水线
作业
日程表
图表
维基
Wiki
代码片段
Snippets
成员
Collapse sidebar
Close sidebar
活动
图像
聊天
创建新问题
作业
提交
Issue Boards
Open sidebar
NiuTrans
mtbookv2
Commits
e6083378
Commit
e6083378
authored
Jan 02, 2021
by
单韦乔
Browse files
Options
Browse Files
Download
Plain Diff
合并分支 'shanweiqiao' 到 'caorunzhe'
Shanweiqiao 查看合并请求
!761
parents
e287b5a4
1e27a739
全部展开
隐藏空白字符变更
内嵌
并排
正在显示
7 个修改的文件
包含
261 行增加
和
11 行删除
+261
-11
Chapter13/Figures/figure-bpe.tex
+1
-1
Chapter13/Figures/figure-exposure-bias.tex
+146
-0
Chapter13/Figures/figure-framework-of-Adversarial-Neural-machine-translation.tex
+39
-0
Chapter13/Figures/figure-of-scheduling-sampling-method.tex
+57
-0
Chapter13/Figures/figure-reinforcement-learning-method-based-on-actor-critic.tex
+15
-8
Chapter13/Figures/figure-word-root.tex
+3
-2
Chapter13/chapter13.tex
+0
-0
没有找到文件。
Chapter13/Figures/figure-bpe.tex
查看文件 @
e6083378
...
@@ -17,7 +17,7 @@
...
@@ -17,7 +17,7 @@
\draw
[->,line width=.03cm]
([yshift=0em]node5.south) -- ([yshift=0em]node6.north);
\draw
[->,line width=.03cm]
([yshift=0em]node5.south) -- ([yshift=0em]node6.north);
\node
[node,anchor = west]
(node8) at ([xshift = 2em,yshift = 2em]node7.east)
{
对于词表外的词lowest
}
;
\node
[node,anchor = west]
(node8) at ([xshift = 2em,yshift = 2em]node7.east)
{
对于词表外的词lowest
}
;
\node
[node,anchor = north west]
(node9) at ([yshift = 0.3em]node8.south west)
{
可以被
分割
为low est
}
;
\node
[node,anchor = north west]
(node9) at ([yshift = 0.3em]node8.south west)
{
可以被
合并
为low est
}
;
\node
[node,font=\scriptsize,anchor = north,fill=ugreen!5,drop shadow]
(dict) at ([xshift = 5em,yshift = -5em]node6.south)
{
\begin{tabular}
{
llllll
}
\node
[node,font=\scriptsize,anchor = north,fill=ugreen!5,drop shadow]
(dict) at ([xshift = 5em,yshift = -5em]node6.south)
{
\begin{tabular}
{
llllll
}
\multirow
{
3
}{
*
}{
符号合并表:
}
&
('e','s')
&
('es','t')
&
('est','
$
<
$
e
$
>
$
')
&
('l','o')
&
('lo','w')
\\
\multirow
{
3
}{
*
}{
符号合并表:
}
&
('e','s')
&
('es','t')
&
('est','
$
<
$
e
$
>
$
')
&
('l','o')
&
('lo','w')
\\
...
...
Chapter13/Figures/figure-exposure-bias.tex
0 → 100644
查看文件 @
e6083378
%------------------------------------------------------------
\begin{tikzpicture}
\begin{scope}
[]
\tikzstyle
{
rnnnode
}
= [draw,inner sep=2pt,minimum width=3em,minimum height=1.5em,rounded corners=1pt,fill=red!20]
\tikzstyle
{
snode
}
= [draw,inner sep=2pt,minimum width=3em,minimum height=1.5em,rounded corners=1pt,fill=blue!20]
\tikzstyle
{
ynode
}
= [inner sep=2pt,minimum width=3em,minimum height=1.5em,rounded corners=1pt]
\node
[anchor=west,rnnnode] (n1) at (0,0)
{$
\mathbi
{
h
}_{
1
}$}
;
\node
[anchor=west] (n2) at ([xshift=2em,yshift=0em]n1.east)
{$
\cdots
$}
;
\node
[anchor=west,rnnnode] (n3) at ([xshift=2em,yshift=0em]n2.east)
{$
\mathbi
{
h
}_{
j
-
1
}$}
;
\node
[anchor=west,rnnnode] (n4) at ([xshift=2em,yshift=0em]n3.east)
{$
\mathbi
{
h
}_{
j
}$}
;
\node
[anchor=south,snode,font=
\footnotesize
] (n5) at ([xshift=0em,yshift=1em]n3.north)
{
Softmax
}
;
\node
[anchor=south,ynode] (n6) at ([xshift=0em,yshift=1em]n5.north)
{$
\tilde
{{
y
}}_{
j
-
1
}$}
;
\node
[anchor=south,snode,font=
\footnotesize
] (n7) at ([xshift=0em,yshift=1em]n4.north)
{
Softmax
}
;
\node
[anchor=south,ynode] (n8) at ([xshift=0em,yshift=1em]n7.north)
{$
\tilde
{{
y
}}_{
j
}$}
;
\node
[anchor=north] (n11) at ([xshift=0em,yshift=-1em]n3.south)
{${{
y
}}_{
j
-
2
}$}
;
\node
[anchor=north] (n12) at ([xshift=0em,yshift=-1em]n4.south)
{${{
y
}}_{
j
-
1
}$}
;
\node
[anchor=north] (n9) at ([xshift=0em,yshift=-3em]n4.south)
{
\small
{
(a)训练阶段
}}
;
\node
[anchor=north] (x1) at ([xshift=0em,yshift=-1em]n1.south)
{$
\seq
{
x
}$}
;
\node
[anchor=south,inner sep=2pt] (st1) at (n6.north)
{
\scriptsize
{
\textbf
{
[step
$
j
-
1
$
]
}}}
;
\node
[anchor=south,inner sep=2pt] (st2) at (n8.north)
{
\scriptsize
{
\textbf
{
[step
$
j
$
]
}}}
;
\draw
[->,thick] ([xshift=0em,yshift=0em]x1.north)--([xshift=0em,yshift=0em]n1.south);
\draw
[->,thick] ([xshift=0em,yshift=0em]n1.east)--([xshift=0em,yshift=0em]n2.west);
\draw
[->,thick] ([xshift=0em,yshift=0em]n2.east)--([xshift=0em,yshift=0em]n3.west);
\draw
[->,thick] ([xshift=0em,yshift=0em]n3.east)--([xshift=0em,yshift=0em]n4.west);
\draw
[->,thick] ([xshift=0em,yshift=0em]n4.east)--([xshift=2em,yshift=0em]n4.east);
\draw
[->,thick] ([xshift=0em,yshift=0em]n3.north)--([xshift=0em,yshift=0em]n5.south);
\draw
[->,thick] ([xshift=0em,yshift=0em]n5.north)--([xshift=0em,yshift=0em]n6.south);
\draw
[->,thick] ([xshift=0em,yshift=0em]n4.north)--([xshift=0em,yshift=0em]n7.south);
\draw
[->,thick] ([xshift=0em,yshift=0em]n7.north)--([xshift=0em,yshift=0em]n8.south);
\draw
[->,thick,dotted] ([xshift=-0em,yshift=0em]n11.north)--([xshift=-0em,yshift=0em]n3.south);
\draw
[->,thick,dotted] ([xshift=0em,yshift=0em]n12.north)--([xshift=-0em,yshift=-0em]n4.south);
\node
[anchor=west] (n10) at ([xshift=4em,yshift=0em]n8.east)
{
真实数据
$
\seq
{
y
}$
服从的分布:
}
;
\node
[anchor=north west] (y1) at ([xshift=0em,yshift=-4em]n10.south west)
{${
y
}_{
1
}$}
;
\node
[anchor=west] (y2) at ([xshift=1em,yshift=0em]y1.east)
{${
y
}_{
2
}$}
;
\node
[anchor=west] (y3) at ([xshift=1em,yshift=0em]y2.east)
{${
y
}_{
3
}$}
;
\node
[anchor=west] (y4) at ([xshift=1em,yshift=0em]y3.east)
{$
\ldots
$}
;
\node
[anchor=west] (y5) at ([xshift=1em,yshift=0em]y4.east)
{${
y
}_{
n
}$}
;
%\draw [-,thick] ([xshift=0em,yshift=0.5em]y1.north) cos(9,0.8) sin (10,1.5) cos(11.5,0.7) sin(12.5,0.2) ;
\node
[anchor=south,minimum width=1.2em,minimum height=1.4em,fill=red!50,inner sep=0pt] (label1) at (y1.north)
{}
;
\node
[anchor=south,minimum width=1.2em,minimum height=2.8em,fill=red!50,inner sep=0pt] (label2) at (y2.north)
{}
;
\node
[anchor=south,minimum width=1.2em,minimum height=1.7em,fill=red!50,inner sep=0pt] (label3) at (y3.north)
{}
;
\node
[anchor=south,minimum width=1.2em,minimum height=1.4em,fill=red!50,inner sep=0pt] (label4) at (y5.north)
{}
;
\begin{pgfonlayer}
{
background
}
\node
[rectangle,inner sep=0em,rounded corners=5pt,very thick,dotted,draw=red] [fit = (n11) (n12)] (b1)
{}
;
\node
[rectangle,inner sep=0.5em,rounded corners=5pt,very thick,dotted,draw=red] [fit = (n10) (y1) (y5)] (b2)
{}
;
\draw
[->,dotted,very thick,red] ([yshift=-0em]b1.east) .. controls +(east:2) and +(west:1) .. (b2.west);
\end{pgfonlayer}
\end{scope}
\begin{scope}
[yshift=-2in]
\tikzstyle
{
rnnnode
}
= [draw,inner sep=2pt,minimum width=3em,minimum height=1.5em,rounded corners=1pt,fill=red!20]
\tikzstyle
{
snode
}
= [draw,inner sep=2pt,minimum width=3em,minimum height=1.5em,rounded corners=1pt,fill=blue!20]
\tikzstyle
{
ynode
}
= [inner sep=2pt,minimum width=3em,minimum height=1.5em,rounded corners=1pt]
\node
[anchor=west,rnnnode] (n1) at (0,0)
{$
\mathbi
{
h
}_{
1
}$}
;
\node
[anchor=west] (n2) at ([xshift=2em,yshift=0em]n1.east)
{$
\cdots
$}
;
\node
[anchor=west,rnnnode] (n3) at ([xshift=2em,yshift=0em]n2.east)
{$
\mathbi
{
h
}_{
j
-
1
}$}
;
\node
[anchor=west,rnnnode] (n4) at ([xshift=2em,yshift=0em]n3.east)
{$
\mathbi
{
h
}_{
j
}$}
;
\node
[anchor=south,snode,font=
\footnotesize
] (n5) at ([xshift=0em,yshift=1em]n3.north)
{
Softmax
}
;
\node
[anchor=south,ynode] (n6) at ([xshift=0em,yshift=1em]n5.north)
{$
\tilde
{{
y
}}_{
j
-
1
}$}
;
\node
[anchor=south,snode,font=
\footnotesize
] (n7) at ([xshift=0em,yshift=1em]n4.north)
{
Softmax
}
;
\node
[anchor=south,ynode] (n8) at ([xshift=0em,yshift=1em]n7.north)
{$
\tilde
{{
y
}}_{
j
}$}
;
\node
[anchor=north] (n9) at ([xshift=0em,yshift=-2em]n4.south)
{
\small
{
(b)解码阶段
}}
;
\node
[anchor=north] (x1) at ([xshift=0em,yshift=-1em]n1.south)
{$
\seq
{
x
}$}
;
\node
[anchor=south,inner sep=2pt] (st1) at (n6.north)
{
\scriptsize
{
\textbf
{
[step
$
j
-
1
$
]
}}}
;
\node
[anchor=south,inner sep=2pt] (st2) at (n8.north)
{
\scriptsize
{
\textbf
{
[step
$
j
$
]
}}}
;
\draw
[->,thick] ([xshift=0em,yshift=0em]x1.north)--([xshift=0em,yshift=0em]n1.south);
\draw
[->,thick] ([xshift=0em,yshift=0em]n1.east)--([xshift=0em,yshift=0em]n2.west);
\draw
[->,thick] ([xshift=0em,yshift=0em]n2.east)--([xshift=0em,yshift=0em]n3.west);
\draw
[->,thick] ([xshift=0em,yshift=0em]n3.east)--([xshift=0em,yshift=0em]n4.west);
\draw
[->,thick] ([xshift=0em,yshift=0em]n4.east)--([xshift=2em,yshift=0em]n4.east);
\draw
[->,thick] ([xshift=0em,yshift=0em]n3.north)--([xshift=0em,yshift=0em]n5.south);
\draw
[->,thick] ([xshift=0em,yshift=0em]n5.north)--([xshift=0em,yshift=0em]n6.south);
\draw
[->,thick] ([xshift=0em,yshift=0em]n4.north)--([xshift=0em,yshift=0em]n7.south);
\draw
[->,thick] ([xshift=0em,yshift=0em]n7.north)--([xshift=0em,yshift=0em]n8.south);
\draw
[->,thick,dotted] ([xshift=-2em,yshift=-1.3em]n3.south) .. controls +(east:1.5em) and +(south:0.2em) .. ([xshift=-0em,yshift=0em]n3.south);
\draw
[->,thick,dotted] ([xshift=0em,yshift=0em]n6.east) .. controls ([xshift=2em,yshift=1em]n6.east) and ([xshift=-2em,yshift=-5em]n4.south west) .. ([xshift=-0em,yshift=-0em]n4.south);
\node
[anchor=west] (n10) at ([xshift=4em,yshift=0em]n8.east)
{
模型输出
$
\tilde
{{
y
}}$
服从的分布:
}
;
\node
[anchor=north west] (y1) at ([xshift=0em,yshift=-4em]n10.south west)
{$
\tilde
{{
y
}}_{
1
}$}
;
\node
[anchor=west] (y2) at ([xshift=1em,yshift=0em]y1.east)
{$
\tilde
{{
y
}}_{
2
}$}
;
\node
[anchor=west] (y3) at ([xshift=1em,yshift=0em]y2.east)
{$
\tilde
{{
y
}}_{
3
}$}
;
\node
[anchor=west] (y4) at ([xshift=1em,yshift=0em]y3.east)
{$
\ldots
$}
;
\node
[anchor=west] (y5) at ([xshift=1em,yshift=0em]y4.east)
{$
\tilde
{{
y
}}_{
n
}$}
;
%\draw [-,thick] ([xshift=0em,yshift=0.5em]y1.north) cos(9,0.8) sin (10,1.5) cos(11.5,0.7) sin(12.5,0.2) ;
\node
[anchor=south,minimum width=1.2em,minimum height=0.7em,fill=ublue!80,inner sep=0pt] (label1) at (y1.north)
{}
;
\node
[anchor=south,minimum width=1.2em,minimum height=1.5em,fill=ublue!80,inner sep=0pt] (label2) at (y2.north)
{}
;
\node
[anchor=south,minimum width=1.2em,minimum height=2.4em,fill=ublue!80,inner sep=0pt] (label3) at (y3.north)
{}
;
\node
[anchor=south,minimum width=1.2em,minimum height=0.2em,fill=ublue!80,inner sep=0pt] (label4) at (y5.north)
{}
;
\begin{pgfonlayer}
{
background
}
\node
[rectangle,inner sep=0em,rounded corners=5pt,very thick,dotted,draw=ublue] [fit = (n6) (n8)] (b1)
{}
;
\node
[rectangle,inner sep=0.5em,rounded corners=5pt,very thick,dotted,draw=ublue] [fit = (n10) (y1) (y5)] (b2)
{}
;
\draw
[->,dotted,very thick,ublue] ([xshift=-0em,yshift=-0em]b1.east) .. controls +(east:1) and +(west:1) .. (b2.west);
\end{pgfonlayer}
\end{scope}
\end{tikzpicture}
Chapter13/Figures/figure-framework-of-Adversarial-Neural-machine-translation.tex
0 → 100644
查看文件 @
e6083378
%------------------------------------------------------------
\begin{tikzpicture}
\tikzstyle
{
rnnnode
}
= [draw,inner sep=2pt,minimum width=4em,minimum height=2em,rounded corners=1pt,fill=yellow!20]
\tikzstyle
{
snode
}
= [draw,inner sep=2pt,minimum width=4em,minimum height=2em,rounded corners=1pt,fill=red!20]
\tikzstyle
{
wode
}
= [inner sep=0pt,minimum width=4em,minimum height=2em,rounded corners=0pt]
\node
[anchor=west,wode] (n1) at (0,0)
{${
y
}_
1
,
{
y
}_
2
,
\ldots
,
{
y
}_
n
$}
;
\node
[anchor=north west,wode] (n2) at ([xshift=1em,yshift=0.5em]n1.south east)
{${
x
}_
1
,
{
x
}_
2
,
\ldots
,
{
x
}_
m
$}
;
\node
[anchor=south west,rnnnode] (n3) at ([xshift=8em,yshift=0.5em]n2.north east)
{
生成模型G
}
;
\node
[anchor=south east,wode] (n4) at ([xshift=-2em,yshift=0em]n3.north west)
{$
\tilde
{{
y
}}_{
1
}
,
\tilde
{{
y
}}_{
2
}
,...,
\tilde
{{
y
}}_{
J
}$}
;
\node
[anchor=south,snode] (n5) at ([xshift=0em,yshift=6em]n2.north)
{
判别网络D
}
;
\node
[anchor=west,align=left,font=
\small
] (n6) at ([xshift=15em,yshift=-3em]n5.east)
{
根据
$
(
\seq
{
x
}
,
\seq
{
\tilde
{
y
}}
)
$
生
\\
成奖励信号
}
;
\draw
[->,thick] ([xshift=0em,yshift=0em]n1.north)--([xshift=0em,yshift=0em]n5.south);
\draw
[->,thick] ([xshift=0em,yshift=0em]n2.north)--([xshift=0em,yshift=0em]n5.south);
\draw
[->,thick] ([xshift=0em,yshift=0em]n4.west)--([xshift=0em,yshift=0em]n5.south);
\draw
[->,thick] ([xshift=0em,yshift=0em]n3.north)--([xshift=0em,yshift=1em]n3.north)--([xshift=0em,yshift=0em]n4.east);
\draw
[->,thick] ([xshift=0em,yshift=0em]n5.east) -- ([xshift=14.5em,yshift=0em]n5.east) -- ([xshift=1em,yshift=0em]n3.east) -- ([xshift=0em,yshift=0em]n3.east);
\draw
[->,thick] ([xshift=0em,yshift=0em]n2.east) -- ([xshift=0em,yshift=-1.5em]n3.south) -- ([xshift=0em,yshift=0em]n3.south);
\begin{pgfonlayer}
{
background
}
%\node [rectangle,inner sep=0.5em,rounded corners=5pt,very thick,dotted,draw=yellow] [fit = (n3) (n4)] (b1) {};
%\node [rectangle,inner sep=0.5em,rounded corners=5pt,very thick,dotted,draw=red] [fit = (n5)] (b2) {};
\end{pgfonlayer}
%\draw [->,thick] ([xshift=0em,yshift=0em]n3.south) .. controls +(south:1em) and +(north:1em) .. ([xshift=0em,yshift=0em]n5.north);
\end{tikzpicture}
Chapter13/Figures/figure-of-scheduling-sampling-method.tex
0 → 100644
查看文件 @
e6083378
%------------------------------------------------------------
\begin{tikzpicture}
\tikzstyle
{
rnnnode
}
= [draw,inner sep=2pt,minimum width=4em,minimum height=2em,rounded corners=1pt,fill=red!20]
\tikzstyle
{
snode
}
= [draw,inner sep=2pt,minimum width=4em,minimum height=2em,rounded corners=1pt,fill=blue!20]
\tikzstyle
{
ynode
}
= [inner sep=2pt,minimum width=4em,minimum height=2em,rounded corners=1pt]
\node
[anchor=west,rnnnode] (n1) at (0,0)
{$
\mathbi
{
h
}_{
1
}$}
;
\node
[anchor=west] (n2) at ([xshift=3em,yshift=0em]n1.east)
{$
\cdots
$}
;
\node
[anchor=west,rnnnode] (n3) at ([xshift=3em,yshift=0em]n2.east)
{$
\mathbi
{
h
}_{
j
-
1
}$}
;
\node
[anchor=west,rnnnode] (n4) at ([xshift=3em,yshift=0em]n3.east)
{$
\mathbi
{
h
}_{
j
}$}
;
\node
[anchor=south,snode] (n5) at ([xshift=0em,yshift=1em]n3.north)
{
Softmax
}
;
\node
[anchor=south,ynode] (n6) at ([xshift=0em,yshift=1em]n5.north)
{$
\tilde
{{
y
}}_{
j
-
1
}$}
;
\node
[anchor=south,snode] (n7) at ([xshift=0em,yshift=1em]n4.north)
{
Softmax
}
;
\node
[anchor=south,ynode] (n8) at ([xshift=0em,yshift=1em]n7.north)
{$
\tilde
{{
y
}}_{
j
}$}
;
\node
[anchor=north] (x1) at ([xshift=0em,yshift=-1em]n1.south)
{$
\seq
{
x
}$}
;
\node
[anchor=north,font=
\small
,align=left] (x2) at ([xshift=-4em,yshift=-1.7em]n3.south)
{
采样出
\\
的
$
\tilde
{{
y
}}_{
j
-
2
}$}
;
\node
[anchor=north,font=
\small
,align=left] (x3) at ([xshift=2em,yshift=-2.5em]n3.south)
{
真实答
\\
案
${
y
}_{
j
-
2
}$}
;
\node
[anchor=north,font=
\small
,align=left] (x4) at ([xshift=2em,yshift=-2.5em]n4.south)
{
真实答
\\
案
${
y
}_{
j
-
1
}$}
;
\node
[anchor=south,inner sep=2pt] (st1) at (n6.north)
{
\scriptsize
{
\textbf
{
[step
$
j
-
1
$
]
}}}
;
\node
[anchor=south,inner sep=2pt] (st2) at (n8.north)
{
\scriptsize
{
\textbf
{
[step
$
j
$
]
}}}
;
\node
[anchor=north,font=
\scriptsize
] (e1) at ([xshift=-3em,yshift=-0em]n3.south)
{$
\funp
{
P
}
=
{
(
1
-
\epsilon
_
i
)
}^
2
$}
;
\node
[anchor=north,font=
\scriptsize
] (e2) at ([xshift=2em,yshift=-0.1em]n3.south)
{$
\funp
{
P
}
=
\epsilon
_
i
$}
;
\node
[anchor=north,font=
\scriptsize
] (e3) at ([xshift=-2em,yshift=-1em]n4.south)
{$
\funp
{
P
}
=
{
(
1
-
\epsilon
_
i
)
}^
2
$}
;
\node
[anchor=north,font=
\scriptsize
] (e4) at ([xshift=2em,yshift=-0.1em]n4.south)
{$
\funp
{
P
}
=
\epsilon
_
i
$}
;
\node
[anchor=south east,font=
\small
] (l1) at ([xshift=-1em,yshift=0.5em]n5.north west)
{
Loss
}
;
\node
[anchor=south west,font=
\small
] (l2) at ([xshift=1em,yshift=0.5em]n7.north east)
{
Loss
}
;
\draw
[->,thick] ([xshift=0em,yshift=0em]x1.north)--([xshift=0em,yshift=0em]n1.south);
\draw
[->,thick] ([xshift=0em,yshift=0em]n1.east)--([xshift=0em,yshift=0em]n2.west);
\draw
[->,thick] ([xshift=0em,yshift=0em]n2.east)--([xshift=0em,yshift=0em]n3.west);
\draw
[->,thick] ([xshift=0em,yshift=0em]n3.east)--([xshift=0em,yshift=0em]n4.west);
\draw
[->,thick] ([xshift=0em,yshift=0em]n4.east)--([xshift=3em,yshift=0em]n4.east);
\draw
[->,thick] ([xshift=0em,yshift=0em]n3.north)--([xshift=0em,yshift=0em]n5.south);
\draw
[->,thick] ([xshift=0em,yshift=0em]n5.north)--([xshift=0em,yshift=0em]n6.south);
\draw
[->,thick] ([xshift=0em,yshift=0em]n4.north)--([xshift=0em,yshift=0em]n7.south);
\draw
[->,thick] ([xshift=0em,yshift=0em]n7.north)--([xshift=0em,yshift=0em]n8.south);
\draw
[->,thick] ([xshift=0em,yshift=0em]l1.south) .. controls +(south:1em) and +(west:0.1em) .. ([xshift=0em,yshift=0em]n5.west);
\draw
[->,thick] ([xshift=0em,yshift=0em]l2.south) .. controls +(south:1em) and +(east:0.1em) .. ([xshift=0em,yshift=0em]n7.east);
\draw
[->,thick,dotted] ([xshift=0em,yshift=-0.5em]x2.north east) .. controls +(east:1.5em) and +(south:0.2em) .. ([xshift=-0.5em,yshift=0em]n3.south);
\draw
[->,thick] ([xshift=0em,yshift=0em]x3.north) .. controls +(north:1em) and +(south:2em) .. ([xshift=0em,yshift=0em]n3.south);
\draw
[->,thick,dotted] ([xshift=0em,yshift=0em]n6.east) .. controls ([xshift=2em,yshift=1em]n6.east) and ([xshift=-2em,yshift=-5em]n4.south west) .. ([xshift=-0.5em,yshift=-0em]n4.south);
\draw
[->,thick] ([xshift=0em,yshift=0em]x4.north) .. controls +(north:1em) and +(south:2em) .. ([xshift=0em,yshift=0em]n4.south);
\end{tikzpicture}
Chapter13/Figures/figure-reinforcement-learning-method-based-on-actor-critic.tex
查看文件 @
e6083378
...
@@ -7,22 +7,28 @@
...
@@ -7,22 +7,28 @@
\node
[anchor=south,inner sep=0mm,font=\small]
(a1) at ([xshift=0em,yshift=1em]n1.north)
{
演员
$
p
_{
\theta
}$}
;
\node
[anchor=south,inner sep=0mm,font=\small]
(a1) at ([xshift=0em,yshift=1em]n1.north)
{
演员
$
p
_{
\theta
}$}
;
\node
[anchor=north,inner sep=0mm]
(a2) at ([xshift=0em,yshift=-1em]n1.south)
{$
\mathbi
{
x
}_
1
,
\mathbi
{
x
}_
2
,
\ldots
,
\mathbi
{
x
}_
m
$}
;
\node
[anchor=north,inner sep=0mm]
(a2) at ([xshift=0em,yshift=-1em]n1.south)
{$
{
x
}_
1
,
{
x
}_
2
,
\ldots
,
{
x
}_
m
$}
;
\node
[anchor=south,inner sep=0mm,font=\small]
(c1) at ([xshift=0em,yshift=1em]n2.north)
{
评论家
$
Q
$}
;
\node
[anchor=south,inner sep=0mm,font=\small]
(c1) at ([xshift=0em,yshift=1em]n2.north)
{
评论家
$
Q
$}
;
\node
[anchor=north,inner sep=0mm]
(c2) at ([xshift=0em,yshift=-1em]n2.south)
{$
\mathbi
{
y
}_
1
,
\mathbi
{
y
}_
2
,
\ldots
,
\mathbi
{
y
}_
J
$}
;
\node
[anchor=north,inner sep=0mm]
(c2) at ([xshift=0em,yshift=-1em]n2.south)
{$
{
y
}_
1
,
{
y
}_
2
,
\ldots
,
{
y
}_
J
$}
;
\node
[anchor=west,inner sep=0mm]
(n3) at ([xshift=2.1em,yshift=2em]n1.east)
{$
Q
_
1
,Q
_
2
,
\ldots
,Q
_
J
$}
;
%
\node[anchor=west,inner sep=0mm] (n3) at ([xshift=2.1em,yshift=2em]n1.east) {$Q_1,Q_2,\ldots,Q_J$};
\node
[anchor=west,inner sep=0mm]
(n4) at ([xshift=2.9em,yshift=-0.4em]n1.east)
{$
\hat
{
\mathbi
{
y
}}_
1
,
\hat
{
\mathbi
{
y
}}_
2
,
\ldots
,
\hat
{
\mathbi
{
y
}}_
J
$}
;
%
\node[anchor=west,inner sep=0mm] (n4) at ([xshift=2.9em,yshift=-0.4em]n1.east) {$\hat{\mathbi{y}}_1,\hat{\mathbi{y}}_2,\ldots,\hat{\mathbi{y}}_J$};
\node
[anchor=west,inner sep=0mm,font=\small]
(n5) at ([xshift=3em,yshift=-3em]n1.east)
{
演员状态
}
;
%
\node[anchor=west,inner sep=0mm,font=\small] (n5) at ([xshift=3em,yshift=-3em]n1.east) {演员状态};
\draw
[-,thick] ([xshift=0em,yshift=0em]n1.west) -- ([xshift=0em,yshift=0em]n1.east);
\draw
[-,thick] ([xshift=0em,yshift=0em]n1.west) -- ([xshift=0em,yshift=0em]n1.east);
\draw
[-,thick] ([xshift=0em,yshift=0em]n2.west) -- ([xshift=0em,yshift=0em]n2.east);
\draw
[-,thick] ([xshift=0em,yshift=0em]n2.west) -- ([xshift=0em,yshift=0em]n2.east);
\draw
[->,thick] ([xshift=0em,yshift=1em]n2.west) -- ([xshift=0em,yshift=1em]n1.east);
%
\draw [->,thick] ([xshift=0em,yshift=1em]n2.west) -- ([xshift=0em,yshift=1em]n1.east);
\draw
[->,thick] ([xshift=0em,yshift=0.5em]n1.east) -- ([xshift=0em,yshift=0.5em]n2.west);
%
\draw [->,thick] ([xshift=0em,yshift=0.5em]n1.east) -- ([xshift=0em,yshift=0.5em]n2.west);
\draw
[->,dotted,very thick] ([xshift=0em,yshift=0em]n1.east) .. controls ([xshift=3em,yshift=-1em]n1.-90) and ([xshift=-3em,yshift=-1em]n2.-90) .. (n2.west);
%\draw [->,dotted,very thick] ([xshift=0em,yshift=0em]n1.east) .. controls ([xshift=3em,yshift=-1em]n1.-90) and ([xshift=-3em,yshift=-1em]n2.-90) .. (n2.west);
\node
[anchor=west,inner sep=0mm]
(n3) at ([xshift=2.1em,yshift=1em]n1.east)
{$
Q
_
1
,Q
_
2
,
\ldots
,Q
_
J
$}
;
\node
[anchor=west,inner sep=0mm]
(n4) at ([xshift=2.9em,yshift=-1em]n1.east)
{$
\tilde
{{
y
}}_
1
,
\tilde
{{
y
}}_
2
,
\ldots
,
\tilde
{{
y
}}_
J
$}
;
\draw
[->,thick] ([xshift=0em,yshift=0.2em]n2.west) -- ([xshift=0em,yshift=0.2em]n1.east);
\draw
[->,thick] ([xshift=0em,yshift=-0.2em]n1.east) -- ([xshift=0em,yshift=-0.2em]n2.west);
\end{tikzpicture}
\end{tikzpicture}
\ No newline at end of file
Chapter13/Figures/figure-word-root.tex
查看文件 @
e6083378
...
@@ -11,8 +11,8 @@
...
@@ -11,8 +11,8 @@
\node
[anchor = north]
(new
_
root) at ([yshift = -1.5em]newer.south)
{
new
}
;
\node
[anchor = north]
(new
_
root) at ([yshift = -1.5em]newer.south)
{
new
}
;
\draw
[->] ([yshift=0.2em]do
_
root.north) .. controls +(north:0.4) and +(south:0.6) ..(do.south);
\draw
[->] ([yshift=0.2em]do
_
root.north) .. controls +(north:0.4) and +(south:0.6) ..(do.south);
\draw
[->] (do
_
root.north) -- (does.south);
\draw
[->] (do
_
root.north) -- (does.south);
\draw
[->] ([yshift=0.2em]do
_
root.north) .. controls +(north:0.4) and +(south:0.6) ..(
[yshift=0.1em]
doing.south);
\draw
[->] ([yshift=0.2em]do
_
root.north) .. controls +(north:0.4) and +(south:0.6) ..(doing.south);
\draw
[->] ([yshift=0.2em]new
_
root.north) .. controls +(north:0.4) and +(south:0.6) ..(new.south);
\draw
[->] ([yshift=0.2em]new
_
root.north) .. controls +(north:0.4) and +(south:0.6) ..(new.south);
\draw
[->] (new
_
root.north) -- (newer.south);
\draw
[->] (new
_
root.north) -- (newer.south);
\draw
[->] ([yshift=0.2em]new
_
root.north) .. controls +(north:0.4) and +(south:0.6) ..(
[yshift=0.08em]
newest.south);
\draw
[->] ([yshift=0.2em]new
_
root.north) .. controls +(north:0.4) and +(south:0.6) ..(newest.south);
\end{tikzpicture}
\end{tikzpicture}
\ No newline at end of file
Chapter13/chapter13.tex
查看文件 @
e6083378
差异被折叠。
点击展开。
编写
预览
Markdown
格式
0%
重试
或
添加新文件
添加附件
取消
您添加了
0
人
到此讨论。请谨慎行事。
请先完成此评论的编辑!
取消
请
注册
或者
登录
后发表评论