Skip to content
项目
群组
代码片段
帮助
当前项目
正在载入...
登录 / 注册
切换导航面板
M
mtbookv2
概览
Overview
Details
Activity
Cycle Analytics
版本库
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
问题
0
Issues
0
列表
Board
标记
里程碑
合并请求
0
Merge Requests
0
CI / CD
CI / CD
流水线
作业
日程表
图表
维基
Wiki
代码片段
Snippets
成员
Collapse sidebar
Close sidebar
活动
图像
聊天
创建新问题
作业
提交
Issue Boards
Open sidebar
NiuTrans
mtbookv2
Commits
5c972926
Commit
5c972926
authored
4 years ago
by
单韦乔
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
15章
parent
48609dee
全部展开
隐藏空白字符变更
内嵌
并排
正在显示
8 个修改的文件
包含
50 行增加
和
26 行删除
+50
-26
Chapter13/Figures/figure-unk-of-bpe.tex
+1
-1
Chapter15/Figures/DLCL-picture.png
+0
-0
Chapter15/Figures/figure-dynamic-linear-aggregation-network-structure.tex
+1
-1
Chapter15/Figures/figure-layer-fusion-method-2d.tex
+8
-8
Chapter15/Figures/figure-layer-fusion-method.tex
+8
-8
Chapter15/Figures/figure-post-norm-vs-pre-norm.tex
+8
-8
Chapter15/Figures/figure-weight-visualization-of-convergence-DLCL-network.tex
+24
-0
Chapter15/chapter15.tex
+0
-0
没有找到文件。
Chapter13/Figures/figure-unk-of-bpe.tex
查看文件 @
5c972926
...
...
@@ -3,7 +3,7 @@
\node
[rounded corners=3pt,minimum width=1.0em,minimum height=2.0em,font=\scriptsize,fill=red!10,drop shadow,thick]
(top) at (0,0)
{
\begin{tabular}
{
lllllll
}
\multicolumn
{
7
}{
c
}{
符号合并表
}
\\
r
\
$
<
$
e
$
>
$
,
&
e
\
s,
&
l
\
o,
&
es
\
t,
&
lo
\
w,
&
est
\
$
<
$
e
$
>
$
,
&
e
\
r
$
<
$
e
$
>
$
,
(r,
$
<
$
e
$
>
$
),
&
(e,s),
&
(l,o),
&
(es,t),
&
(lo,w),
&
(est,
$
<
$
e
$
>
$
),
&
(e,r
$
<
$
e
$
>
$
)
,
\end{tabular}
}
;
\node
[font=\footnotesize,anchor=north]
(l1) at ([xshift=0em,yshift=-1em]top.south)
{
(a) 符号合并表
}
;
...
...
This diff is collapsed.
Click to expand it.
Chapter15/Figures/DLCL-picture.png
0 → 100644
查看文件 @
5c972926
41.8 KB
This diff is collapsed.
Click to expand it.
Chapter15/Figures/figure-dynamic-linear-aggregation-network-structure.tex
查看文件 @
5c972926
...
...
@@ -18,7 +18,7 @@
\node
[anchor=north,rectangle,draw, inner sep=0mm,minimum height=1.2em,minimum width=15em,fill=teal!17,rounded corners=5pt,thick] (n8) at ([xshift=0em,yshift=-3em]n4.south)
{
层正则化
}
;
\node
[anchor=north,rectangle,draw, inner sep=0mm,minimum height=1.2em,minimum width=15em,fill=purple!17,rounded corners=5pt,thick] (n9) at ([xshift=0em,yshift=-1em]n8.south)
{$
\mathbi
{
X
}
\ \quad
\mathbi
{
h
}
_
1
\ \quad
\mathbi
{
h
}_
2
\quad
\ldots
\quad\ \mathbi
{
h
}_
l
$}
;
\node
[anchor=north,rectangle,draw, inner sep=0mm,minimum height=1.2em,minimum width=15em,fill=purple!17,rounded corners=5pt,thick] (n9) at ([xshift=0em,yshift=-1em]n8.south)
{$
\mathbi
{
X
}
\ \quad
\mathbi
{
h
}
^
1
\ \quad
\mathbi
{
h
}^
2
\quad
\ldots
\quad\ \mathbi
{
h
}^
l
$}
;
\node
[anchor=north,rectangle,draw, inner sep=0mm,minimum height=1.2em,minimum width=15em,fill=teal!17,rounded corners=5pt,thick] (n10) at ([xshift=0em,yshift=-2em]n9.south)
{
权重累加
}
;
...
...
This diff is collapsed.
Click to expand it.
Chapter15/Figures/figure-layer-fusion-method-2d.tex
查看文件 @
5c972926
...
...
@@ -7,9 +7,9 @@
\tikzstyle
{
vlnode
}
=[rectangle,inner sep=0mm,minimum height=1em,minimum width=5em,rounded corners=2pt,draw]
\node
[anchor=west,lnode] (n1) at (0, 0)
{$
\mathbi
{
h
}
_
3
$}
;
\node
[anchor=north west,lnode] (n2) at ([xshift=0em,yshift=-0.5em]n1.south west)
{$
\mathbi
{
h
}
_
2
$}
;
\node
[anchor=north west,lnode] (n3) at ([xshift=0em,yshift=-0.5em]n2.south west)
{$
\mathbi
{
h
}
_
1
$}
;
\node
[anchor=west,lnode] (n1) at (0, 0)
{$
\mathbi
{
h
}
^
3
$}
;
\node
[anchor=north west,lnode] (n2) at ([xshift=0em,yshift=-0.5em]n1.south west)
{$
\mathbi
{
h
}
^
2
$}
;
\node
[anchor=north west,lnode] (n3) at ([xshift=0em,yshift=-0.5em]n2.south west)
{$
\mathbi
{
h
}
^
1
$}
;
\node
[anchor=south] (d1) at ([xshift=0em,yshift=0.2em]n1.north)
{
1D
}
;
...
...
@@ -96,16 +96,16 @@
\draw
[->,thick] ([xshift=0em,yshift=0em]ffn.north) -- ([xshift=0em,yshift=0em]fn.west);
\draw
[decorate,decoration=
{
brace,mirror
}
] ([xshift=0em]n3.south west) to node [midway,font=
\small
,align=center,xshift=0em,yshift=-0.8em]
{$
d
$}
([xshift=0em]n3.south east);
\draw
[decorate,decoration=
{
brace,mirror
}
] ([xshift=0em]n3.south west) to node [midway,font=
\small
,align=center,xshift=0em,yshift=-0.8em]
{$
d
_{
\textrm
{
model
}}
$}
([xshift=0em]n3.south east);
\draw
[decorate,decoration=
{
brace,mirror
}
] ([xshift=0em]n6.south west) to node [midway,font=
\small
,align=center,xshift=0em,yshift=-0.8em]
{$
d
_{
\rm
a
}$}
([xshift=0em]n6.south east);
\draw
[decorate,decoration=
{
brace,mirror
}
] ([xshift=0em]n7.north west) to node [midway,font=
\small
,align=center,xshift=-
0.7em,yshift=-0em]
{$
d
$}
([xshift=0em]n7.south west);
\draw
[decorate,decoration=
{
brace
}
] ([xshift=0em]n7.north west) to node [midway,font=
\small
,align=center,xshift=0em,yshift=0.7em]
{$
d
$}
([xshift=0em]n7.north east);
\draw
[decorate,decoration=
{
brace,mirror
}
] ([xshift=0em]n7.north west) to node [midway,font=
\small
,align=center,xshift=-
1.4em,yshift=-0em]
{$
d
_{
\textrm
{
model
}}
$}
([xshift=0em]n7.south west);
\draw
[decorate,decoration=
{
brace
}
] ([xshift=0em]n7.north west) to node [midway,font=
\small
,align=center,xshift=0em,yshift=0.7em]
{$
d
_{
\textrm
{
model
}}
$}
([xshift=0em]n7.north east);
\draw
[decorate,decoration=
{
brace,mirror
}
] ([xshift=0em]n8.north west) to node [midway,font=
\small
,align=center,xshift=-0.8em,yshift=-0em]
{$
d
_{
\rm
a
}$}
([xshift=0em]n8.south west);
\draw
[decorate,decoration=
{
brace
}
] ([xshift=0em]n8.north west) to node [midway,font=
\small
,align=center,xshift=0em,yshift=0.8em]
{$
n
_{
\rm
hop
}$}
([xshift=0em]n8.north east);
\draw
[decorate,decoration=
{
brace,mirror
}
] ([xshift=0em]nc31.south west) to node [midway,font=
\small
,align=center,xshift=0em,yshift=-0.8em]
{$
n
_{
\rm
hop
}$}
([xshift=0em]nc35.south east);
\draw
[decorate,decoration=
{
brace,mirror
}
] ([xshift=0em]ln5.south west) to node [midway,font=
\small
,align=center,xshift=0em,yshift=-0.8em]
{$
d
$}
([xshift=0em]ln5.south east);
\draw
[decorate,decoration=
{
brace,mirror
}
] ([xshift=0em]ln5.south west) to node [midway,font=
\small
,align=center,xshift=0em,yshift=-0.8em]
{$
d
_{
\textrm
{
model
}}
$}
([xshift=0em]ln5.south east);
\draw
[decorate] ([xshift=0em]ln5.south east) to node [midway,font=
\footnotesize
,align=center,xshift=1em,yshift=-0.5em]
{$
n
_{
\rm
hop
}$}
([xshift=0em]ln1.south east);
\draw
[decorate,decoration=
{
brace,mirror
}
] ([xshift=0em]fn.south east) to node [midway,font=
\small
,align=center,xshift=
0.7em,yshift=-0em]
{$
d
$}
([xshift=0em]fn.north east);
\draw
[decorate,decoration=
{
brace,mirror
}
] ([xshift=0em]fn.south east) to node [midway,font=
\small
,align=center,xshift=
1.4em,yshift=-0em]
{$
d
_{
\textrm
{
model
}}
$}
([xshift=0em]fn.north east);
...
...
This diff is collapsed.
Click to expand it.
Chapter15/Figures/figure-layer-fusion-method.tex
查看文件 @
5c972926
...
...
@@ -9,15 +9,15 @@
\node
[anchor=north,rectangle,minimum height=1.5em,minimum width=2.5em,rounded corners=5pt] (n2) at ([xshift=0em,yshift=-0.2em]n1.south)
{$
\mathbi
{
X
}$}
;
\node
[anchor=west,encnode,draw=red!60!black!80,fill=red!20] (n3) at ([xshift=1.5em,yshift=0em]n2.east)
{$
\mathbi
{
h
}
_
0
$}
;
\node
[anchor=west,encnode,draw=red!60!black!80,fill=red!20] (n3) at ([xshift=1.5em,yshift=0em]n2.east)
{$
\mathbi
{
h
}
^
0
$}
;
\node
[anchor=west,encnode,draw=red!60!black!80,fill=red!20] (n4) at ([xshift=1.5em,yshift=0em]n3.east)
{$
\mathbi
{
h
}
_
1
$}
;
\node
[anchor=west,encnode,draw=red!60!black!80,fill=red!20] (n4) at ([xshift=1.5em,yshift=0em]n3.east)
{$
\mathbi
{
h
}
^
1
$}
;
\node
[anchor=west,encnode,draw=red!60!black!80,fill=red!20] (n5) at ([xshift=1.5em,yshift=0em]n4.east)
{$
\mathbi
{
h
}
_
2
$}
;
\node
[anchor=west,encnode,draw=red!60!black!80,fill=red!20] (n5) at ([xshift=1.5em,yshift=0em]n4.east)
{$
\mathbi
{
h
}
^
2
$}
;
\node
[anchor=west,rectangle,minimum height=1.5em,minimum width=2.5em,rounded corners=5pt] (n6) at ([xshift=1em,yshift=0em]n5.east)
{$
\ldots
$}
;
\node
[anchor=west,encnode,draw=red!60!black!80,fill=red!20] (n7) at ([xshift=1em,yshift=0em]n6.east)
{$
\mathbi
{
h
}
_
{
L
-
1
}$}
;
\node
[anchor=west,encnode,draw=red!60!black!80,fill=red!20] (n7) at ([xshift=1em,yshift=0em]n6.east)
{$
\mathbi
{
h
}
^
{
L
-
1
}$}
;
\node
[anchor=north,rectangle,draw=teal!80, inner sep=0mm,minimum height=2em,minimum width=8em,fill=teal!17,rounded corners=5pt,thick] (n8) at ([xshift=3em,yshift=-1.5em]n4.south)
{
权重聚合
$
\mathbi
{
g
}$}
;
...
...
@@ -27,15 +27,15 @@
\node
[anchor=north,rectangle,minimum height=1.5em,minimum width=2.5em,rounded corners=5pt] (n10) at ([xshift=0em,yshift=-0.2em]n9.south)
{$
\mathbi
{
y
}_{
<j
}$}
;
\node
[anchor=west,decnode,draw=ublue,fill=blue!10] (n11) at ([xshift=1.5em,yshift=0em]n10.east)
{$
\mathbi
{
s
}
_{
0
,
j
}$}
;
\node
[anchor=west,decnode,draw=ublue,fill=blue!10] (n11) at ([xshift=1.5em,yshift=0em]n10.east)
{$
\mathbi
{
s
}
^
0
_{
j
}$}
;
\node
[anchor=west,decnode,draw=ublue,fill=blue!10] (n12) at ([xshift=1.5em,yshift=0em]n11.east)
{$
\mathbi
{
s
}
_{
1
,
j
}$}
;
\node
[anchor=west,decnode,draw=ublue,fill=blue!10] (n12) at ([xshift=1.5em,yshift=0em]n11.east)
{$
\mathbi
{
s
}
^
1
_{
j
}$}
;
\node
[anchor=west,decnode,draw=ublue,fill=blue!10] (n13) at ([xshift=1.5em,yshift=0em]n12.east)
{$
\mathbi
{
s
}
_{
2
,
j
}$}
;
\node
[anchor=west,decnode,draw=ublue,fill=blue!10] (n13) at ([xshift=1.5em,yshift=0em]n12.east)
{$
\mathbi
{
s
}
^
2
_{
j
}$}
;
\node
[anchor=west,rectangle,minimum height=1.5em,minimum width=2.5em,rounded corners=5pt] (n14) at ([xshift=1em,yshift=0em]n13.east)
{$
\ldots
$}
;
\node
[anchor=west,decnode,draw=ublue,fill=blue!10] (n15) at ([xshift=1em,yshift=0em]n14.east)
{$
\mathbi
{
s
}
_{
M
-
1
,
j
}$}
;
\node
[anchor=west,decnode,draw=ublue,fill=blue!10] (n15) at ([xshift=1em,yshift=0em]n14.east)
{$
\mathbi
{
s
}
^{
M
-
1
}_{
j
}$}
;
\node
[anchor=west,rectangle,minimum height=1.5em,minimum width=2.5em,rounded corners=5pt] (n16) at ([xshift=1.5em,yshift=0em]n15.east)
{$
\mathbi
{
y
}_{
j
}$}
;
...
...
This diff is collapsed.
Click to expand it.
Chapter15/Figures/figure-post-norm-vs-pre-norm.tex
查看文件 @
5c972926
...
...
@@ -6,16 +6,16 @@
\begin{scope}
[minimum height = 20pt]
\node
[anchor=east] (x1) at (-0.5em, 0)
{$
\mathbi
{
x
}_
l
$}
;
\node
[anchor=west,draw,fill=red!20,inner xsep=5pt,rounded corners=2pt] (F1) at ([xshift=
2
em]x1.east)
{
\small
{$
F
$}}
;
\node
[anchor=west,circle,draw,minimum size=1em] (n1) at ([xshift=
2
em]F1.east)
{}
;
\node
[anchor=west,draw,fill=green!20,inner xsep=5pt,rounded corners=2pt] (ln1) at ([xshift=
2
em]n1.east)
{
\small
{
\textrm
{
LN
}}}
;
\node
[anchor=west] (x2) at ([xshift=
2
em]ln1.east)
{$
\mathbi
{
x
}_{
l
+
1
}$}
;
\node
[anchor=west,draw,fill=red!20,inner xsep=5pt,rounded corners=2pt] (F1) at ([xshift=
4
em]x1.east)
{
\small
{$
F
$}}
;
\node
[anchor=west,circle,draw,minimum size=1em] (n1) at ([xshift=
4
em]F1.east)
{}
;
\node
[anchor=west,draw,fill=green!20,inner xsep=5pt,rounded corners=2pt] (ln1) at ([xshift=
4
em]n1.east)
{
\small
{
\textrm
{
LN
}}}
;
\node
[anchor=west] (x2) at ([xshift=
4
em]ln1.east)
{$
\mathbi
{
x
}_{
l
+
1
}$}
;
\node
[anchor=north] (x3) at ([yshift=-5em]x1.south)
{$
\mathbi
{
x
}_
l
$}
;
\node
[anchor=west,draw,fill=green!20,inner xsep=5pt,rounded corners=2pt] (F2) at ([xshift=
2
em]x3.east)
{
\small
{
\textrm
{
LN
}}}
;
\node
[anchor=west,draw,fill=red!20,inner xsep=5pt,rounded corners=2pt] (ln2) at ([xshift=
2
em]F2.east)
{
\small
{$
F
$}}
;
\node
[anchor=west,circle,draw,,minimum size=1em] (n2) at ([xshift=
2
em]ln2.east)
{}
;
\node
[anchor=west] (x4) at ([xshift=
2
em]n2.east)
{$
\mathbi
{
x
}_{
l
+
1
}$}
;
\node
[anchor=west,draw,fill=green!20,inner xsep=5pt,rounded corners=2pt] (F2) at ([xshift=
4
em]x3.east)
{
\small
{
\textrm
{
LN
}}}
;
\node
[anchor=west,draw,fill=red!20,inner xsep=5pt,rounded corners=2pt] (ln2) at ([xshift=
4
em]F2.east)
{
\small
{$
F
$}}
;
\node
[anchor=west,circle,draw,,minimum size=1em] (n2) at ([xshift=
4
em]ln2.east)
{}
;
\node
[anchor=west] (x4) at ([xshift=
4
em]n2.east)
{$
\mathbi
{
x
}_{
l
+
1
}$}
;
\draw
[->, line width=1pt]
([xshift=-0.1em]x1.east)--(F1.west);
\draw
[->, line width=1pt]
([xshift=-0.1em]F1.east)--(n1.west);
...
...
This diff is collapsed.
Click to expand it.
Chapter15/Figures/figure-weight-visualization-of-convergence-DLCL-network.tex
0 → 100644
查看文件 @
5c972926
\begin{tikzpicture}
[node distance = 0,scale = 1]
\tikzstyle
{
every node
}
=[scale=1]
\node
[draw=white]
(input) at (0,0)
{
\includegraphics
[width=0.62\textwidth]
{
./Chapter15/Figures/DLCL-picture.png
}}
;(1.9,-1.4);
\node
[scale = 2]
at (4.5,3.6)
{
4
}
;
\node
[scale = 2]
at (4.5,1.8)
{
2
}
;
\node
[scale = 2]
at (4.5,0)
{
0
}
;
\node
[scale = 2]
at (4.5,-1.8)
{
-2
}
;
\node
[scale = 2]
at (4.5,-3.6)
{
-4
}
;
\node
[scale = 1.5]
at (-4.5,3.75)
{$
\rm
x
_{
1
}$}
;
\node
[scale = 1.5]
at (-4.5,2.5)
{$
\rm
x
_{
6
}$}
;
\node
[scale = 1.5]
at (-4.5,1.4)
{$
\rm
x
_{
11
}$}
;
\node
[scale = 1.5]
at (-4.5,0.1)
{$
\rm
x
_{
16
}$}
;
\node
[scale = 1.5]
at (-4.5,-1.1)
{$
\rm
x
_{
21
}$}
;
\node
[scale = 1.5]
at (-4.5,-2.3)
{$
\rm
x
_{
26
}$}
;
\node
[scale = 1.5]
at (-4.5,-3.4)
{$
\rm
x
_{
31
}$}
;
\node
[scale = 1.5]
at (-3.8,-4)
{$
\rm
y
_{
0
}$}
;
\node
[scale = 1.5]
at (-2.7,-4)
{$
\rm
y
_{
5
}$}
;
\node
[scale = 1.5]
at (-1.5,-4)
{$
\rm
y
_{
10
}$}
;
\node
[scale = 1.5]
at (-0.3,-4)
{$
\rm
y
_{
15
}$}
;
\node
[scale = 1.5]
at (0.9,-4)
{$
\rm
y
_{
20
}$}
;
\node
[scale = 1.5]
at (2.1,-4)
{$
\rm
y
_{
25
}$}
;
\node
[scale = 1.5]
at (3.3,-4)
{$
\rm
y
_{
30
}$}
;
\end{tikzpicture}
\ No newline at end of file
This diff is collapsed.
Click to expand it.
Chapter15/chapter15.tex
查看文件 @
5c972926
差异被折叠。
点击展开。
编写
预览
Markdown
格式
0%
重试
或
添加新文件
添加附件
取消
您添加了
0
人
到此讨论。请谨慎行事。
请先完成此评论的编辑!
取消
请
注册
或者
登录
后发表评论