Skip to content
项目
群组
代码片段
帮助
当前项目
正在载入...
登录 / 注册
切换导航面板
M
mtbookv2
概览
Overview
Details
Activity
Cycle Analytics
版本库
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
问题
0
Issues
0
列表
Board
标记
里程碑
合并请求
0
Merge Requests
0
CI / CD
CI / CD
流水线
作业
日程表
图表
维基
Wiki
代码片段
Snippets
成员
Collapse sidebar
Close sidebar
活动
图像
聊天
创建新问题
作业
提交
Issue Boards
Open sidebar
NiuTrans
mtbookv2
Commits
010b2a13
Commit
010b2a13
authored
Jan 13, 2021
by
孟霞
Browse files
Options
Browse Files
Download
Plain Diff
合并分支 'caorunzhe' 到 'mengxia'
Caorunzhe 查看合并请求
!888
parents
a27ef1c4
8b825be1
全部展开
隐藏空白字符变更
内嵌
并排
正在显示
8 个修改的文件
包含
50 行增加
和
26 行删除
+50
-26
Chapter13/Figures/figure-unk-of-bpe.tex
+1
-1
Chapter15/Figures/DLCL-picture.png
+0
-0
Chapter15/Figures/figure-dynamic-linear-aggregation-network-structure.tex
+1
-1
Chapter15/Figures/figure-layer-fusion-method-2d.tex
+8
-8
Chapter15/Figures/figure-layer-fusion-method.tex
+8
-8
Chapter15/Figures/figure-post-norm-vs-pre-norm.tex
+8
-8
Chapter15/Figures/figure-weight-visualization-of-convergence-DLCL-network.tex
+24
-0
Chapter15/chapter15.tex
+0
-0
没有找到文件。
Chapter13/Figures/figure-unk-of-bpe.tex
查看文件 @
010b2a13
...
...
@@ -3,7 +3,7 @@
\node
[rounded corners=3pt,minimum width=1.0em,minimum height=2.0em,font=\scriptsize,fill=red!10,drop shadow,thick]
(top) at (0,0)
{
\begin{tabular}
{
lllllll
}
\multicolumn
{
7
}{
c
}{
符号合并表
}
\\
r
\
$
<
$
e
$
>
$
,
&
e
\
s,
&
l
\
o,
&
es
\
t,
&
lo
\
w,
&
est
\
$
<
$
e
$
>
$
,
&
e
\
r
$
<
$
e
$
>
$
,
(r,
$
<
$
e
$
>
$
),
&
(e,s),
&
(l,o),
&
(es,t),
&
(lo,w),
&
(est,
$
<
$
e
$
>
$
),
&
(e,r
$
<
$
e
$
>
$
)
,
\end{tabular}
}
;
\node
[font=\footnotesize,anchor=north]
(l1) at ([xshift=0em,yshift=-1em]top.south)
{
(a) 符号合并表
}
;
...
...
Chapter15/Figures/DLCL-picture.png
0 → 100644
查看文件 @
010b2a13
41.8 KB
Chapter15/Figures/figure-dynamic-linear-aggregation-network-structure.tex
查看文件 @
010b2a13
...
...
@@ -18,7 +18,7 @@
\node
[anchor=north,rectangle,draw, inner sep=0mm,minimum height=1.2em,minimum width=15em,fill=teal!17,rounded corners=5pt,thick] (n8) at ([xshift=0em,yshift=-3em]n4.south)
{
层正则化
}
;
\node
[anchor=north,rectangle,draw, inner sep=0mm,minimum height=1.2em,minimum width=15em,fill=purple!17,rounded corners=5pt,thick] (n9) at ([xshift=0em,yshift=-1em]n8.south)
{$
\mathbi
{
X
}
\ \quad
\mathbi
{
h
}
_
1
\ \quad
\mathbi
{
h
}_
2
\quad
\ldots
\quad\ \mathbi
{
h
}_
l
$}
;
\node
[anchor=north,rectangle,draw, inner sep=0mm,minimum height=1.2em,minimum width=15em,fill=purple!17,rounded corners=5pt,thick] (n9) at ([xshift=0em,yshift=-1em]n8.south)
{$
\mathbi
{
X
}
\ \quad
\mathbi
{
h
}
^
1
\ \quad
\mathbi
{
h
}^
2
\quad
\ldots
\quad\ \mathbi
{
h
}^
l
$}
;
\node
[anchor=north,rectangle,draw, inner sep=0mm,minimum height=1.2em,minimum width=15em,fill=teal!17,rounded corners=5pt,thick] (n10) at ([xshift=0em,yshift=-2em]n9.south)
{
权重累加
}
;
...
...
Chapter15/Figures/figure-layer-fusion-method-2d.tex
查看文件 @
010b2a13
...
...
@@ -7,9 +7,9 @@
\tikzstyle
{
vlnode
}
=[rectangle,inner sep=0mm,minimum height=1em,minimum width=5em,rounded corners=2pt,draw]
\node
[anchor=west,lnode] (n1) at (0, 0)
{$
\mathbi
{
h
}
_
3
$}
;
\node
[anchor=north west,lnode] (n2) at ([xshift=0em,yshift=-0.5em]n1.south west)
{$
\mathbi
{
h
}
_
2
$}
;
\node
[anchor=north west,lnode] (n3) at ([xshift=0em,yshift=-0.5em]n2.south west)
{$
\mathbi
{
h
}
_
1
$}
;
\node
[anchor=west,lnode] (n1) at (0, 0)
{$
\mathbi
{
h
}
^
3
$}
;
\node
[anchor=north west,lnode] (n2) at ([xshift=0em,yshift=-0.5em]n1.south west)
{$
\mathbi
{
h
}
^
2
$}
;
\node
[anchor=north west,lnode] (n3) at ([xshift=0em,yshift=-0.5em]n2.south west)
{$
\mathbi
{
h
}
^
1
$}
;
\node
[anchor=south] (d1) at ([xshift=0em,yshift=0.2em]n1.north)
{
1D
}
;
...
...
@@ -96,16 +96,16 @@
\draw
[->,thick] ([xshift=0em,yshift=0em]ffn.north) -- ([xshift=0em,yshift=0em]fn.west);
\draw
[decorate,decoration=
{
brace,mirror
}
] ([xshift=0em]n3.south west) to node [midway,font=
\small
,align=center,xshift=0em,yshift=-0.8em]
{$
d
$}
([xshift=0em]n3.south east);
\draw
[decorate,decoration=
{
brace,mirror
}
] ([xshift=0em]n3.south west) to node [midway,font=
\small
,align=center,xshift=0em,yshift=-0.8em]
{$
d
_{
\textrm
{
model
}}
$}
([xshift=0em]n3.south east);
\draw
[decorate,decoration=
{
brace,mirror
}
] ([xshift=0em]n6.south west) to node [midway,font=
\small
,align=center,xshift=0em,yshift=-0.8em]
{$
d
_{
\rm
a
}$}
([xshift=0em]n6.south east);
\draw
[decorate,decoration=
{
brace,mirror
}
] ([xshift=0em]n7.north west) to node [midway,font=
\small
,align=center,xshift=-
0.7em,yshift=-0em]
{$
d
$}
([xshift=0em]n7.south west);
\draw
[decorate,decoration=
{
brace
}
] ([xshift=0em]n7.north west) to node [midway,font=
\small
,align=center,xshift=0em,yshift=0.7em]
{$
d
$}
([xshift=0em]n7.north east);
\draw
[decorate,decoration=
{
brace,mirror
}
] ([xshift=0em]n7.north west) to node [midway,font=
\small
,align=center,xshift=-
1.4em,yshift=-0em]
{$
d
_{
\textrm
{
model
}}
$}
([xshift=0em]n7.south west);
\draw
[decorate,decoration=
{
brace
}
] ([xshift=0em]n7.north west) to node [midway,font=
\small
,align=center,xshift=0em,yshift=0.7em]
{$
d
_{
\textrm
{
model
}}
$}
([xshift=0em]n7.north east);
\draw
[decorate,decoration=
{
brace,mirror
}
] ([xshift=0em]n8.north west) to node [midway,font=
\small
,align=center,xshift=-0.8em,yshift=-0em]
{$
d
_{
\rm
a
}$}
([xshift=0em]n8.south west);
\draw
[decorate,decoration=
{
brace
}
] ([xshift=0em]n8.north west) to node [midway,font=
\small
,align=center,xshift=0em,yshift=0.8em]
{$
n
_{
\rm
hop
}$}
([xshift=0em]n8.north east);
\draw
[decorate,decoration=
{
brace,mirror
}
] ([xshift=0em]nc31.south west) to node [midway,font=
\small
,align=center,xshift=0em,yshift=-0.8em]
{$
n
_{
\rm
hop
}$}
([xshift=0em]nc35.south east);
\draw
[decorate,decoration=
{
brace,mirror
}
] ([xshift=0em]ln5.south west) to node [midway,font=
\small
,align=center,xshift=0em,yshift=-0.8em]
{$
d
$}
([xshift=0em]ln5.south east);
\draw
[decorate,decoration=
{
brace,mirror
}
] ([xshift=0em]ln5.south west) to node [midway,font=
\small
,align=center,xshift=0em,yshift=-0.8em]
{$
d
_{
\textrm
{
model
}}
$}
([xshift=0em]ln5.south east);
\draw
[decorate] ([xshift=0em]ln5.south east) to node [midway,font=
\footnotesize
,align=center,xshift=1em,yshift=-0.5em]
{$
n
_{
\rm
hop
}$}
([xshift=0em]ln1.south east);
\draw
[decorate,decoration=
{
brace,mirror
}
] ([xshift=0em]fn.south east) to node [midway,font=
\small
,align=center,xshift=
0.7em,yshift=-0em]
{$
d
$}
([xshift=0em]fn.north east);
\draw
[decorate,decoration=
{
brace,mirror
}
] ([xshift=0em]fn.south east) to node [midway,font=
\small
,align=center,xshift=
1.4em,yshift=-0em]
{$
d
_{
\textrm
{
model
}}
$}
([xshift=0em]fn.north east);
...
...
Chapter15/Figures/figure-layer-fusion-method.tex
查看文件 @
010b2a13
...
...
@@ -9,15 +9,15 @@
\node
[anchor=north,rectangle,minimum height=1.5em,minimum width=2.5em,rounded corners=5pt] (n2) at ([xshift=0em,yshift=-0.2em]n1.south)
{$
\mathbi
{
X
}$}
;
\node
[anchor=west,encnode,draw=red!60!black!80,fill=red!20] (n3) at ([xshift=1.5em,yshift=0em]n2.east)
{$
\mathbi
{
h
}
_
0
$}
;
\node
[anchor=west,encnode,draw=red!60!black!80,fill=red!20] (n3) at ([xshift=1.5em,yshift=0em]n2.east)
{$
\mathbi
{
h
}
^
0
$}
;
\node
[anchor=west,encnode,draw=red!60!black!80,fill=red!20] (n4) at ([xshift=1.5em,yshift=0em]n3.east)
{$
\mathbi
{
h
}
_
1
$}
;
\node
[anchor=west,encnode,draw=red!60!black!80,fill=red!20] (n4) at ([xshift=1.5em,yshift=0em]n3.east)
{$
\mathbi
{
h
}
^
1
$}
;
\node
[anchor=west,encnode,draw=red!60!black!80,fill=red!20] (n5) at ([xshift=1.5em,yshift=0em]n4.east)
{$
\mathbi
{
h
}
_
2
$}
;
\node
[anchor=west,encnode,draw=red!60!black!80,fill=red!20] (n5) at ([xshift=1.5em,yshift=0em]n4.east)
{$
\mathbi
{
h
}
^
2
$}
;
\node
[anchor=west,rectangle,minimum height=1.5em,minimum width=2.5em,rounded corners=5pt] (n6) at ([xshift=1em,yshift=0em]n5.east)
{$
\ldots
$}
;
\node
[anchor=west,encnode,draw=red!60!black!80,fill=red!20] (n7) at ([xshift=1em,yshift=0em]n6.east)
{$
\mathbi
{
h
}
_
{
L
-
1
}$}
;
\node
[anchor=west,encnode,draw=red!60!black!80,fill=red!20] (n7) at ([xshift=1em,yshift=0em]n6.east)
{$
\mathbi
{
h
}
^
{
L
-
1
}$}
;
\node
[anchor=north,rectangle,draw=teal!80, inner sep=0mm,minimum height=2em,minimum width=8em,fill=teal!17,rounded corners=5pt,thick] (n8) at ([xshift=3em,yshift=-1.5em]n4.south)
{
权重聚合
$
\mathbi
{
g
}$}
;
...
...
@@ -27,15 +27,15 @@
\node
[anchor=north,rectangle,minimum height=1.5em,minimum width=2.5em,rounded corners=5pt] (n10) at ([xshift=0em,yshift=-0.2em]n9.south)
{$
\mathbi
{
y
}_{
<j
}$}
;
\node
[anchor=west,decnode,draw=ublue,fill=blue!10] (n11) at ([xshift=1.5em,yshift=0em]n10.east)
{$
\mathbi
{
s
}
_{
0
,
j
}$}
;
\node
[anchor=west,decnode,draw=ublue,fill=blue!10] (n11) at ([xshift=1.5em,yshift=0em]n10.east)
{$
\mathbi
{
s
}
^
0
_{
j
}$}
;
\node
[anchor=west,decnode,draw=ublue,fill=blue!10] (n12) at ([xshift=1.5em,yshift=0em]n11.east)
{$
\mathbi
{
s
}
_{
1
,
j
}$}
;
\node
[anchor=west,decnode,draw=ublue,fill=blue!10] (n12) at ([xshift=1.5em,yshift=0em]n11.east)
{$
\mathbi
{
s
}
^
1
_{
j
}$}
;
\node
[anchor=west,decnode,draw=ublue,fill=blue!10] (n13) at ([xshift=1.5em,yshift=0em]n12.east)
{$
\mathbi
{
s
}
_{
2
,
j
}$}
;
\node
[anchor=west,decnode,draw=ublue,fill=blue!10] (n13) at ([xshift=1.5em,yshift=0em]n12.east)
{$
\mathbi
{
s
}
^
2
_{
j
}$}
;
\node
[anchor=west,rectangle,minimum height=1.5em,minimum width=2.5em,rounded corners=5pt] (n14) at ([xshift=1em,yshift=0em]n13.east)
{$
\ldots
$}
;
\node
[anchor=west,decnode,draw=ublue,fill=blue!10] (n15) at ([xshift=1em,yshift=0em]n14.east)
{$
\mathbi
{
s
}
_{
M
-
1
,
j
}$}
;
\node
[anchor=west,decnode,draw=ublue,fill=blue!10] (n15) at ([xshift=1em,yshift=0em]n14.east)
{$
\mathbi
{
s
}
^{
M
-
1
}_{
j
}$}
;
\node
[anchor=west,rectangle,minimum height=1.5em,minimum width=2.5em,rounded corners=5pt] (n16) at ([xshift=1.5em,yshift=0em]n15.east)
{$
\mathbi
{
y
}_{
j
}$}
;
...
...
Chapter15/Figures/figure-post-norm-vs-pre-norm.tex
查看文件 @
010b2a13
...
...
@@ -6,16 +6,16 @@
\begin{scope}
[minimum height = 20pt]
\node
[anchor=east] (x1) at (-0.5em, 0)
{$
\mathbi
{
x
}_
l
$}
;
\node
[anchor=west,draw,fill=red!20,inner xsep=5pt,rounded corners=2pt] (F1) at ([xshift=
2
em]x1.east)
{
\small
{$
F
$}}
;
\node
[anchor=west,circle,draw,minimum size=1em] (n1) at ([xshift=
2
em]F1.east)
{}
;
\node
[anchor=west,draw,fill=green!20,inner xsep=5pt,rounded corners=2pt] (ln1) at ([xshift=
2
em]n1.east)
{
\small
{
\textrm
{
LN
}}}
;
\node
[anchor=west] (x2) at ([xshift=
2
em]ln1.east)
{$
\mathbi
{
x
}_{
l
+
1
}$}
;
\node
[anchor=west,draw,fill=red!20,inner xsep=5pt,rounded corners=2pt] (F1) at ([xshift=
4
em]x1.east)
{
\small
{$
F
$}}
;
\node
[anchor=west,circle,draw,minimum size=1em] (n1) at ([xshift=
4
em]F1.east)
{}
;
\node
[anchor=west,draw,fill=green!20,inner xsep=5pt,rounded corners=2pt] (ln1) at ([xshift=
4
em]n1.east)
{
\small
{
\textrm
{
LN
}}}
;
\node
[anchor=west] (x2) at ([xshift=
4
em]ln1.east)
{$
\mathbi
{
x
}_{
l
+
1
}$}
;
\node
[anchor=north] (x3) at ([yshift=-5em]x1.south)
{$
\mathbi
{
x
}_
l
$}
;
\node
[anchor=west,draw,fill=green!20,inner xsep=5pt,rounded corners=2pt] (F2) at ([xshift=
2
em]x3.east)
{
\small
{
\textrm
{
LN
}}}
;
\node
[anchor=west,draw,fill=red!20,inner xsep=5pt,rounded corners=2pt] (ln2) at ([xshift=
2
em]F2.east)
{
\small
{$
F
$}}
;
\node
[anchor=west,circle,draw,,minimum size=1em] (n2) at ([xshift=
2
em]ln2.east)
{}
;
\node
[anchor=west] (x4) at ([xshift=
2
em]n2.east)
{$
\mathbi
{
x
}_{
l
+
1
}$}
;
\node
[anchor=west,draw,fill=green!20,inner xsep=5pt,rounded corners=2pt] (F2) at ([xshift=
4
em]x3.east)
{
\small
{
\textrm
{
LN
}}}
;
\node
[anchor=west,draw,fill=red!20,inner xsep=5pt,rounded corners=2pt] (ln2) at ([xshift=
4
em]F2.east)
{
\small
{$
F
$}}
;
\node
[anchor=west,circle,draw,,minimum size=1em] (n2) at ([xshift=
4
em]ln2.east)
{}
;
\node
[anchor=west] (x4) at ([xshift=
4
em]n2.east)
{$
\mathbi
{
x
}_{
l
+
1
}$}
;
\draw
[->, line width=1pt]
([xshift=-0.1em]x1.east)--(F1.west);
\draw
[->, line width=1pt]
([xshift=-0.1em]F1.east)--(n1.west);
...
...
Chapter15/Figures/figure-weight-visualization-of-convergence-DLCL-network.tex
0 → 100644
查看文件 @
010b2a13
\begin{tikzpicture}
[node distance = 0,scale = 1]
\tikzstyle
{
every node
}
=[scale=1]
\node
[draw=white]
(input) at (0,0)
{
\includegraphics
[width=0.62\textwidth]
{
./Chapter15/Figures/DLCL-picture.png
}}
;(1.9,-1.4);
\node
[scale = 2]
at (4.5,3.6)
{
4
}
;
\node
[scale = 2]
at (4.5,1.8)
{
2
}
;
\node
[scale = 2]
at (4.5,0)
{
0
}
;
\node
[scale = 2]
at (4.5,-1.8)
{
-2
}
;
\node
[scale = 2]
at (4.5,-3.6)
{
-4
}
;
\node
[scale = 1.5]
at (-4.5,3.75)
{$
\rm
x
_{
1
}$}
;
\node
[scale = 1.5]
at (-4.5,2.5)
{$
\rm
x
_{
6
}$}
;
\node
[scale = 1.5]
at (-4.5,1.4)
{$
\rm
x
_{
11
}$}
;
\node
[scale = 1.5]
at (-4.5,0.1)
{$
\rm
x
_{
16
}$}
;
\node
[scale = 1.5]
at (-4.5,-1.1)
{$
\rm
x
_{
21
}$}
;
\node
[scale = 1.5]
at (-4.5,-2.3)
{$
\rm
x
_{
26
}$}
;
\node
[scale = 1.5]
at (-4.5,-3.4)
{$
\rm
x
_{
31
}$}
;
\node
[scale = 1.5]
at (-3.8,-4)
{$
\rm
y
_{
0
}$}
;
\node
[scale = 1.5]
at (-2.7,-4)
{$
\rm
y
_{
5
}$}
;
\node
[scale = 1.5]
at (-1.5,-4)
{$
\rm
y
_{
10
}$}
;
\node
[scale = 1.5]
at (-0.3,-4)
{$
\rm
y
_{
15
}$}
;
\node
[scale = 1.5]
at (0.9,-4)
{$
\rm
y
_{
20
}$}
;
\node
[scale = 1.5]
at (2.1,-4)
{$
\rm
y
_{
25
}$}
;
\node
[scale = 1.5]
at (3.3,-4)
{$
\rm
y
_{
30
}$}
;
\end{tikzpicture}
\ No newline at end of file
Chapter15/chapter15.tex
查看文件 @
010b2a13
差异被折叠。
点击展开。
编写
预览
Markdown
格式
0%
重试
或
添加新文件
添加附件
取消
您添加了
0
人
到此讨论。请谨慎行事。
请先完成此评论的编辑!
取消
请
注册
或者
登录
后发表评论