Skip to content
项目
群组
代码片段
帮助
当前项目
正在载入...
登录 / 注册
切换导航面板
M
mtbookv2
概览
Overview
Details
Activity
Cycle Analytics
版本库
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
问题
0
Issues
0
列表
Board
标记
里程碑
合并请求
0
Merge Requests
0
CI / CD
CI / CD
流水线
作业
日程表
图表
维基
Wiki
代码片段
Snippets
成员
Collapse sidebar
Close sidebar
活动
图像
聊天
创建新问题
作业
提交
Issue Boards
Open sidebar
NiuTrans
mtbookv2
Commits
c4e21b36
Commit
c4e21b36
authored
4 years ago
by
单韦乔
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
15章反馈,还需修改
parent
bee03ba1
全部展开
隐藏空白字符变更
内嵌
并排
正在显示
6 个修改的文件
包含
27 行增加
和
27 行删除
+27
-27
Chapter15/Figures/figure-encoder-structure-of-transformer-model-optimized-by-nas.tex
+4
-4
Chapter15/Figures/figure-evolution-and-change-of-ml-methods.tex
+0
-0
Chapter15/Figures/figure-layer-fusion-method.tex
+8
-8
Chapter15/Figures/figure-main-flow-of-neural-network-structure-search.tex
+13
-13
Chapter15/Figures/figure-relative-position-weight.tex
+2
-2
Chapter15/chapter15.tex
+0
-0
没有找到文件。
Chapter15/Figures/figure-encoder-structure-of-transformer-model-optimized-by-nas.tex
查看文件 @
c4e21b36
...
...
@@ -4,7 +4,7 @@
%left
\begin{scope}
\foreach
\x
/
\d
in
{
1/2em, 2/8em
}
\node
[unit,fill=yellow!30]
at (0,
\d
) (ln
_
\x
)
{
层
正则
化
}
;
\node
[unit,fill=yellow!30]
at (0,
\d
) (ln
_
\x
)
{
层
标准
化
}
;
\foreach
\x
/
\d
in
{
1/4em
}
\node
[unit,fill=green!30]
at (0,
\d
) (sa
_
\x
)
{
8头自注意力:512
}
;
...
...
@@ -35,7 +35,7 @@
\draw
[->,thick]
([yshift=-0.8em]ln
_
1.-90) .. controls ([xshift=5em,yshift=-0.8em]ln
_
1.-90) and ([xshift=5em]add
_
1.0) .. (add
_
1.0);
\draw
[->,thick]
(add
_
1.0) .. controls ([xshift=5em]add
_
1.0) and ([xshift=5em]add
_
2.0) .. (add
_
2.0);
\node
[font=\scriptsize]
at (0em, -1em)
{
(a) Transformer编码器中若干块的结构
}
;
\node
[font=\scriptsize]
at (0em, -1
.1
em)
{
(a) Transformer编码器中若干块的结构
}
;
\end{scope}
%right
...
...
@@ -44,7 +44,7 @@
\foreach
\x
/
\d
in
{
1/2em, 2/8em, 3/16em
}
\node
[unit,fill=yellow!30]
at (0,
\d
) (ln
_
\x
)
{
层
正则
化
}
;
\node
[unit,fill=yellow!30]
at (0,
\d
) (ln
_
\x
)
{
层
标准
化
}
;
\foreach
\x
/
\d
in
{
1/6em, 2/14em, 3/20em
}
\node
[draw,circle,minimum size=1em,inner sep=1pt]
at (0,
\d
) (add
_
\x
)
{
\scriptsize\bfnew
{
+
}}
;
...
...
@@ -84,7 +84,7 @@
\node
[minimum size=0.8em,inner sep=0pt,rounded corners=1pt,draw,fill=blue!30]
(act) at (8em, 20em)
{}
;
\node
[anchor=west,font=\footnotesize]
at ([xshift=0.1em]act.east)
{
激活函数
}
;
\node
[anchor=north,minimum size=0.8em,inner sep=0pt,rounded corners=1pt,draw,fill=yellow!30]
(nor) at ([yshift=-0.6em]act.south)
{}
;
\node
[anchor=west,font=\footnotesize]
at ([xshift=0.1em]nor.east)
{
层
正则
化
}
;
\node
[anchor=west,font=\footnotesize]
at ([xshift=0.1em]nor.east)
{
层
标准
化
}
;
\node
[anchor=north,minimum size=0.8em,inner sep=0pt,rounded corners=1pt,draw,fill=cyan!30]
(wc) at ([yshift=-0.6em]nor.south)
{}
;
\node
[anchor=west,font=\footnotesize]
at ([xshift=0.1em]wc.east)
{
宽卷积
}
;
\node
[anchor=north,minimum size=0.8em,inner sep=0pt,rounded corners=1pt,draw,fill=green!30]
(at) at ([yshift=-0.6em]wc.south)
{}
;
...
...
This diff is collapsed.
Click to expand it.
Chapter15/Figures/figure-evolution-and-change-of-ml-methods.tex
查看文件 @
c4e21b36
差异被折叠。
点击展开。
Chapter15/Figures/figure-layer-fusion-method.tex
查看文件 @
c4e21b36
...
...
@@ -9,15 +9,15 @@
\node
[anchor=north,rectangle,minimum height=1.5em,minimum width=2.5em,rounded corners=5pt] (n2) at ([xshift=0em,yshift=-0.2em]n1.south)
{$
\mathbi
{
X
}$}
;
\node
[anchor=west,encnode,draw=red!60!black!80,fill=red!20] (n3) at ([xshift=1.5em,yshift=0em]n2.east)
{$
\mathbi
{
h
}^
0
$}
;
\node
[anchor=west,encnode,draw=red!60!black!80,fill=red!20] (n3) at ([xshift=1.5em,yshift=0em]n2.east)
{$
\mathbi
{
h
}^
1
$}
;
\node
[anchor=west,encnode,draw=red!60!black!80,fill=red!20] (n4) at ([xshift=1.5em,yshift=0em]n3.east)
{$
\mathbi
{
h
}^
1
$}
;
\node
[anchor=west,encnode,draw=red!60!black!80,fill=red!20] (n4) at ([xshift=1.5em,yshift=0em]n3.east)
{$
\mathbi
{
h
}^
2
$}
;
\node
[anchor=west,encnode,draw=red!60!black!80,fill=red!20] (n5) at ([xshift=1.5em,yshift=0em]n4.east)
{$
\mathbi
{
h
}^
2
$}
;
\node
[anchor=west,encnode,draw=red!60!black!80,fill=red!20] (n5) at ([xshift=1.5em,yshift=0em]n4.east)
{$
\mathbi
{
h
}^
3
$}
;
\node
[anchor=west,rectangle,minimum height=1.5em,minimum width=2.5em,rounded corners=5pt] (n6) at ([xshift=1em,yshift=0em]n5.east)
{$
\ldots
$}
;
\node
[anchor=west,encnode,draw=red!60!black!80,fill=red!20] (n7) at ([xshift=1em,yshift=0em]n6.east)
{$
\mathbi
{
h
}^{
L
-
1
}$}
;
\node
[anchor=west,encnode,draw=red!60!black!80,fill=red!20] (n7) at ([xshift=1em,yshift=0em]n6.east)
{$
\mathbi
{
h
}^{
L
}$}
;
\node
[anchor=north,rectangle,draw=teal!80, inner sep=0mm,minimum height=2em,minimum width=8em,fill=teal!17,rounded corners=5pt,thick] (n8) at ([xshift=3em,yshift=-1.5em]n4.south)
{
权重聚合
$
\mathbi
{
g
}$}
;
...
...
@@ -27,15 +27,15 @@
\node
[anchor=north,rectangle,minimum height=1.5em,minimum width=2.5em,rounded corners=5pt] (n10) at ([xshift=0em,yshift=-0.2em]n9.south)
{$
\mathbi
{
y
}_{
<j
}$}
;
\node
[anchor=west,decnode,draw=ublue,fill=blue!10] (n11) at ([xshift=1.5em,yshift=0em]n10.east)
{$
\mathbi
{
s
}^
0
_{
j
}$}
;
\node
[anchor=west,decnode,draw=ublue,fill=blue!10] (n11) at ([xshift=1.5em,yshift=0em]n10.east)
{$
\mathbi
{
s
}^
1
_{
j
}$}
;
\node
[anchor=west,decnode,draw=ublue,fill=blue!10] (n12) at ([xshift=1.5em,yshift=0em]n11.east)
{$
\mathbi
{
s
}^
1
_{
j
}$}
;
\node
[anchor=west,decnode,draw=ublue,fill=blue!10] (n12) at ([xshift=1.5em,yshift=0em]n11.east)
{$
\mathbi
{
s
}^
2
_{
j
}$}
;
\node
[anchor=west,decnode,draw=ublue,fill=blue!10] (n13) at ([xshift=1.5em,yshift=0em]n12.east)
{$
\mathbi
{
s
}^
2
_{
j
}$}
;
\node
[anchor=west,decnode,draw=ublue,fill=blue!10] (n13) at ([xshift=1.5em,yshift=0em]n12.east)
{$
\mathbi
{
s
}^
3
_{
j
}$}
;
\node
[anchor=west,rectangle,minimum height=1.5em,minimum width=2.5em,rounded corners=5pt] (n14) at ([xshift=1em,yshift=0em]n13.east)
{$
\ldots
$}
;
\node
[anchor=west,decnode,draw=ublue,fill=blue!10] (n15) at ([xshift=1em,yshift=0em]n14.east)
{$
\mathbi
{
s
}^{
M
-
1
}_{
j
}$}
;
\node
[anchor=west,decnode,draw=ublue,fill=blue!10] (n15) at ([xshift=1em,yshift=0em]n14.east)
{$
\mathbi
{
s
}^{
M
}_{
j
}$}
;
\node
[anchor=west,rectangle,minimum height=1.5em,minimum width=2.5em,rounded corners=5pt] (n16) at ([xshift=1.5em,yshift=0em]n15.east)
{$
\mathbi
{
y
}_{
j
}$}
;
...
...
This diff is collapsed.
Click to expand it.
Chapter15/Figures/figure-main-flow-of-neural-network-structure-search.tex
查看文件 @
c4e21b36
\begin{tikzpicture}
\tikzstyle
{
node
}
=[draw,minimum height=1.4em,minimum width=2em,rounded corners=1pt,thick]
%violet
\begin{scope}
[scale=0.36]
\tikzstyle
{
every node
}
=[scale=0.36]
\node
[draw
=ublue,very thick,rounded corners=3pt,drop shadow,fill=white
,minimum width=40em,minimum height=25em]
(rec3) at (2.25,0)
{}
;
\node
[draw
=ublue,very thick,rounded corners=3pt,drop shadow,fill=white
,minimum width=22em,minimum height=25em]
(rec2) at (-12.4,0)
{}
;
\node
[draw
=ublue,very thick,rounded corners=3pt,drop shadow,fill=white
,minimum width=24em,minimum height=25em]
(rec1) at (-24,0)
{}
;
\node
[draw
,very thick,rounded corners=3pt,drop shadow,fill=red!30
,minimum width=40em,minimum height=25em]
(rec3) at (2.25,0)
{}
;
\node
[draw
,very thick,rounded corners=3pt,drop shadow,fill=green!30
,minimum width=22em,minimum height=25em]
(rec2) at (-12.4,0)
{}
;
\node
[draw
,very thick,rounded corners=3pt,drop shadow,fill=yellow!30
,minimum width=24em,minimum height=25em]
(rec1) at (-24,0)
{}
;
%left
\node
[
text=ublue
]
(label1) at (-26.4,4)
{
\Huge\bfnew
{
结构空间
}}
;
\node
[align=left]
at (-24,-0.5)
{
\Huge
\bfnew
{
1.前馈神经网络
}
\\
[4ex]
\Huge\bfnew
{
2.卷积神经网络
}
\\
[4ex]
\Huge\bfnew
{
3.循环神经网络
}
\\
[4ex]
\Huge\bfnew
{
4. Transformer网络
}
\\
[4ex]
\Huge\bfnew
{
...
}}
;
\node
[]
(label1) at (-26.4,4)
{
\Huge\bfnew
{
结构空间
}}
;
\node
[align=left]
at (-24,-0.5)
{
\Huge
{
1.前馈神经网络
}
\\
[4ex]
\Huge
{
2.卷积神经网络
}
\\
[4ex]
\Huge
{
3.循环神经网络
}
\\
[4ex]
\Huge
{
4. Transformer网络
}
\\
[4ex]
\Huge
{
...
}}
;
\draw
[
ublue,very thick,-latex]
(rec1.0) -- node[align=center,above,text=violet]
{
\huge
{
设计
}
\\
\huge
{
搜索
}
\\
\huge
{
空间
}}
(rec2.180);
\draw
[
very thick,-latex]
(rec1.0) -- node[align=center,above,text=ublue]
{
\huge\bfnew
{
设计
}
\\
\huge\bfnew
{
搜索
}
\\
\huge\bfnew
{
空间
}}
(rec2.180);
%mid
\node
[
text=ublue
]
(label2) at (-14.4,4)
{
\Huge\bfnew
{
搜索空间
}}
;
\node
[align=left]
at (-12.4,-0.5)
{
\Huge
\bfnew
{
循环神经网络
}
\\
[4ex]
\Huge\bfnew
{
1.普通RNN网络
}
\\
[4ex]
\Huge\bfnew
{
2. LSTM网络
}
\\
[4ex]
\Huge\bfnew
{
3. GRU网络
}
\\
[4ex]
\Huge\bfnew
{
...
}}
;
\node
[]
(label2) at (-14.4,4)
{
\Huge\bfnew
{
搜索空间
}}
;
\node
[align=left]
at (-12.4,-0.5)
{
\Huge
{
循环神经网络
}
\\
[4ex]
\Huge
{
1.普通RNN网络
}
\\
[4ex]
\Huge
{
2. LSTM网络
}
\\
[4ex]
\Huge
{
3. GRU网络
}
\\
[4ex]
\Huge
{
...
}}
;
\draw
[
ublue,very thick,-latex]
(rec2.0) -- node[align=center,above,text=violet]
{
\huge
{
选择
}
\\
\huge
{
搜索
}
\\
\huge
{
策略
}}
(rec3.180);
\draw
[
very thick,-latex]
(rec2.0) -- node[align=center,above,text=ublue]
{
\huge\bfnew
{
选择
}
\\
\huge\bfnew
{
搜索
}
\\
\huge\bfnew
{
策略
}}
(rec3.180);
\draw
[
ublue,very thick,-latex,out=-150,in=-30]
(rec3.-90) to node[above,text=violet,yshift=1em]
{
\huge
{
迭代结构搜索的过程
}}
(rec2.-90);
\draw
[
very thick,-latex,out=-150,in=-30]
(rec3.-90) to node[above,text=ublue,yshift=1em]
{
\huge\bfnew
{
迭代结构搜索的过程
}}
(rec2.-90);
\draw
[
ublue,very thick,-latex,out=60,in=130]
([xshift=-8em]rec3.90) to node[above,text=violet]
{
\huge
{
性能评估
}}
([xshift=8em]rec3.90);
\draw
[
very thick,-latex,out=60,in=130]
([xshift=-8em]rec3.90) to node[above,text=ublue]
{
\huge\bfnew
{
性能评估
}}
([xshift=8em]rec3.90);
%right
\node
[node]
(n1) at (0,0)
{}
;
\node
[node]
(n2) at (1.5,0)
{}
;
...
...
@@ -52,7 +52,7 @@
\node
[font=\Huge]
at (9,0)
{$
\cdots
$}
;
\node
[font=\Huge]
at (-4.5,0)
{$
\cdots
$}
;
\node
[
text=ublue
]
(label3) at (-2,4)
{
\Huge\bfnew
{
找到的模型结构
}}
;
\node
[]
(label3) at (-2,4)
{
\Huge\bfnew
{
找到的模型结构
}}
;
\node
[draw,rounded corners=6pt,very thick,minimum width=16em,minimum height=15em]
(box1) at (2.25,0)
{}
;
...
...
This diff is collapsed.
Click to expand it.
Chapter15/Figures/figure-relative-position-weight.tex
查看文件 @
c4e21b36
...
...
@@ -27,8 +27,8 @@
{
0/0/8, 1/0/9, 2/0/10, 3/0/11, 4/0/12, 5/0/13, 6/0/14
}
\node
[anchor=north]
(n
\k
) at ([xshift=-0em,yshift=-0.5em]a
\i\j
.south)
{
\i
}
;
\node
[anchor=east] (l1) at ([xshift=-0.3em,yshift=0em]n8.west)
{$
i
$}
;
\node
[anchor=north] (l2) at ([xshift=0em,yshift=-0em]n7.south)
{$
j
$}
;
\node
[anchor=east] (l1) at ([xshift=-0.3em,yshift=0em]n8.west)
{$
j
$}
;
\node
[anchor=north] (l2) at ([xshift=0em,yshift=-0em]n7.south)
{$
i
$}
;
%\node [anchor=north] (n1) at ([xshift=0em,yshift=0em]a00.south west) {};
...
...
This diff is collapsed.
Click to expand it.
Chapter15/chapter15.tex
查看文件 @
c4e21b36
差异被折叠。
点击展开。
编写
预览
Markdown
格式
0%
重试
或
添加新文件
添加附件
取消
您添加了
0
人
到此讨论。请谨慎行事。
请先完成此评论的编辑!
取消
请
注册
或者
登录
后发表评论