Skip to content
项目
群组
代码片段
帮助
当前项目
正在载入...
登录 / 注册
切换导航面板
M
mtbookv2
概览
Overview
Details
Activity
Cycle Analytics
版本库
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
问题
0
Issues
0
列表
Board
标记
里程碑
合并请求
0
Merge Requests
0
CI / CD
CI / CD
流水线
作业
日程表
图表
维基
Wiki
代码片段
Snippets
成员
Collapse sidebar
Close sidebar
活动
图像
聊天
创建新问题
作业
提交
Issue Boards
Open sidebar
NiuTrans
mtbookv2
Commits
cba7f03f
Commit
cba7f03f
authored
4 years ago
by
zengxin
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
11
parent
227dde2d
隐藏空白字符变更
内嵌
并排
正在显示
3 个修改的文件
包含
10 行增加
和
8 行删除
+10
-8
Chapter11/Figures/figure-deep-vs-light.tex
+4
-3
Chapter11/Figures/figure-standard.tex
+5
-4
Chapter11/chapter11.tex
+1
-1
没有找到文件。
Chapter11/Figures/figure-deep-vs-light.tex
查看文件 @
cba7f03f
...
...
@@ -2,7 +2,7 @@
\begin{tikzpicture}
\tikzstyle
{
every node
}
=[scale=1.5]
\tikzstyle
{
unit
}
= [inner sep=0pt, minimum size=1em,draw,thick]
\tikzstyle
{
vuale
}
= [inner sep=0pt]
\tikzstyle
{
vuale
}
= [inner sep=0pt
,font=
\tiny
]
\begin{scope}
...
...
@@ -27,7 +27,7 @@
\node
[vuale]
at (6.5em, 9.9em)
{$
y
_
2
$}
;
\node
(t2) at (2.5em, -1em)
{
\large
{$
\cdots
$}}
;
\node
[anchor=north,font=
\
footnotesize
] at ([yshift=-0.2em]t2.south)
{
深度卷积
}
;
\node
[anchor=north,font=
\
tiny
] at ([yshift=-0.2em]t2.south)
{
深度卷积
}
;
\end{scope}
\begin{scope}
[xshift=4cm]
...
...
@@ -52,7 +52,7 @@
\node
[vuale]
at (6.5em, 9.9em)
{$
y
_
2
$}
;
\node
(t2) at (2.5em, -1em)
{
\large
{$
\cdots
$}}
;
\node
[anchor=north,font=
\
footnotesize
] at ([yshift=-0.2em]t2.south)
{
轻量卷积
}
;
\node
[anchor=north,font=
\
tiny
] at ([yshift=-0.2em]t2.south)
{
轻量卷积
}
;
\end{scope}
\end{tikzpicture}
\ No newline at end of file
This diff is collapsed.
Click to expand it.
Chapter11/Figures/figure-standard.tex
查看文件 @
cba7f03f
...
...
@@ -3,7 +3,7 @@
\tikzstyle
{
every node
}
=[scale=1.5]
\tikzstyle
{
unit
}
= [inner sep=0pt, minimum size=1em,draw,thick]
%, font=\scriptsize
\tikzstyle
{
vuale
}
= [inner sep=0pt]
\tikzstyle
{
vuale
}
= [inner sep=0pt
,font=
\tiny
]
\begin{scope}
\foreach
\point
in
{
0,1,2
}{
...
...
@@ -40,7 +40,7 @@
\node
[vuale]
at ([xshift=0.9em]r3
_
1.east)
{$
y
_
3
$}
;
\node
(t1) at (2.5em, -1em)
{
\large
{$
\cdots
$}}
;
\node
[anchor=north,font=
\
footnotesize
] at ([yshift=-0.2em]t1.south)
{
传统卷积
}
;
\node
[anchor=north,font=
\
tiny
] at ([yshift=-0.2em]t1.south)
{
传统卷积
}
;
\end{scope}
\begin{scope}
[xshift=4cm]
...
...
@@ -74,7 +74,7 @@
\node
[vuale]
at ([xshift=0.9em]r3
_
1.east)
{$
y
_
3
$}
;
\node
(t2) at (2.5em, -1em)
{
\large
{$
\cdots
$}}
;
\node
[anchor=north,font=
\
footnotesize
] at ([yshift=-0.2em]t2.south)
{
深度卷积
}
;
\node
[anchor=north,font=
\
tiny
] at ([yshift=-0.2em]t2.south)
{
深度卷积
}
;
\end{scope}
\begin{scope}
[xshift=8cm]
...
...
@@ -110,7 +110,7 @@
\node
[vuale]
at ([xshift=0.9em]r3
_
1.east)
{$
y
_
3
$}
;
\node
(t3) at (2.5em, -1em)
{
\large
{$
\cdots
$}}
;
\node
[anchor=north,font=
\
footnotesize
] at ([yshift=-0.2em]t3.south)
{
逐点卷积
}
;
\node
[anchor=north,font=
\
tiny
] at ([yshift=-0.2em]t3.south)
{
逐点卷积
}
;
\end{scope}
\end{tikzpicture}
\ No newline at end of file
This diff is collapsed.
Click to expand it.
Chapter11/chapter11.tex
查看文件 @
cba7f03f
...
...
@@ -329,7 +329,7 @@
\parinterval
残差连接从广义上讲也叫
{
\small\bfnew
{
短连接
}}
\index
{
短连接
}
(Short-cut Connection)
\index
{
Short-cut Connection
}
,指的是这种短距离的连接。它的思想很简单,就是把层和层之间的距离拉近,进而提高信息传递的效率。如图
\ref
{
fig:11-15
}
所示,子层1 通过残差连接跳过了子层2,直接和子层3 进行信息传递。使信息传递变得更高效,有效解决了深层网络训练过程中容易出现的梯度消失/爆炸问题,使得深层网络的训练更加容易。其计算公式为:
\begin{eqnarray}
x
_{
l+1
}
= x
_
l +
\mathcal
{
F
}
(x
_
l)
x
_{
l+1
}
= x
_
l +
F
(x
_
l)
\label
{
eq:11-3
}
\end{eqnarray}
...
...
This diff is collapsed.
Click to expand it.
编写
预览
Markdown
格式
0%
重试
或
添加新文件
添加附件
取消
您添加了
0
人
到此讨论。请谨慎行事。
请先完成此评论的编辑!
取消
请
注册
或者
登录
后发表评论