文件名称:CNTK
- 所属分类:
- 人工智能/神经网络/遗传算法
- 资源属性:
- [Windows] [Visual.Net] [源码]
- 上传时间:
- 2017-08-16
- 文件大小:
- 56.91mb
- 下载次数:
- 0次
- 提 供 者:
- 夏***
- 相关连接:
- 无
- 下载说明:
- 别用迅雷下载,失败请重下,重下不扣分!
介绍说明--下载内容均来自于网络,请自行研究使用
在深度的重要性的驱使下,出现了一个新的问题:训练一个更好的网络是否和堆叠更多的层一样简单呢?解决这一问题的障碍便是困扰人们很久的梯度消失/梯度爆炸,这从一开始便阻碍了模型的收敛。归一初始化(normalized initialization)和中间归一化(intermediate normalization)在很大程度上解决了这一问题,它使得数十层的网络在反向传播的随机梯度下降(SGD)上能够收敛。
当深层网络能够收敛时,一个退化问题又出现了:随着网络深度的增加,准确率达到饱和(不足为奇)然后迅速退化。意外的是,这种退化并不是由过拟合造成的,并且在一个合理的深度模型中增加更多的层却导致了更高的错误率(Deeper neural networks are more difficult to train. We present a residual learning fr a mework to ease the training of networks that are substantially deeper than those used previously. We explicitly reformulate the layers as learning residual functions with reference to the layer inputs, instead of learning unreferenced functions. We provide comprehensive empirical evidence showing that these residual networks are easier to optimize, and can gain accuracy from considerably increased depth. On the ImageNet dataset we evaluate residual nets with a depth of up to 152 layers---8x deeper than VGG nets but still having lower complexity. An ensemble of these residual nets achieves 3.57% error on the ImageNet test set. This result won the 1st place on the ILSVRC 2015 classification task. We also present analysis on CIFAR-10 with 100 and 1000 layers)
当深层网络能够收敛时,一个退化问题又出现了:随着网络深度的增加,准确率达到饱和(不足为奇)然后迅速退化。意外的是,这种退化并不是由过拟合造成的,并且在一个合理的深度模型中增加更多的层却导致了更高的错误率(Deeper neural networks are more difficult to train. We present a residual learning fr a mework to ease the training of networks that are substantially deeper than those used previously. We explicitly reformulate the layers as learning residual functions with reference to the layer inputs, instead of learning unreferenced functions. We provide comprehensive empirical evidence showing that these residual networks are easier to optimize, and can gain accuracy from considerably increased depth. On the ImageNet dataset we evaluate residual nets with a depth of up to 152 layers---8x deeper than VGG nets but still having lower complexity. An ensemble of these residual nets achieves 3.57% error on the ImageNet test set. This result won the 1st place on the ILSVRC 2015 classification task. We also present analysis on CIFAR-10 with 100 and 1000 layers)
(系统自动生成,下载前可以参看下载内容)
下载文件列表
App.config
CntkBitmapExtensions.cs
CNTKLibraryCSEvalCPUOnlyExamples.csproj
CNTKLibraryCSEvalCPUOnlyExamples.csproj.user
CNTKLibraryCSEvalExamples.cs
CNTKLibraryEval.csproj
CNTKLibraryEval.sln
CNTKLibraryEval.user
packages
packages.config
packages\CNTK.CPUOnly.2.0.0
packages\CNTK.CPUOnly.2.0.0\build
packages\CNTK.CPUOnly.2.0.0\build\native
packages\CNTK.CPUOnly.2.0.0\build\native\CNTK.CPUOnly.targets
packages\CNTK.CPUOnly.2.0.0\build\native\include
packages\CNTK.CPUOnly.2.0.0\build\native\include\CNTKLibrary.h
packages\CNTK.CPUOnly.2.0.0\build\native\include\CNTKLibraryInternals.h
packages\CNTK.CPUOnly.2.0.0\build\native\lib
packages\CNTK.CPUOnly.2.0.0\build\native\lib\x64
packages\CNTK.CPUOnly.2.0.0\build\native\lib\x64\Debug
packages\CNTK.CPUOnly.2.0.0\build\native\lib\x64\Debug\Cntk.Core-2.0d.lib
packages\CNTK.CPUOnly.2.0.0\build\native\lib\x64\Release
packages\CNTK.CPUOnly.2.0.0\build\native\lib\x64\Release\Cntk.Core-2.0.lib
packages\CNTK.CPUOnly.2.0.0\build\net45
packages\CNTK.CPUOnly.2.0.0\build\net45\CNTK.CPUOnly.targets
packages\CNTK.CPUOnly.2.0.0\CNTK.CPUOnly.2.0.0.nupkg
packages\CNTK.CPUOnly.2.0.0\lib
packages\CNTK.CPUOnly.2.0.0\lib\net45
packages\CNTK.CPUOnly.2.0.0\lib\net45\x64
packages\CNTK.CPUOnly.2.0.0\lib\net45\x64\Cntk.Core.Managed-2.0.dll
packages\CNTK.CPUOnly.2.0.0\support
packages\CNTK.CPUOnly.2.0.0\support\x64
packages\CNTK.CPUOnly.2.0.0\support\x64\Debug
packages\CNTK.CPUOnly.2.0.0\support\x64\Debug\Cntk.Core-2.0d.dll
packages\CNTK.CPUOnly.2.0.0\support\x64\Debug\Cntk.Core.CSBinding-2.0d.dll
packages\CNTK.CPUOnly.2.0.0\support\x64\Debug\Cntk.Math-2.0d.dll
packages\CNTK.CPUOnly.2.0.0\support\x64\Debug\Cntk.PerformanceProfiler-2.0d.dll
packages\CNTK.CPUOnly.2.0.0\support\x64\Dependency
packages\CNTK.CPUOnly.2.0.0\support\x64\Dependency\libiomp5md.dll
packages\CNTK.CPUOnly.2.0.0\support\x64\Dependency\mkl_cntk_p.dll
packages\CNTK.CPUOnly.2.0.0\support\x64\Release
packages\CNTK.CPUOnly.2.0.0\support\x64\Release\Cntk.Core-2.0.dll
packages\CNTK.CPUOnly.2.0.0\support\x64\Release\Cntk.Core.CSBinding-2.0.dll
packages\CNTK.CPUOnly.2.0.0\support\x64\Release\Cntk.Math-2.0.dll
packages\CNTK.CPUOnly.2.0.0\support\x64\Release\Cntk.PerformanceProfiler-2.0.dll
packages\Newtonsoft.Json.10.0.3
packages\NLog.4.4.11
packages\NLog.4.4.11\lib
packages\NLog.4.4.11\lib\MonoAndroid10
packages\NLog.4.4.11\lib\MonoAndroid10\NLog.dll
packages\NLog.4.4.11\lib\MonoAndroid10\NLog.xml
packages\NLog.4.4.11\lib\net35
packages\NLog.4.4.11\lib\net35\NLog.dll
packages\NLog.4.4.11\lib\net35\NLog.xml
packages\NLog.4.4.11\lib\net40
packages\NLog.4.4.11\lib\net40\NLog.dll
packages\NLog.4.4.11\lib\net40\NLog.xml
packages\NLog.4.4.11\lib\net45
packages\NLog.4.4.11\lib\net45\NLog.dll
packages\NLog.4.4.11\lib\net45\NLog.xml
packages\NLog.4.4.11\lib\sl4
packages\NLog.4.4.11\lib\sl4\NLog.dll
packages\NLog.4.4.11\lib\sl4\NLog.xml
packages\NLog.4.4.11\lib\sl5
packages\NLog.4.4.11\lib\sl5\NLog.dll
packages\NLog.4.4.11\lib\sl5\NLog.xml
packages\NLog.4.4.11\lib\wp8
packages\NLog.4.4.11\lib\wp8\NLog.dll
packages\NLog.4.4.11\lib\wp8\NLog.xml
packages\NLog.4.4.11\lib\Xamarin.iOS10
packages\NLog.4.4.11\lib\Xamarin.iOS10\NLog.dll
packages\NLog.4.4.11\lib\Xamarin.iOS10\NLog.xml
packages\NLog.4.4.11\NLog.4.4.11.nupkg
packages\NLog.4.4.6
packages\NLog.4.4.6\lib
packages\NLog.4.4.6\lib\MonoAndroid10
packages\NLog.4.4.6\lib\MonoAndroid10\NLog.dll
packages\NLog.4.4.6\lib\MonoAndroid10\NLog.xml
packages\NLog.4.4.6\lib\net35
packages\NLog.4.4.6\lib\net35\NLog.dll
packages\NLog.4.4.6\lib\net35\NLog.xml
packages\NLog.4.4.6\lib\net40
packages\NLog.4.4.6\lib\net40\NLog.dll
packages\NLog.4.4.6\lib\net40\NLog.xml
packages\NLog.4.4.6\lib\net45
packages\NLog.4.4.6\lib\net45\NLog.dll
packages\NLog.4.4.6\lib\net45\NLog.xml
packages\NLog.4.4.6\lib\sl4
packages\NLog.4.4.6\lib\sl4\NLog.dll
packages\NLog.4.4.6\lib\sl4\NLog.xml
packages\NLog.4.4.6\lib\sl5
packages\NLog.4.4.6\lib\sl5\NLog.dll
packages\NLog.4.4.6\lib\sl5\NLog.xml
packages\NLog.4.4.6\lib\wp8
packages\NLog.4.4.6\lib\wp8\NLog.dll
packages\NLog.4.4.6\lib\wp8\NLog.xml
packages\NLog.4.4.6\lib\Xamarin.iOS10
packages\NLog.4.4.6\lib\Xamarin.iOS10\NLog.dll
packages\NLog.4.4.6\lib\Xamarin.iOS10\NLog.xml
packages\NLog.4.4.6\NLog.4.4.6.nupkg
CntkBitmapExtensions.cs
CNTKLibraryCSEvalCPUOnlyExamples.csproj
CNTKLibraryCSEvalCPUOnlyExamples.csproj.user
CNTKLibraryCSEvalExamples.cs
CNTKLibraryEval.csproj
CNTKLibraryEval.sln
CNTKLibraryEval.user
packages
packages.config
packages\CNTK.CPUOnly.2.0.0
packages\CNTK.CPUOnly.2.0.0\build
packages\CNTK.CPUOnly.2.0.0\build\native
packages\CNTK.CPUOnly.2.0.0\build\native\CNTK.CPUOnly.targets
packages\CNTK.CPUOnly.2.0.0\build\native\include
packages\CNTK.CPUOnly.2.0.0\build\native\include\CNTKLibrary.h
packages\CNTK.CPUOnly.2.0.0\build\native\include\CNTKLibraryInternals.h
packages\CNTK.CPUOnly.2.0.0\build\native\lib
packages\CNTK.CPUOnly.2.0.0\build\native\lib\x64
packages\CNTK.CPUOnly.2.0.0\build\native\lib\x64\Debug
packages\CNTK.CPUOnly.2.0.0\build\native\lib\x64\Debug\Cntk.Core-2.0d.lib
packages\CNTK.CPUOnly.2.0.0\build\native\lib\x64\Release
packages\CNTK.CPUOnly.2.0.0\build\native\lib\x64\Release\Cntk.Core-2.0.lib
packages\CNTK.CPUOnly.2.0.0\build\net45
packages\CNTK.CPUOnly.2.0.0\build\net45\CNTK.CPUOnly.targets
packages\CNTK.CPUOnly.2.0.0\CNTK.CPUOnly.2.0.0.nupkg
packages\CNTK.CPUOnly.2.0.0\lib
packages\CNTK.CPUOnly.2.0.0\lib\net45
packages\CNTK.CPUOnly.2.0.0\lib\net45\x64
packages\CNTK.CPUOnly.2.0.0\lib\net45\x64\Cntk.Core.Managed-2.0.dll
packages\CNTK.CPUOnly.2.0.0\support
packages\CNTK.CPUOnly.2.0.0\support\x64
packages\CNTK.CPUOnly.2.0.0\support\x64\Debug
packages\CNTK.CPUOnly.2.0.0\support\x64\Debug\Cntk.Core-2.0d.dll
packages\CNTK.CPUOnly.2.0.0\support\x64\Debug\Cntk.Core.CSBinding-2.0d.dll
packages\CNTK.CPUOnly.2.0.0\support\x64\Debug\Cntk.Math-2.0d.dll
packages\CNTK.CPUOnly.2.0.0\support\x64\Debug\Cntk.PerformanceProfiler-2.0d.dll
packages\CNTK.CPUOnly.2.0.0\support\x64\Dependency
packages\CNTK.CPUOnly.2.0.0\support\x64\Dependency\libiomp5md.dll
packages\CNTK.CPUOnly.2.0.0\support\x64\Dependency\mkl_cntk_p.dll
packages\CNTK.CPUOnly.2.0.0\support\x64\Release
packages\CNTK.CPUOnly.2.0.0\support\x64\Release\Cntk.Core-2.0.dll
packages\CNTK.CPUOnly.2.0.0\support\x64\Release\Cntk.Core.CSBinding-2.0.dll
packages\CNTK.CPUOnly.2.0.0\support\x64\Release\Cntk.Math-2.0.dll
packages\CNTK.CPUOnly.2.0.0\support\x64\Release\Cntk.PerformanceProfiler-2.0.dll
packages\Newtonsoft.Json.10.0.3
packages\NLog.4.4.11
packages\NLog.4.4.11\lib
packages\NLog.4.4.11\lib\MonoAndroid10
packages\NLog.4.4.11\lib\MonoAndroid10\NLog.dll
packages\NLog.4.4.11\lib\MonoAndroid10\NLog.xml
packages\NLog.4.4.11\lib\net35
packages\NLog.4.4.11\lib\net35\NLog.dll
packages\NLog.4.4.11\lib\net35\NLog.xml
packages\NLog.4.4.11\lib\net40
packages\NLog.4.4.11\lib\net40\NLog.dll
packages\NLog.4.4.11\lib\net40\NLog.xml
packages\NLog.4.4.11\lib\net45
packages\NLog.4.4.11\lib\net45\NLog.dll
packages\NLog.4.4.11\lib\net45\NLog.xml
packages\NLog.4.4.11\lib\sl4
packages\NLog.4.4.11\lib\sl4\NLog.dll
packages\NLog.4.4.11\lib\sl4\NLog.xml
packages\NLog.4.4.11\lib\sl5
packages\NLog.4.4.11\lib\sl5\NLog.dll
packages\NLog.4.4.11\lib\sl5\NLog.xml
packages\NLog.4.4.11\lib\wp8
packages\NLog.4.4.11\lib\wp8\NLog.dll
packages\NLog.4.4.11\lib\wp8\NLog.xml
packages\NLog.4.4.11\lib\Xamarin.iOS10
packages\NLog.4.4.11\lib\Xamarin.iOS10\NLog.dll
packages\NLog.4.4.11\lib\Xamarin.iOS10\NLog.xml
packages\NLog.4.4.11\NLog.4.4.11.nupkg
packages\NLog.4.4.6
packages\NLog.4.4.6\lib
packages\NLog.4.4.6\lib\MonoAndroid10
packages\NLog.4.4.6\lib\MonoAndroid10\NLog.dll
packages\NLog.4.4.6\lib\MonoAndroid10\NLog.xml
packages\NLog.4.4.6\lib\net35
packages\NLog.4.4.6\lib\net35\NLog.dll
packages\NLog.4.4.6\lib\net35\NLog.xml
packages\NLog.4.4.6\lib\net40
packages\NLog.4.4.6\lib\net40\NLog.dll
packages\NLog.4.4.6\lib\net40\NLog.xml
packages\NLog.4.4.6\lib\net45
packages\NLog.4.4.6\lib\net45\NLog.dll
packages\NLog.4.4.6\lib\net45\NLog.xml
packages\NLog.4.4.6\lib\sl4
packages\NLog.4.4.6\lib\sl4\NLog.dll
packages\NLog.4.4.6\lib\sl4\NLog.xml
packages\NLog.4.4.6\lib\sl5
packages\NLog.4.4.6\lib\sl5\NLog.dll
packages\NLog.4.4.6\lib\sl5\NLog.xml
packages\NLog.4.4.6\lib\wp8
packages\NLog.4.4.6\lib\wp8\NLog.dll
packages\NLog.4.4.6\lib\wp8\NLog.xml
packages\NLog.4.4.6\lib\Xamarin.iOS10
packages\NLog.4.4.6\lib\Xamarin.iOS10\NLog.dll
packages\NLog.4.4.6\lib\Xamarin.iOS10\NLog.xml
packages\NLog.4.4.6\NLog.4.4.6.nupkg