資源描述:
《神經(jīng)網(wǎng)絡(luò)與深度學(xué)習(xí)講義20151211》由會(huì)員上傳分享,免費(fèi)在線閱讀,更多相關(guān)內(nèi)容在行業(yè)資料-天天文庫(kù)。
1、《神經(jīng)網(wǎng)絡(luò)與深度學(xué)習(xí)》講義NotesonArti?cialNeuralNetworksandDeepLearning邱錫鵬xpqiu@fudan.edu.cn2015年12月11日DRAFT2015-12-1122:00編譯時(shí)間:目錄第一章緒論11.1總結(jié)和深入閱讀.................................2第二章數(shù)學(xué)基礎(chǔ)32.1向量.......................................32.1.1向量的模................................32.1.2向量的范數(shù).........
2、......................32.2矩陣.......................................42.3矩陣的基本運(yùn)算.................................42015-12-1122:002.3.1常見(jiàn)的矩陣...............................52.3.2矩陣的范數(shù)DRAFT...............................52.4導(dǎo)數(shù).......................................6編譯時(shí)間:2.4.1常見(jiàn)的向量導(dǎo)數(shù)...
3、.........................62.4.2導(dǎo)數(shù)法則................................62.5常用函數(shù)....................................72.5.1logistic函數(shù)...............................72.5.2softmax函數(shù)..............................72.6總結(jié)和深入閱讀.................................9第三章機(jī)器學(xué)習(xí)概述103.1機(jī)器學(xué)習(xí)概述.............
4、.....................10II目錄3.1.1損失函數(shù)................................123.1.2機(jī)器學(xué)習(xí)算法的類型..........................133.1.3機(jī)器學(xué)習(xí)中的一些概念.........................143.1.4參數(shù)學(xué)習(xí)算法..............................163.2線性回歸....................................183.3線性分類................................
5、....203.3.1兩類分類................................203.3.2多類線性分類..............................223.4評(píng)價(jià)方法....................................263.5總結(jié)和深入閱讀.................................27第四章感知器284.1兩類感知器...................................294.1.1感知器學(xué)習(xí)算法............................294.1.
6、2收斂性證明...............................304.2多類感知器...................................324.2.1多類感知器的收斂性..........................2015-12-1122:00344.3投票感知器...................................354.4總結(jié)和深入閱讀DRAFT.................................36第五章人工神經(jīng)網(wǎng)絡(luò)編譯時(shí)間:385.1神經(jīng)元.......................
7、...............395.1.1激活函數(shù)................................395.2前饋神經(jīng)網(wǎng)絡(luò)..................................415.2.1前饋計(jì)算................................415.3反向傳播算法..................................425.4梯度消失問(wèn)題..................................455.5訓(xùn)練方法....................................
8、465.6經(jīng)驗(yàn)..........................