75. Stochastic Gradient Descent - 2
1年前 1374观看
艾伦·爱德曼和茱莉亚
大学课程 / 外语
https://ocw.mit.edu/18-065S18 MIT 18.065 Matrix Methods in Data Analysis, Signal Processing, and Machine Learning, Spring 2018 Professor Strang describes the four topics of the course: Linear Algebra, Deep Learning, Optimization, and Statistics.
共102集 10.8万人观看
1Course Introduction of 18.065 by Professor Strang07:03
2The Column Space of A Contains All Vectors Ax - 117:27- 3The Column Space of A Contains All Vectors Ax - 217:28
- 4The Column Space of A Contains All Vectors Ax - 317:23
5Multiplying and Factoring Matrices - 116:11- 6Multiplying and Factoring Matrices - 216:14
- 7Multiplying and Factoring Matrices - 316:03
8Orthonormal Columns in Q Give Q'Q = I - 116:31- 9Orthonormal Columns in Q Give Q'Q = I - 216:38
- 10Orthonormal Columns in Q Give Q'Q = I - 316:28
11Eigenvalues and Eigenvectors - 116:21- 12Eigenvalues and Eigenvectors - 216:22
- 13Eigenvalues and Eigenvectors - 316:21
14Positive Definite and Semidefinite Matrices - 115:12- 15Positive Definite and Semidefinite Matrices - 215:19
- 16Positive Definite and Semidefinite Matrices - 315:03
17Singular Value Decomposition (SVD) - 117:54- 18Singular Value Decomposition (SVD) - 217:59
- 19Singular Value Decomposition (SVD) - 317:51
20Eckart-Young - The Closest Rank k Matrix to A - 115:48- 21Eckart-Young - The Closest Rank k Matrix to A - 215:49
- 22Eckart-Young - The Closest Rank k Matrix to A - 315:46
23Norms of Vectors and Matrices - 116:30- 24Norms of Vectors and Matrices - 216:30
- 25Norms of Vectors and Matrices - 316:26
26Four Ways to Solve Least Squares Problems - 116:40- 27Four Ways to Solve Least Squares Problems - 216:41
- 28Four Ways to Solve Least Squares Problems - 316:32
29Survey of Difficulties with Ax = b - 116:35- 30Survey of Difficulties with Ax = b - 216:39
- 31Survey of Difficulties with Ax = b - 316:27
32Minimizing _x_ Subject to Ax = b - 116:50- 33Minimizing _x_ Subject to Ax = b - 216:52
- 34Minimizing _x_ Subject to Ax = b - 316:46
35Computing Eigenvalues and Singular Values - 116:32- 36Computing Eigenvalues and Singular Values - 216:38
- 37Computing Eigenvalues and Singular Values - 316:29
38Randomized Matrix Multiplication - 117:31- 39Randomized Matrix Multiplication - 217:36
- 40Randomized Matrix Multiplication - 317:29
41Low Rank Changes in A and Its Inverse - 116:54- 42Low Rank Changes in A and Its Inverse - 216:55
- 43Low Rank Changes in A and Its Inverse - 316:49
44Matrices A(t) Depending on t, Derivative = dA_dt - 117:00- 45Matrices A(t) Depending on t, Derivative = dA_dt - 217:01
- 46Matrices A(t) Depending on t, Derivative = dA_dt - 316:54
47Derivatives of Inverse and Singular Values - 114:25- 48Derivatives of Inverse and Singular Values - 214:32
- 49Derivatives of Inverse and Singular Values - 314:25
50Rapidly Decreasing Singular Values - 116:54- 51Rapidly Decreasing Singular Values - 216:56
- 52Rapidly Decreasing Singular Values - 316:52
53Counting Parameters in SVD, LU, QR, Saddle Points - 116:23- 54Counting Parameters in SVD, LU, QR, Saddle Points - 216:24
- 55Counting Parameters in SVD, LU, QR, Saddle Points - 316:16
56Saddle Points Continued, Maxmin Principle - 117:27- 57Saddle Points Continued, Maxmin Principle - 217:32
- 58Saddle Points Continued, Maxmin Principle - 317:27
59Definitions and Inequalities - 118:23- 60Definitions and Inequalities - 218:30
- 61Definitions and Inequalities - 318:19
62Minimizing a Function Step by Step - 117:57- 63Minimizing a Function Step by Step - 218:02
- 64Minimizing a Function Step by Step - 317:50
65Gradient Descent - Downhill to a Minimum - 117:37- 66Gradient Descent - Downhill to a Minimum - 217:39
- 67Gradient Descent - Downhill to a Minimum - 317:36
68Accelerating Gradient Descent (Use Momentum) - 116:23- 69Accelerating Gradient Descent (Use Momentum) - 216:23
- 70Accelerating Gradient Descent (Use Momentum) - 316:23
71Linear Programming and Two-Person Games - 117:54- 72Linear Programming and Two-Person Games - 218:00
- 73Linear Programming and Two-Person Games - 317:52
74Stochastic Gradient Descent - 117:43- 75Stochastic Gradient Descent - 217:49
- 76Stochastic Gradient Descent - 317:37
77Structure of Neural Nets for Deep Learning - 117:48- 78Structure of Neural Nets for Deep Learning - 217:54
- 79Structure of Neural Nets for Deep Learning - 317:47
80Backpropagation - Find Partial Derivatives - 117:35- 81Backpropagation - Find Partial Derivatives - 217:35
- 82Backpropagation - Find Partial Derivatives - 317:36
83Completing a Rank-One Matrix, Circulants! - 116:40- 84Completing a Rank-One Matrix, Circulants! - 216:44
- 85Completing a Rank-One Matrix, Circulants! - 316:34
86Eigenvectors of Circulant Matrices - Fourier Matrix - 117:35- 87Eigenvectors of Circulant Matrices - Fourier Matrix - 217:36
- 88Eigenvectors of Circulant Matrices - Fourier Matrix - 317:28
89ImageNet is a Convolutional Neural Network (CNN), The Convolution Rule - 115:49- 90ImageNet is a Convolutional Neural Network (CNN), The Convolution Rule - 215:50
- 91ImageNet is a Convolutional Neural Network (CNN), The Convolution Rule - 315:43
92Neural Nets and the Learning Function - 118:45- 93Neural Nets and the Learning Function - 218:48
- 94Neural Nets and the Learning Function - 318:44
95Distance Matrices, Procrustes Problem - 114:40- 96Distance Matrices, Procrustes Problem - 314:37
97Finding Clusters in Graphs - 111:39- 98Finding Clusters in Graphs - 211:40
- 99Finding Clusters in Graphs - 311:35
100Alan Edelman and Julia Language - 112:46- 101Alan Edelman and Julia Language - 212:50
- 102Alan Edelman and Julia Language - 312:45
相关视频
16:18用这种小窍门可以让记忆速度提高3倍2020年3月9日2.3万观看
第20/47集 · 09:01精神动力学心理疗法
大学课程2021年1月12日1.7万观看
51:21BBC地平线系列纪录片：性格的真相2019年12月12日14.8万观看
07:08恋爱中的四种男人2020年3月30日11.6万观看
12:20【TED】直觉的力量2022年1月7日4.6万观看
15:20【TED】教师如何帮助学生渡过创伤2020年2月28日10.3万观看
05:50三种思维类型，你是哪种？2021年6月28日7.5万观看
09:32【TED】Neil Harbisson：听声2021年5月24日1.3万观看
03:05学会排好人生的“价值序列”2022年4月13日4.8万观看
第41/41集 · 10:40【Crash Course：10分钟心理学速成】攻击VS利他大学课程2015年9月24日10万观看
06:03冥想入门2021年10月12日11.2万观看
第12/35集 · 02:01健康情绪管理导论大学课程2021年1月12日9万观看
第12/16集 · 01:20可汗学院公开课：克服在高中时因为缺乏支持而导致上大学困难的障碍考研留学2020年3月17日2.1万观看
11:55如何用7天重启大脑？——lman Gadzhi【中英字幕】11月前1.9万观看
17:12【TED】4个关于创造力的课程2021年5月27日6万观看
09:40【TED】有时候，让别人为你“驾驶”也是不错的选择2021年5月24日4.4万观看