Validation-based Decay
3 explanations from your library.
12:07IIT Madras (NPTEL)
Learning Rate Decay
“the performance on the validation data improves, you decline, you decrease the earning rate by a certain fixed factor, okay. trial and error or some systematic search that we saw earlier okay.”
20:21NPTEL: Practical ML with TensorFlow
Underfitting and Overfitting in Practice
“So what happens if we look at the learning curves, we observe that the training error and validation error both reduce to begin with.”
Closest moment in this session: it teaches the idea without listing it as a key concept.
31:41Prof. Prabir Kumar Biswas, IIT Kharagpur
From AdaGrad to RMSProp
“And in case of RMS prop instead of using this cumulative or accumulative sum of squared gradients the RMS prop takes exponentially decaying average of the squared gradient and”
Closest moment in this session: it teaches the idea without listing it as a key concept.
Cloudinary under the hood2 Cloudinary URLs make this page. No render servers: each one is generated on request and cached.
Compare reel
3 explanations of this concept, from different sessions, spliced into one video with fl_splice. Each clip is labelled with its speaker.
…/video/upload/so_125.7,eo_143.3,w_1280,h_720,c_fill/l_video:pravaha:ff809418-9768-43d9-ab11-dd64c8941e4d,fl_spl…/so_19.5,eo_30.8,w_1280,h_720,c_fill/fl_layer_apply/fl_layer_apply,g_north_west,x_40,y_40,so_28.9,eo_45.3/f_auto:video,q_auto/pravaha/2b17046e-fb2d-4a2c-ad2c-e84a76f8c28a.mp4
- so_125.7
- starts at 125.7 s · and 5 more like it
- eo_143.3
- ends at 143.3 s · and 5 more like it
- w_1280
- 1280 px wide · and 2 more like it
- h_720
- 720 px tall · and 2 more like it
- c_fill
- crops to fill the frame exactly · and 2 more like it
- l_video:pravaha:ff809418-97…
- another video (pravaha/ff809418-9768-43d9-ab11-dd64c8941e4d) as a layer
- fl_splice
- joins the next clip onto the end of this one · and 1 more like it
- fl_layer_apply
- places the layer defined just before · and 4 more like it
- l_video:pravaha:1ba747ae-bd…
- another video (pravaha/1ba747ae-bdb0-43b5-bd11-8a0eda32a02c) as a layer
- l_text:arial_34_bold:1%20%C…
- text layer “1 · IIT Madras (NPTEL)” · and 2 more like it
- co_white
- text colour white · and 2 more like it
- b_rgb:0f766ecc
- background #0f766ecc · and 2 more like it
- g_north_west
- anchored to the top-left corner · and 2 more like it
- x_40
- 40 px from the side · and 2 more like it
- y_40
- 40 px from the edge · and 2 more like it
- f_auto:video
- best format for each device (e.g. AV1, WebM, MP4, WebP)
- q_auto
- AI-chosen quality: smallest file that still looks right
Explanation thumbnail
The frame at that moment, cropped around the speaker by AI.
…/video/upload/so_127.2,c_fill,ar_16:9,w_640,g_auto/f_auto,q_auto/pravaha/2b17046e-fb2d-4a2c-ad2c-e84a76f8c28a.jpg
- so_127.2
- starts at 127.2 s
- c_fill
- crops to fill the frame exactly
- ar_16:9
- aspect ratio 16 : 9
- w_640
- 640 px wide
- g_auto
- AI picks the focus (the speaker or slide), not a blind centre crop
- f_auto
- best format for each device (e.g. AV1, WebM, MP4, WebP)
- q_auto
- AI-chosen quality: smallest file that still looks right
Want a guided order, basics first? Turn Validation-based Decay into a short course →