Skip to content

← Concept map

Exponentially Decaying Average

2 explanations from your library.

  1. From AdaGrad to RMSProp, at 1:4111:41

    Prof. Prabir Kumar Biswas, IIT Kharagpur

    From AdaGrad to RMSProp

    “And in case of RMS prop instead of using this cumulative or accumulative sum of squared gradients the RMS prop takes exponentially decaying average of the squared gradient and”

    Closest moment in this session: it teaches the idea without listing it as a key concept.

    Open full session

    Moment · 1:41

    From AdaGrad to RMSProp

    Full session
  2. Learning Rate Decay, at 2:2522:25

    IIT Madras (NPTEL)

    Learning Rate Decay

    “One of the more automated ways are also to ensure a very smooth decay. So for instance we in the previous techniques we saw you manually or not manually you set”

    Closest moment in this session: it teaches the idea without listing it as a key concept.

    Open full session

    Moment · 2:25

    Learning Rate Decay

    Full session
Cloudinary under the hood2 Cloudinary URLs make this page. No render servers: each one is generated on request and cached.

  • Compare reel

    2 explanations of this concept, from different sessions, spliced into one video with fl_splice. Each clip is labelled with its speaker.

    Open ↗

    …/video/upload/so_99.5,eo_115.9,w_1280,h_720,c_fill/l_video:pravaha:2b17046e-fb2d-4a2c-ad2c-e84a76f8c28a,fl_spl…/so_144,eo_159.5,w_1280,h_720,c_fill/fl_layer_apply/fl_layer_apply,g_north_west,x_40,y_40,so_16.4,eo_31.9/f_auto:video,q_auto/pravaha/1ba747ae-bdb0-43b5-bd11-8a0eda32a02c.mp4

    so_99.5
    starts at 99.5 s · and 3 more like it
    eo_115.9
    ends at 115.9 s · and 3 more like it
    w_1280
    1280 px wide · and 1 more like it
    h_720
    720 px tall · and 1 more like it
    c_fill
    crops to fill the frame exactly · and 1 more like it
    l_video:pravaha:2b17046e-fb…
    another video (pravaha/2b17046e-fb2d-4a2c-ad2c-e84a76f8c28a) as a layer
    fl_splice
    joins the next clip onto the end of this one
    fl_layer_apply
    places the layer defined just before · and 2 more like it
    l_text:arial_34_bold:1%20%C…
    text layer “1 · Prof. Prabir Kumar Biswas” · and 1 more like it
    co_white
    text colour white · and 1 more like it
    b_rgb:0f766ecc
    background #0f766ecc · and 1 more like it
    g_north_west
    anchored to the top-left corner · and 1 more like it
    x_40
    40 px from the side · and 1 more like it
    y_40
    40 px from the edge · and 1 more like it
    f_auto:video
    best format for each device (e.g. AV1, WebM, MP4, WebP)
    q_auto
    AI-chosen quality: smallest file that still looks right

  • Explanation thumbnail

    The frame at that moment, cropped around the speaker by AI.

    Open ↗

    …/video/upload/so_101,c_fill,ar_16:9,w_640,g_auto/f_auto,q_auto/pravaha/1ba747ae-bdb0-43b5-bd11-8a0eda32a02c.jpg

    so_101
    starts at 101 s
    c_fill
    crops to fill the frame exactly
    ar_16:9
    aspect ratio 16 : 9
    w_640
    640 px wide
    g_auto
    AI picks the focus (the speaker or slide), not a blind centre crop
    f_auto
    best format for each device (e.g. AV1, WebM, MP4, WebP)
    q_auto
    AI-chosen quality: smallest file that still looks right

Want a guided order, basics first? Turn Exponentially Decaying Average into a short course →