AI / ML VisualizerRuns in your browser · No API keyOpen Model
← All topics

Sequence Models

LSTM

Inspect forget, input and output gates along the cell-state highway.

An LSTM manages memory: keep some information, add new information, and expose an output.

Why do we need this? Gates help recurrent networks preserve useful information across a sequence.

Memory through time · observation 1 of 5Memory through time · observation 1 of 5x1: 1x2: 0x3: -1x4: 0.5x5: 0Memory stream →1 ›0 ›Forget 0.81760Input gate 0.69 × candidate 0.76160.5255New memoryOutput gate 0.64570.3112 ›Hidden stateOne scalar memory cell · gates scale information rather than choosing literal words
Memory stream →Active gate / moving value
STEP 1 OF 35

Time 1: Read the current input

A new number enters this scalar LSTM. This demonstration uses numeric observations, not a trained language model.

No account required. Local images and model files stay in your browser. Educational models demonstrate mechanisms; they are not production predictors.