Jump to content

File:Grokking modular addition.jpg

Page contents not supported in other languages.
This is a file from the Wikimedia Commons
From Wikipedia, the free encyclopedia

Original file (1,280 × 720 pixels, file size: 87 KB, MIME type: image/jpeg)

Summary

Description
English: Training and test loss curves from multiple runs showing the sudden emergence of generalization ("grokking") in a neural network learning modular addition. Created in the context of a paper replication walkthrough of "Progress measures for grokking via mechanistic interpretability".
Date
Source https://www.neelnanda.io/mechanistic-interpretability (also the thumbnail of this video: https://www.youtube.com/watch?v=ob4vuiqG2Go)
Author Neel Nanda
Permission
(Reusing this file)

Licensing

w:en:Creative Commons
attribution share alike
This file is licensed under the Creative Commons Attribution-Share Alike 4.0 International license.
You are free:
  • to share – to copy, distribute and transmit the work
  • to remix – to adapt the work
Under the following conditions:
  • attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
  • share alike – If you remix, transform, or build upon the material, you must distribute your contributions under the same or compatible license as the original.

Captions

Training and test loss curves from multiple runs showing the sudden emergence of generalization ("grokking") in a neural network learning modular addition

In dieser Datei abgebildete Objekte

depicts

12 March 2023

89,252 byte

720 pixel

1,280 pixel

image/jpeg

d7250e7950f52714a0b58ab03593054d95bdf95c

File history

Click on a date/time to view the file as it appeared at that time.

Date/TimeThumbnailDimensionsUserComment
current01:09, 20 January 2025Thumbnail for version as of 01:09, 20 January 20251,280 × 720 (87 KB)AlenoachUploaded a work by Neel Nanda from https://www.neelnanda.io/mechanistic-interpretability (also the thumbnail of this video: https://www.youtube.com/watch?v=ob4vuiqG2Go) with UploadWizard

Global file usage

The following other wikis use this file:

Metadata