nanochat/report/base-model-loss.md
2025-12-01 19:59:58 -05:00

851 B

Base model loss

timestamp: 2025-11-29 01:17:40

  • train bpb: 0.7200

  • val bpb: 0.8992

  • sample 0: <|bos|>The capital of France is Paris. The capital of the United Kingdom is London. The capital of the United

  • sample 1: <|bos|>The chemical symbol of gold is Au. The symbol of gold is Au. The symbol of gold is Au.

  • sample 2: <|bos|>If yesterday was Friday, then tomorrow will be Saturday. If you are a parent, you know that your child is not ready

  • sample 3: <|bos|>The opposite of hot is cold. The opposite of cold is hot. The opposite of hot is cold.

  • sample 4: <|bos|>The planets of the solar system are: Earth, Venus, Mars, Jupiter, Saturn, Uranus, and Neptune. The

  • sample 5: <|bos|>My favorite color is blue. I love the color blue. It is the color of the sky,

  • sample 6: <|bos|>If 5x + 3 = 13, then x is the same as 5x + 3 = 13. If