🥝 Daniël de Kok

Recent Notes

  • Nix Overlays

    Nov 08, 2026

  • Software

    Nov 08, 2026

  • MoErgo Glove80 Review

    May 31, 2026

Home

❯

Machine Learning

Machine Learning

May 30, 20261 min read

  • moc

Model building blocks

  • Dish Activation
  • Attention Mechanisms
  • Logit Softcapping

Multi-GPU

  • Model Parallelism:
    • Tensor Parallelism

Quantization

  • Quantizer Notation
  • GPTQ Checkpoint Format

    • Model building blocks
    • Multi-GPU
    • Quantization

    Created with Quartz v5.0.0 © 2026

    • All pages are human-written