🥝 Daniël de Kok

Recent Notes

  • MoErgo Glove80 Review

    May 31, 2026

  • ZSA Voyager Review

    May 31, 2026

  • Short Bio

    May 31, 2026

Home

❯

Machine Learning

Machine Learning

May 30, 20261 min read

  • moc

Model building blocks

  • Dish Activation
  • Attention Mechanisms
  • Logit Softcapping

Multi-GPU

  • Model Parallelism:
    • Tensor Parallelism

Quantization

  • Quantizer Notation
  • GPTQ Checkpoint Format

    • Model building blocks
    • Multi-GPU
    • Quantization

    Created with Quartz v5.0.0 © 2026

    • All pages are human-written