SCAO — Optimizer
ストックにはログインが必要です
I built a 2nd-order optimizer for LLMs.
Artificial Intelligence
GitHub
54% faster LLM training. SCAO is a sparse, second-order PyTorch optimizer designed as a high-throughput, drop-in replacement for AdamW. - whispering3/scao
投票数: 2