f-dangel/backobsPython
Use DeepOBS with BackPACK
(2 stars) (3 forks) (1 indexed issue) (1 open good first issue)
Repositories
Use DeepOBS with BackPACK
PyTorch linear operators for curvature matrices (Hessian, Fisher/GGN, KFAC, ...)
[ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)
Code and tutorial on integrating wandb sweeps with Slurm pre-emption