Show HN: Mistral NeMo finetuning fits in Colab https://ift.tt/rvIeswX

Show HN: Mistral NeMo finetuning fits in Colab Managed to make Mistral NeMO 12b https://ift.tt/WrF9qPG fit in a free Google Colab with a Tesla T4 GPU (16GB) for 4bit QLoRA finetuning! Managed to shave 60% VRAM usage and made it 2x faster as well! It should work in under 12GB of VRAM as well! https://ift.tt/dZltAh0 July 19, 2024 at 10:06PM