Tag: QLoRA

Machine Learning

Multi-GPUs Superb-tuning for Llama 3.1 70B with FSDP and QLoRA

August 9, 2024
roosho

What you are able to do with solely 2×24 GB GPUs and lots of CPU RAM…