Fine tuning LLM

“Take a trained LLM, sometimes called Base LLM. You can download them from HuggingFace. Prepare your training data. You only need to compile instructions and responses. Here’s an example of such a dataset. You can also generate synthetic data using GPT-4. Choose a suitable fine-tuning method. LoRA and QLoRA are currently popular. Fine-tune the model on new data.”