Custom Fine-Tuning for Domain-Specific LLMs

Fine-tuning a large language model (LLM) is the process of taking a pre-trained model — usually a vast one like GPT or Llama models, with millions to billions of weights — and continuing to train it, exposing it to new data so that the model weights (or typically parts of them) get updated.

source https://machinelearningmastery.com/custom-fine-tuning-for-domain-specific-llms/