You need to customize a pre-trained LLM to improve its efficiency on a narrow, specialized corpus. Which strategy provides the best balance between resource efficiency and domain performance?

Question

Answer

Increasing the size of the model and training only the output layers

Answer

Training a small LLM from scratch on the specialized corpus

Answer

Fine-tuning the entire model on the specialized corpus

Answer

Using Low-Rank Adaptation or other PEFT Techniques

Crowdly

You need to customize a pre-trained LLM to improve its efficiency on a narrow, s...

Want instant access to all verified answers on softserve.academy?