model-merging
Orchestra-Research/AI-Research-SKILLs
Utilize Mergekit to merge multiple fine-tuned models via SLERP, TIES, DARE, Task Arithmetic, and linear merging; perfect for preserving diverse domain skills, improving benchmark performance, and experimenting with new combinations without retraining.