2023年7月18日Meta开源了Llama2,在2万亿个Token上训练,可用于商业和研究,包括从7B到70B模型权重、预训练和微调的代码。相比Llama1,Llama2有较多提升,评估结果如下所示:
基于Llama2模型的开源模型如下所示:
1.WizardCoder Python V1.0
https://huggingface.co/WizardLM/WizardCoder-Python-13B-V1.0
https://huggingface.co/WizardLM/WizardCoder-Python-34B-V1.0
2.Phind Code Llama v1
https://huggingface.co/Phind/Phind-CodeLlama-34B-v1
https://huggingface.co/Phind/Phind-CodeLlama-34B-Python-v1
3.WizardLM 70B V1.0
https://huggingface.co/WizardLM/WizardLM-70B-V1.0
4.Dophin Llama 2 7B
https://huggingface.co/ehartford/dolphin-llama2-7b
5.Airoboros L2 2.0
https://huggingface.co/jondurbin/airoboros-l2-7b-gpt4-2.0
https://huggingface.co/jondurbin/airoboros-l2-13b-gpt4-2.0
https://huggingface.co/jondurbin/airoboros-33b-gpt4-2.0
https://huggingface.co/jondurbin/airoboros-l2-70b-gpt4-2.0
6.OpenOrca Preview2 13B
https://huggingface.co/Open-Orca/OpenOrcaxOpenChat-Preview2-13B
7.Vicuna v1.5 16k
https://huggingface.co/lmsys/vicuna-7b-v1.5-16k
https://huggingface.co/lmsys/vicuna-13b-v1.5-16k
8.Vicuna v1.5
https://huggingface.co/lmsys/vicuna-7b-v1.5
https://huggingface.co/lmsys/vicuna-13b-v1.5
9.Hermes LLongMA-2 8k
https://huggingface.co/conceptofmind/Hermes-LLongMA-2-7b-8k
https://huggingface.co/conceptofmind/Hermes-LLongMA-2-13b-8k
10.OpenChat V3.2
https://huggingface.co/openchat/openchat_v3.2
11.Llama 2 70B Instruct v2
https://huggingface.co/upstage/Llama-2-70b-instruct-v2
12.StableBeluga
https://huggingface.co/stabilityai/StableBeluga-7B
https://huggingface.co/stabilityai/StableBeluga-13B
https://huggingface.co/stabilityai/StableBeluga2
13.Holodeck
https://huggingface.co/KoboldAI/LLAMA2-13B-Holodeck-1
https://huggingface.co/KoboldAI/LLAMA2-13B-Holodeck-1-GGML
14.Llama 2 7B 32K
https://huggingface.co/togethercomputer/LLaMA-2-7B-32K
15.Kimiko
https://huggingface.co/nRuaif/Kimiko_7B
https://huggingface.co/nRuaif/Kimiko_13B
v16.LLongMA 2 16k**
https://huggingface.co/conceptofmind/LLongMA-2-7b-16k
https://huggingface.co/conceptofmind/LLongMA-2-13b-16k
17.Airoboros L2 GPT4 1.4.1
https://huggingface.co/jondurbin/airoboros-l2-7b-gpt4-1.4.1
https://huggingface.co/jondurbin/airoboros-l2-13b-gpt4-1.4.1
https://huggingface.co/jondurbin/airoboros-l2-70b-gpt4-1.4.1
**18.Llama 2 13B Orca 8kv
https://huggingface.co/OpenAssistant/llama2-13b-orca-8k-3319
19.WizardLM 13B V1.2
https://huggingface.co/WizardLM/WizardLM-13B-V1.2
20.LLongMA 2 8k
https://huggingface.co/conceptofmind/LLongMA-2-7b
https://huggingface.co/conceptofmind/LLongMA-2-13b
21.Nous Hermes Llama 2
https://huggingface.co/NousResearch/Nous-Hermes-llama-2-7b
https://huggingface.co/NousResearch/Nous-Hermes-llama-2-7b-GGML
https://huggingface.co/NousResearch/Nous-Hermes-Llama2-13b
https://huggingface.co/NousResearch/Nous-Hermes-Llama2-13b-GGML
https://huggingface.co/NousResearch/Nous-Hermes-Llama2-13b-GPTQ
22.Redmond Puffin 13B
https://huggingface.co/NousResearch/Redmond-Puffin-13B
https://huggingface.co/NousResearch/Redmond-Puffin-13B-GGML
23.Llama 2 7B Uncensored
https://huggingface.co/georgesung/llama2_7b_chat_uncensored
24.Luna AI 7B Chat Uncensored
https://huggingface.co/Tap-M/Luna-AI-Llama2-Uncensored
25.Guanaco Llama 2
https://huggingface.co/Mikael110/llama-2-7b-guanaco-fp16
https://huggingface.co/Mikael110/llama-2-13b-guanaco-fp16
https://huggingface.co/Mikael110/llama-2-70b-guanaco-qlora
26.Chinese Llama 2 7B
https://github.com/LinkSoul-AI/Chinese-Llama-2-7b
27.llama2-Chinese-chat
https://github.com/CrazyBoyM/llama2-Chinese-chat
参考文献:
[1]https://github.com/facebookresearch/llama
[2]https://github.com/facebookresearch/llama-recipes/
[3]https://ai.meta.com/resources/models-and-libraries/llama-downloads/
[4]https://github.com/facebookresearch/llama/blob/main/MODEL_CARD.md
[5]https://ai.meta.com/research/publications/llama-2-open-foundation-and-fine-tuned-chat-models/
[6]https://ai.meta.com/resources/models-and-libraries/llama/
[7]https://github.com/ovh/ai-training-examples/blob/main/notebooks/natural-language-processing/llm/miniconda/llama2-fine-tuning/llama_2_finetuning.ipynb
[8]https://blog.ovhcloud.com/fine-tuning-llama-2-models-using-a-single-gpu-qlora-and-ai-notebooks/
[9]https://www.reddit.com/r/LocalLLaMA/wiki/models/
[10]大模型评测:https://opencompass.org.cn/