CODE LLM

Model	Pass@1	License	机构	Respository
CodeGen-16B-multi	19.2	开源	Salesforce	Salesforce/codegen-16B-multi at main https://github.com/salesforce/CodeGen
CodeGeeX-13B	22.9	开源	清华大学	https://github.com/THUDM/CodeGeeX
Codex-12B	28.8	不开源	OpenAI
CodeT5Plus-16B-mono	30.9	开源	Salesforce	Salesforce/codet5p-16b · Hugging Face
Code-Cushman-001	33.5	不开源	OpenAI
LLaMA-65B	23.7	开源	Meta
LLaMA2-70B	29.9	开源	Meta	https://huggingface.co/meta-llama/Llama-2-70b
CodeGen2.5-7B-mono	33.4	开源	Salesforce	https://github.com/salesforce/CodeGen/tree/main/codegen25?ref=blog.salesforceairesearch.com
StarCoder-15B	33.2	开源	BigCode	bigcode/starcoder · Hugging Face
CodeGeeX2-6B	35.9	开源	清华大学	GitHub - THUDM/CodeGeeX2: CodeGeeX2: A More Powerful Multilingual Code Generation Model
GPT-3.5 - OpenAI	48.1	不开源	OpenAI
WizardCoder-15B	57.3	OpenRAIL-M	微软	WizardLM/WizardCoder-15B-V1.0 · Hugging Face
PanGu-Coder2	61.64	不开源	华为	https://arxiv.org/abs/2307.14936
GPT-4 - OpenAI	67.0	不开源	OpenAI

reference:

https://github.com/abacaj/code-eval

LMSYS Org

Chatbot Arena Leaderboard - a Hugging Face Space by lmsys

WizardLM/WizardLM-30B-V1.0 · Hugging Face

https://github.com/QwenLM/Qwen-7B

https://github.com/THUDM/ChatGLM2-6B