Leaderboard

Chaiverse calculates the ELO of LLMs via human feedback, obtained through blind selection testing using the Chai app. This involves gathering positive and negative upvotes from randomly selected models on our leaderboard, as experienced by end users. With over one million samples a day, we are able to build a ranking of LLMs - which for our use-case, seems to be the most accurate.
Submit your model now, and start collecting feedback on your model’s ranking in under five minutes! Feel free to join us on our Discord server to discuss the leaderboard and chat with other participants!

Submissions in the last 24 hours: 6

1 hour ago by chai_backend_admin 🚀

Model: blend_gofuk_2024-10-09

HuggingFace: N/A

Model Size: N/A

Elo: N/A

Human feedbacks: 0

1 hour ago by azuruce 🚀

Model: vdr1-sunfall-nemomix-unl_5157_v2

HuggingFace: N/A

Model Size: N/A

Elo: N/A

Human feedbacks: 0

2 hours ago by azuruce 🚀

Model: thedrummer-cydonia-22b-v1-1_v1

HuggingFace: N/A

Model Size: N/A

Elo: N/A

Human feedbacks: 0

2 hours ago by azuruce 🚀

Model: vdr1-sunfall-nemomix-unl_5157_v1

HuggingFace: N/A

Model Size: N/A

Elo: N/A

Human feedbacks: 0

2 hours ago by azuruce 🚀

Model: sao10k-mn-backyardai-par_1350_v2

HuggingFace: N/A

Model Size: N/A

Elo: N/A

Human feedbacks: 0

2 hours ago by azuruce 🚀

Model: nbeerbower-mistral-nemo-_9180_v1

HuggingFace: N/A

Model Size: N/A

Elo: N/A

Human feedbacks: 0

2 hours ago by azuruce 🚀

Model: migtissera-tess-3-mistra_7953_v1

HuggingFace: N/A

Model Size: N/A

Elo: N/A

Human feedbacks: 0

2 hours ago by azuruce 🚀

Model: axolotl-ai-co-romulus-mi_7539_v4

HuggingFace: N/A

Model Size: N/A

Elo: N/A

Human feedbacks: 0

2 hours ago by azuruce 🚀

Model: anthracite-org-magnum-v2_6820_v2

HuggingFace: N/A

Model Size: N/A

Elo: N/A

Human feedbacks: 0

2 hours ago by azuruce 🚀

Model: abacusai-bigstral-12b-32k_v1

HuggingFace: N/A

Model Size: N/A

Elo: N/A

Human feedbacks: 0

Model Developer	Developer Rank	Model Rank	Model Rank By Developer	Elo Rating	Elo Rating By Developer	Family Friendly	Family Friendly By Developer	Submission ID	Parameters	Huggingface Repository	Variant	Number of Battles	Number of Battles By Developer	Win Ratio	Win Ratio By Developer	Type	Best of	Max Input Tokens	Max Output Tokens	Model Architecture	Model Group	Date	Ranking Group	Thoughput	GPU Counts
rica40325	1	1.0	1.0	1297.21	1297.21	0.58	0.58	rica40325-dpo-1008-5162s_v4	13B	rica40325/dpo_1008_5162s	rica40325-dpo-1008-5162s_v4	6562	1806470	0.56	0.56	basic	8.0	1024.0	64.0	MistralForCausalLM	rica40325/dpo_1008_5162s	2024-10-08	single
rica40325	1	2.0	1.0	1294.27	1297.21	0.58	0.58	rica40325-dpo-1008-5162s_v2	13B	rica40325/dpo_1008_5162s	rica40325-dpo-1008-5162s_v2	6577	1806470	0.55	0.56	basic	8.0	1024.0	64.0	MistralForCausalLM	rica40325/dpo_1008_5162s	2024-10-08	single
shiroe40	2	3.0	3.0	1292.01	1292.01	0.54	0.57	cycy233-nemo-p-e-v0-c2_v1	13B	cycy233/nemo-p-e-v0-c2	auto	19308	16838687	0.55	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	cycy233/nemo-p-e-v0-c2	2024-09-19	single	1.24	{'NVIDIA RTX A5000': 1}
Riverise	3	4.0	4.0	1289.84	1289.84	0.57	0.57	rica40325-dpo-1008-5162s_v5	13B	rica40325/dpo_1008_5162s	rica40325-dpo-1008-5162s_v4	6301	1680117	0.55	0.55	basic	8.0	1024.0	64.0	MistralForCausalLM	rica40325/dpo_1008_5162s	2024-10-08	single
rica40325	1	5.0	1.0	1289.71	1297.21	0.58	0.58	rica40325-mistral-test1_v4	13B	rica40325/mistral-test1	rica40325-mistral-test1_v1	102937	1806470	0.55	0.56	basic	8.0	1024.0	64.0	MistralForCausalLM	rica40325/mistral-test1	2024-09-29	single
shiroe40	2	6.0	3.0	1289.52	1292.01	0.54	0.57	cycy233-nemo-p-e-v0-c3_v1	13B	cycy233/nemo-p-e-v0-c3	auto	19635	16838687	0.55	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	cycy233/nemo-p-e-v0-c3	2024-09-19	single	1.2	{'NVIDIA RTX A5000': 1}
rica40325	1	7.0	1.0	1288.89	1297.21	0.58	0.58	rica40325-mistral-test1_v3	13B	rica40325/mistral-test1	rica40325-mistral-test1_v1	112841	1806470	0.55	0.56	basic	8.0	1024.0	64.0	MistralForCausalLM	rica40325/mistral-test1	2024-09-29	single
shiroe40	2	8.0	3.0	1287.17	1292.01	0.54	0.57	cycy233-nemo-p-e-v0-c1_v1	13B	cycy233/nemo-p-e-v0-c1	auto	19524	16838687	0.55	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	cycy233/nemo-p-e-v0-c1	2024-09-19	single	1.23	{'NVIDIA RTX A5000': 1}
PawanOsman	4	9.0	9.0	1286.73	1286.73	0.57	0.58	pawankrd-cosmosrp-12b_v16	13B	PawanKrd/CosmosRP-12b	pawankrd-cosmosrp-12b_v16	7463	4558129	0.54	0.75	basic	8.0	2048.0	64.0	MistralForCausalLM	PawanKrd/CosmosRP-12b	2024-10-06	single
shiroe40	2	10.0	3.0	1285.78	1292.01	0.0	0.57	cycy233-nemo-p-e-v0-c4_v1	13B	cycy233/nemo-p-e-v0-c4	auto	13049	16838687	0.55	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	cycy233/nemo-p-e-v0-c4	2024-09-19	single	1.24	{'NVIDIA RTX A5000': 1}
shiroe40	2	11.0	3.0	1285.75	1292.01	0.0	0.57	cycy233-nemo-p-e-v2-c4_v1	13B	cycy233/nemo-p-e-v2-c4	auto	64494	16838687	0.56	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	cycy233/nemo-p-e-v2-c4	2024-09-22	single	1.18	{'NVIDIA RTX A5000': 1}
shiroe40	2	12.0	3.0	1285.58	1292.01	0.0	0.57	cycy233-l3-e-v2-c1_v36	8B	cycy233/L3-e-v2-c1	auto	11858	16838687	0.57	0.61	basic	16.0	512.0	64.0	LlamaForCausalLM	cycy233/L3-e-v2-c1	2024-08-19	single
PawanOsman	4	13.0	9.0	1285.55	1286.73	0.56	0.58	pawankrd-cosmosrp-12b_v18	13B	PawanKrd/CosmosRP-12b	pawankrd-cosmosrp-12b_v18	7427	4558129	0.54	0.75	basic	8.0	2048.0	64.0	MistralForCausalLM	PawanKrd/CosmosRP-12b	2024-10-06	single
shiroe40	2	14.0	3.0	1285.37	1292.01	0.0	0.57	cycy233-nemo-p-e-v2-c3_v1	13B	cycy233/nemo-p-e-v2-c3	auto	64255	16838687	0.56	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	cycy233/nemo-p-e-v2-c3	2024-09-22	single	1.21	{'NVIDIA RTX A5000': 1}
PawanOsman	4	15.0	9.0	1284.66	1286.73	0.57	0.58	pawankrd-cosmosrp-12b_v17	13B	PawanKrd/CosmosRP-12b	pawankrd-cosmosrp-12b_v17	7289	4558129	0.54	0.75	basic	8.0	2048.0	64.0	MistralForCausalLM	PawanKrd/CosmosRP-12b	2024-10-06	single
shiroe40	2	16.0	3.0	1284.56	1292.01	0.0	0.57	cycy233-nemo-p-e-v2-c1_v1	13B	cycy233/nemo-p-e-v2-c1	auto	64800	16838687	0.56	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	cycy233/nemo-p-e-v2-c1	2024-09-22	single	1.2	{'NVIDIA RTX A5000': 1}
shiroe40	2	17.0	3.0	1283.49	1292.01	0.0	0.57	cycy233-nemo-p-e-v2-c2_v1	13B	cycy233/nemo-p-e-v2-c2	auto	64896	16838687	0.55	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	cycy233/nemo-p-e-v2-c2	2024-09-22	single	1.2	{'NVIDIA RTX A5000': 1}
shiroe40	2	18.0	3.0	1282.9	1292.01	0.0	0.57	cycy233-nemo-p-e-v3-c3_v1	13B	cycy233/nemo-p-e-v3-c3	auto	21067	16838687	0.56	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	cycy233/nemo-p-e-v3-c3	2024-09-23	single	1.2	{'NVIDIA RTX A5000': 1}
shiroe40	2	19.0	3.0	1281.99	1292.01	0.0	0.57	cycy233-nemo-p-e-v3-c2_v1	13B	cycy233/nemo-p-e-v3-c2	auto	20729	16838687	0.56	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	cycy233/nemo-p-e-v3-c2	2024-09-23	single	1.2	{'NVIDIA RTX A5000': 1}
shiroe40	2	20.0	3.0	1281.7	1292.01	0.0	0.57	cycy233-l3-e-v2-c1_v37	8B	cycy233/L3-e-v2-c1	auto	12901	16838687	0.58	0.61	basic	16.0	512.0	64.0	LlamaForCausalLM	cycy233/L3-e-v2-c1	2024-08-20	single
rica40325	1	21.0	1.0	1278.9	1297.21	0.57	0.58	rica40325-dpo-1008-5162s_v3	13B	rica40325/dpo_1008_5162s	rica40325-dpo-1008-5162s_v3	6675	1806470	0.53	0.56	basic	8.0	1024.0	64.0	MistralForCausalLM	rica40325/dpo_1008_5162s	2024-10-08	single
shiroe40	2	22.0	3.0	1278.43	1292.01	0.0	0.57	cycy233-nemo-p-e-v3-c1_v1	13B	cycy233/nemo-p-e-v3-c1	auto	20941	16838687	0.56	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	cycy233/nemo-p-e-v3-c1	2024-09-23	single	1.22	{'NVIDIA RTX A5000': 1}
sao10k	5	23.0	23.0	1278.01	1278.01	0.6	0.6	sao10k-mn-12b-vespa-x1_v2	13B	Sao10K/MN-12B-Vespa-x1	vespa-mistralml	5400	5148077	0.54	0.59	basic	8.0	1024.0	64.0	MistralForCausalLM	Sao10K/MN-12B-Vespa-x1	2024-10-01	single
shiroe40	2	24.0	3.0	1276.8	1292.01	0.0	0.57	cycy233-l3-e-v2-c1_v35	8B	cycy233/L3-e-v2-c1	auto	11838	16838687	0.56	0.61	basic	16.0	512.0	64.0	LlamaForCausalLM	cycy233/L3-e-v2-c1	2024-08-19	single
shiroe40	2	25.0	3.0	1275.02	1292.01	0.0	0.57	cycy233-l3-e-v2-c1_v32	8B	cycy233/L3-e-v2-c1	auto	11087	16838687	0.57	0.61	basic	16.0	512.0	64.0	LlamaForCausalLM	cycy233/L3-e-v2-c1	2024-08-18	single
PawanOsman	4	26.0	9.0	1275.01	1286.73	0.0	0.58	pawankrd-cosmosrp_v77	8B	PawanKrd/CosmosRP	pawankrd-cosmosrp_v77	13198	4558129	0.58	0.75	basic	16.0	512.0	64.0	LlamaForCausalLM	PawanKrd/CosmosRP	2024-07-20	single
shiroe40	2	27.0	3.0	1273.78	1292.01	0.0	0.57	cycy233-l3-e-v2-c4_v8	8B	cycy233/L3-e-v2-c4	auto	12324	16838687	0.58	0.61	basic	16.0	512.0	64.0	LlamaForCausalLM	cycy233/L3-e-v2-c4	2024-07-28	single
shiroe40	2	28.0	3.0	1273.25	1292.01	0.57	0.57	cycy233-nemo-p-p-v0-c2_v1	13B	cycy233/nemo-p-p-v0-c2	auto	6266	16838687	0.53	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	cycy233/nemo-p-p-v0-c2	2024-10-07	single
chace9580	6	29.0	29.0	1272.5	1272.5	0.56	0.6	jic062-dpo-v1-4-nemo_v7	13B	jic062/dpo-v1.4-Nemo	jic062-dpo-v1-4-nemo_v7	7861	3016771	0.53	0.55	basic	8.0	1024.0	64.0	MistralForCausalLM	jic062/dpo-v1.4-Nemo	2024-10-08	single
PawanOsman	4	30.0	9.0	1272.33	1286.73	0.0	0.58	pawankrd-cosmosrp_v76	8B	PawanKrd/CosmosRP	pawankrd-cosmosrp_v76	10908	4558129	0.58	0.75	basic	16.0	512.0	64.0	LlamaForCausalLM	PawanKrd/CosmosRP	2024-07-20	single
shiroe40	2	31.0	3.0	1272.26	1292.01	0.0	0.57	cycy233-l3-e-v2-c4_v2	8B	cycy233/L3-e-v2-c4	auto	7611	16838687	0.59	0.61	basic	16.0	512.0	64.0	LlamaForCausalLM	cycy233/L3-e-v2-c4	2024-07-19	single
shiroe40	2	32.0	3.0	1272.18	1292.01	0.0	0.57	cycy233-l3-ba-e-v-c2_v1	8B	cycy233/L3-ba-e-v-c2	auto	13620	16838687	0.57	0.61	basic	16.0	512.0	64.0	LlamaForCausalLM	cycy233/L3-ba-e-v-c2	2024-07-29	single
chace9580	6	33.0	29.0	1272.1	1272.5	0.0	0.6	jic062-dpo-v1-4-nemo_v3	13B	jic062/dpo-v1.4-Nemo	jic062-dpo-v1-4-nemo_v3	13006	3016771	0.53	0.55	basic	8.0	1024.0	64.0	MistralForCausalLM	jic062/dpo-v1.4-Nemo	2024-09-19	single	1.21	{'NVIDIA RTX A5000': 1}
shiroe40	2	34.0	3.0	1271.46	1292.01	0.56	0.57	cycy233-nemo-p-p-v0-c1_v2	13B	cycy233/nemo-p-p-v0-c1	auto	6289	16838687	0.53	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	cycy233/nemo-p-p-v0-c1	2024-10-07	single
PawanOsman	4	35.0	9.0	1271.21	1286.73	0.0	0.58	pawankrd-cosmosrp_v78	8B	PawanKrd/CosmosRP	pawankrd-cosmosrp_v78	12920	4558129	0.58	0.75	basic	16.0	512.0	64.0	LlamaForCausalLM	PawanKrd/CosmosRP	2024-07-20	single
PawanOsman	4	36.0	9.0	1270.96	1286.73	0.0	0.58	pawankrd-cosmosrp_v66	8B	PawanKrd/CosmosRP	pawankrd-cosmosrp_v66	353310	4558129	0.56	0.75	basic	16.0	512.0	64.0	LlamaForCausalLM	PawanKrd/CosmosRP	2024-07-13	single
chace9580	6	37.0	29.0	1270.71	1272.5	0.0	0.6	jic062-nemo-v1-1_v6	13B	jic062/Nemo-v1.1	jic062-nemo-v1-1_v6	13460	3016771	0.54	0.55	basic	8.0	1024.0	64.0	MistralForCausalLM	jic062/Nemo-v1.1	2024-09-23	single	1.21	{'NVIDIA RTX A5000': 1}
PawanOsman	4	38.0	9.0	1270.69	1286.73	0.0	0.58	pawankrd-cosmosrp_v73	8B	PawanKrd/CosmosRP	pawankrd-cosmosrp_v73	13819	4558129	0.61	0.75	basic	16.0	512.0	64.0	LlamaForCausalLM	PawanKrd/CosmosRP	2024-07-18	single
PawanOsman	4	39.0	9.0	1270.62	1286.73	0.0	0.58	pawankrd-cosmosrp_v79	8B	PawanKrd/CosmosRP	pawankrd-cosmosrp_v79	10793	4558129	0.57	0.75	basic	16.0	512.0	64.0	LlamaForCausalLM	PawanKrd/CosmosRP	2024-07-20	single
shiroe40	2	40.0	3.0	1270.51	1292.01	0.0	0.57	cycy233-l3-ba-e-v0-c4_v1	8B	cycy233/L3-ba-e-v0-c4	auto	12262	16838687	0.58	0.61	basic	16.0	512.0	64.0	LlamaForCausalLM	cycy233/L3-ba-e-v0-c4	2024-07-25	single