Leaderboard

Chaiverse calculates the ELO of LLMs via human feedback, obtained through blind selection testing using the Chai app. This involves gathering positive and negative upvotes from randomly selected models on our leaderboard, as experienced by end users. With over one million samples a day, we are able to build a ranking of LLMs - which for our use-case, seems to be the most accurate.
Submit your model now, and start collecting feedback on your model’s ranking in under five minutes! Feel free to join us on our Discord server to discuss the leaderboard and chat with other participants!

Submissions in the last 24 hours: 2

14 minutes ago by rinen0721 🚀

Model: rinen0721-mistral12b-1117_v3

HuggingFace: rinen0721/Mistral12b-1117

Model Size: 13B

Elo: N/A

Human feedbacks: 128

1 hour ago by chai_backend_admin 🚀

Model: chaiml-ezstorytellingsft_6474_v2

HuggingFace: N/A

Model Size: N/A

Elo: N/A

Human feedbacks: 0

3 hours ago by chai_backend_admin 🚀

Model: chaiml-ezstorytellingsft_6474_v1

HuggingFace: N/A

Model Size: N/A

Elo: N/A

Human feedbacks: 0

3 hours ago by chai_backend_admin 🚀

Model: function_nisun_2024-11-21

HuggingFace: N/A

Model Size: N/A

Elo: N/A

Human feedbacks: 0

3 hours ago by chai_backend_admin 🚀

Model: function_dojif_2024-11-21

HuggingFace: N/A

Model Size: N/A

Elo: N/A

Human feedbacks: 0

3 hours ago by chai_backend_admin 🚀

Model: function_horel_2024-11-21

HuggingFace: N/A

Model Size: N/A

Elo: N/A

Human feedbacks: 0

3 hours ago by chai_backend_admin 🚀

Model: function_taluk_2024-11-21

HuggingFace: N/A

Model Size: N/A

Elo: N/A

Human feedbacks: 0

3 hours ago by chai_backend_admin 🚀

Model: function_dodol_2024-11-21

HuggingFace: N/A

Model Size: N/A

Elo: N/A

Human feedbacks: 0

3 hours ago by chai_backend_admin 🚀

Model: function_fitus_2024-11-21

HuggingFace: N/A

Model Size: N/A

Elo: N/A

Human feedbacks: 0

3 hours ago by chai_backend_admin 🚀

Model: function_bufam_2024-11-21

HuggingFace: N/A

Model Size: N/A

Elo: N/A

Human feedbacks: 0

Model Developer	Developer Rank	Model Rank	Model Rank By Developer	Elo Rating	Elo Rating By Developer	Family Friendly	Family Friendly By Developer	Submission ID	Parameters	Huggingface Repository	Variant	Number of Battles	Number of Battles By Developer	Win Ratio	Win Ratio By Developer	Type	Best of	Max Input Tokens	Max Output Tokens	Model Architecture	Model Group	Date	Ranking Group	Thoughput	GPU Counts
rica40325	1	1.0	1.0	1302.47	1302.47	0.59	0.59	rica40325-10-14dpo_v2	13B	rica40325/10_14dpo	rica40325-10-14dpo_v1	7499	1909408	0.57	0.57	basic	8.0	1024.0	64.0	MistralForCausalLM	rica40325/10_14dpo	2024-10-14	single
Riverise	2	2.0	2.0	1299.66	1299.66	0.56	0.78	rica40325-linear-merge-1106_v3	13B	rica40325/linear_merge_1106	rica40325-linear-merge-1106_v1	14986	1950800	0.58	0.58	basic	8.0	1024.0	64.0	MistralForCausalLM	rica40325/linear_merge_1	2024-11-11	single	1.37	{'NVIDIA RTX A5000': 1}
Riverise	2	3.0	2.0	1297.77	1299.66	0.56	0.78	rica40325-10-14dpo_v5	13B	rica40325/10_14dpo	rica40325-10-14dpo_v1	15282	1950800	0.58	0.58	basic	8.0	1024.0	64.0	MistralForCausalLM	rica40325/10_14dpo	2024-11-01	single
rica40325	1	4.0	1.0	1297.21	1302.47	0.58	0.59	rica40325-dpo-1008-5162s_v4	13B	rica40325/dpo_1008_5162s	rica40325-dpo-1008-5162s_v4	6562	1909408	0.56	0.57	basic	8.0	1024.0	64.0	MistralForCausalLM	rica40325/dpo_1008_5162s	2024-10-08	single
Riverise	2	5.0	2.0	1296.5	1299.66	0.56	0.78	rica40325-linear-merge-1113_v1	13B	rica40325/linear_merge_1113	rica40325-linear-merge-1113_v1	14932	1950800	0.57	0.58	basic	8.0	1024.0	64.0	MistralForCausalLM	rica40325/linear_merge_1	2024-11-12	single	1.31	{'NVIDIA RTX A5000': 1}
rica40325	1	6.0	1.0	1295.4	1302.47	0.57	0.59	rica40325-kto-1017_v1	13B	rica40325/kto_1017	rica40325-kto-1017_v1	9605	1909408	0.56	0.57	basic	8.0	1024.0	64.0	MistralForCausalLM	rica40325/kto_1017	2024-10-17	single
rica40325	1	7.0	1.0	1295.03	1302.47	0.58	0.59	rica40325-10-14dpo_v1	13B	rica40325/10_14dpo	rica40325-10-14dpo_v1	8717	1909408	0.56	0.57	basic	8.0	1024.0	64.0	MistralForCausalLM	rica40325/10_14dpo	2024-10-14	single
rica40325	1	8.0	1.0	1294.27	1302.47	0.58	0.59	rica40325-dpo-1008-5162s_v2	13B	rica40325/dpo_1008_5162s	rica40325-dpo-1008-5162s_v2	6577	1909408	0.55	0.57	basic	8.0	1024.0	64.0	MistralForCausalLM	rica40325/dpo_1008_5162s	2024-10-08	single
rica40325	1	9.0	1.0	1293.74	1302.47	0.56	0.59	rica40325-10-14dpo_v6	13B	rica40325/10_14dpo	rica40325-10-14dpo_v1	12472	1909408	0.56	0.57	basic	8.0	1024.0	64.0	MistralForCausalLM	rica40325/10_14dpo	2024-11-12	single	1.32	{'NVIDIA RTX A5000': 1}
Bbbrun0	3	10.0	10.0	1293.33	1293.33	0.56	0.59	bbchicago-nana-nemo-12b-v1-0_v8	13B	BBChicago/Nana-nemo-12B_v1.0	bbchicago-nana-nemo-12b-v1-0_v1	12246	3787999	0.58	0.59	basic	8.0	1024.0	64.0	MistralForCausalLM	BBChicago/Nana-nemo-12B_	2024-10-13	single
Riverise	2	11.0	2.0	1292.92	1299.66	0.56	0.78	rica40325-linear-merge-1106_v1	13B	rica40325/linear_merge_1106	rica40325-linear-merge-1106_v1	19054	1950800	0.57	0.58	basic	8.0	1024.0	64.0	MistralForCausalLM	rica40325/linear_merge_1	2024-11-06	single
Riverise	2	12.0	2.0	1292.47	1299.66	0.57	0.78	rica40325-10-14dpo_v7	13B	rica40325/10_14dpo	rica40325-10-14dpo_v1	15060	1950800	0.56	0.58	basic	8.0	1024.0	64.0	MistralForCausalLM	rica40325/10_14dpo	2024-11-12	single	1.31	{'NVIDIA RTX A5000': 1}
shiroe40	4	13.0	13.0	1292.01	1292.01	0.54	0.57	cycy233-nemo-p-e-v0-c2_v1	13B	cycy233/nemo-p-e-v0-c2	auto	19308	16838687	0.55	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	cycy233/nemo-p-e-v0-c2	2024-09-19	single	1.24	{'NVIDIA RTX A5000': 1}
Nitral-AI	5	14.0	14.0	1290.86	1290.86	0.57	0.6	nitral-ai-captain-bmo-12b_v12	13B	Nitral-AI/Captain_BMO-12B	nitral-ai-captain-bmo-12b_v1	12641	6192795	0.56	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	Nitral-AI/Captain_BMO-12	2024-11-14	single	1.45	{'NVIDIA RTX A5000': 1}
Nitral-AI	5	15.0	14.0	1290.58	1290.86	0.57	0.6	nitral-ai-captain-bmo-12b_v8	13B	Nitral-AI/Captain_BMO-12B	nitral-ai-captain-bmo-12b_v1	8779	6192795	0.54	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	Nitral-AI/Captain_BMO-12	2024-11-03	single
Riverise	2	16.0	2.0	1289.84	1299.66	0.57	0.78	rica40325-dpo-1008-5162s_v5	13B	rica40325/dpo_1008_5162s	rica40325-dpo-1008-5162s_v4	6301	1950800	0.55	0.58	basic	8.0	1024.0	64.0	MistralForCausalLM	rica40325/dpo_1008_5162s	2024-10-08	single
Nitral-AI	5	17.0	14.0	1289.81	1290.86	0.57	0.6	nitral-ai-captain-bmo-12b_v13	13B	Nitral-AI/Captain_BMO-12B	nitral-ai-captain-bmo-12b_v1	10255	6192795	0.56	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	Nitral-AI/Captain_BMO-12	2024-11-14	single	1.41	{'NVIDIA RTX A5000': 1}
rica40325	1	18.0	1.0	1289.71	1302.47	0.58	0.59	rica40325-mistral-test1_v4	13B	rica40325/mistral-test1	rica40325-mistral-test1_v1	102937	1909408	0.55	0.57	basic	8.0	1024.0	64.0	MistralForCausalLM	rica40325/mistral-test1	2024-09-29	single
shiroe40	4	19.0	13.0	1289.52	1292.01	0.54	0.57	cycy233-nemo-p-e-v0-c3_v1	13B	cycy233/nemo-p-e-v0-c3	auto	19635	16838687	0.55	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	cycy233/nemo-p-e-v0-c3	2024-09-19	single	1.2	{'NVIDIA RTX A5000': 1}
rica40325	1	20.0	1.0	1288.89	1302.47	0.58	0.59	rica40325-mistral-test1_v3	13B	rica40325/mistral-test1	rica40325-mistral-test1_v1	112841	1909408	0.55	0.57	basic	8.0	1024.0	64.0	MistralForCausalLM	rica40325/mistral-test1	2024-09-29	single
Riverise	2	21.0	2.0	1287.75	1299.66	0.56	0.78	rica40325-linear-merge-1106_v2	13B	rica40325/linear_merge_1106	rica40325-linear-merge-1106_v2	18098	1950800	0.56	0.58	basic	8.0	1024.0	64.0	MistralForCausalLM	rica40325/linear_merge_1	2024-11-06	single
shiroe40	4	22.0	13.0	1287.17	1292.01	0.54	0.57	cycy233-nemo-p-e-v0-c1_v1	13B	cycy233/nemo-p-e-v0-c1	auto	19524	16838687	0.55	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	cycy233/nemo-p-e-v0-c1	2024-09-19	single	1.23	{'NVIDIA RTX A5000': 1}
Nitral-AI	5	23.0	14.0	1286.86	1290.86	0.57	0.6	nitral-ai-captain-bmo-12b_v2	13B	Nitral-AI/Captain_BMO-12B	nitral-ai-captain-bmo-12b_v1	13517	6192795	0.56	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	Nitral-AI/Captain_BMO-12	2024-11-03	single
chace9580	6	24.0	24.0	1286.79	1286.79	0.58	0.6	jic062-dpo-v3-0-nemo_v1	13B	jic062/dpo-v3.0-Nemo	jic062-dpo-v3-0-nemo_v1	6898	3425408	0.54	0.57	basic	8.0	1024.0	64.0	MistralForCausalLM	jic062/dpo-v3.0-Nemo	2024-10-13	single
PawanOsman	7	25.0	25.0	1286.73	1286.73	0.57	0.58	pawankrd-cosmosrp-12b_v16	13B	PawanKrd/CosmosRP-12b	pawankrd-cosmosrp-12b_v16	7463	4573921	0.54	0.75	basic	8.0	2048.0	64.0	MistralForCausalLM	PawanKrd/CosmosRP-12b	2024-10-06	single
Riverise	2	26.0	2.0	1286.53	1299.66	0.56	0.78	rica40325-nsfw-dpo-1106_v2	13B	rica40325/nsfw_dpo_1106	rica40325-nsfw-dpo-1106_v2	17044	1950800	0.56	0.58	basic	8.0	1024.0	64.0	MistralForCausalLM	rica40325/nsfw_dpo_1106	2024-11-05	single
c.gato	8	27.0	27.0	1286.49	1286.49	0.55	0.78	cgato-nemo-12b-thespice-_2145_v1	13B	cgato/Nemo-12b-TheSpice-V0.9-All-v2-KTO-v0.1-E1-1657	cgato-nemo-12b-thespice-_2145_v1	11537	12748558	0.58	0.63	basic	8.0	1024.0	64.0	MistralForCausalLM	cgato/Nemo-12b-TheSpice-	2024-10-29	single
shiroe40	4	28.0	13.0	1285.78	1292.01	0.0	0.57	cycy233-nemo-p-e-v0-c4_v1	13B	cycy233/nemo-p-e-v0-c4	auto	13049	16838687	0.55	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	cycy233/nemo-p-e-v0-c4	2024-09-19	single	1.24	{'NVIDIA RTX A5000': 1}
shiroe40	4	29.0	13.0	1285.75	1292.01	0.0	0.57	cycy233-nemo-p-e-v2-c4_v1	13B	cycy233/nemo-p-e-v2-c4	auto	64494	16838687	0.56	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	cycy233/nemo-p-e-v2-c4	2024-09-22	single	1.18	{'NVIDIA RTX A5000': 1}
shiroe40	4	30.0	13.0	1285.58	1292.01	0.0	0.57	cycy233-l3-e-v2-c1_v36	8B	cycy233/L3-e-v2-c1	auto	11858	16838687	0.57	0.61	basic	16.0	512.0	64.0	LlamaForCausalLM	cycy233/L3-e-v2-c1	2024-08-19	single
PawanOsman	7	31.0	25.0	1285.55	1286.73	0.56	0.58	pawankrd-cosmosrp-12b_v18	13B	PawanKrd/CosmosRP-12b	pawankrd-cosmosrp-12b_v18	7427	4573921	0.54	0.75	basic	8.0	2048.0	64.0	MistralForCausalLM	PawanKrd/CosmosRP-12b	2024-10-06	single
shiroe40	4	32.0	13.0	1285.37	1292.01	0.0	0.57	cycy233-nemo-p-e-v2-c3_v1	13B	cycy233/nemo-p-e-v2-c3	auto	64255	16838687	0.56	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	cycy233/nemo-p-e-v2-c3	2024-09-22	single	1.21	{'NVIDIA RTX A5000': 1}
Riverise	2	33.0	2.0	1284.73	1299.66	0.56	0.78	rica40325-nsfw-dpo-1106_v1	13B	rica40325/nsfw_dpo_1106	rica40325-nsfw-dpo-1106_v1	17223	1950800	0.55	0.58	basic	8.0	1024.0	64.0	MistralForCausalLM	rica40325/nsfw_dpo_1106	2024-11-05	single
PawanOsman	7	34.0	25.0	1284.66	1286.73	0.57	0.58	pawankrd-cosmosrp-12b_v17	13B	PawanKrd/CosmosRP-12b	pawankrd-cosmosrp-12b_v17	7289	4573921	0.54	0.75	basic	8.0	2048.0	64.0	MistralForCausalLM	PawanKrd/CosmosRP-12b	2024-10-06	single
shiroe40	4	35.0	13.0	1284.56	1292.01	0.0	0.57	cycy233-nemo-p-e-v2-c1_v1	13B	cycy233/nemo-p-e-v2-c1	auto	64800	16838687	0.56	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	cycy233/nemo-p-e-v2-c1	2024-09-22	single	1.2	{'NVIDIA RTX A5000': 1}
Nitral-AI	5	36.0	14.0	1284.15	1290.86	0.57	0.6	nitral-ai-captain-bmo-12b_v4	13B	Nitral-AI/Captain_BMO-12B	nitral-ai-captain-bmo-12b_v1	8886	6192795	0.54	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	Nitral-AI/Captain_BMO-12	2024-11-03	single
shiroe40	4	37.0	13.0	1283.49	1292.01	0.0	0.57	cycy233-nemo-p-e-v2-c2_v1	13B	cycy233/nemo-p-e-v2-c2	auto	64896	16838687	0.55	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	cycy233/nemo-p-e-v2-c2	2024-09-22	single	1.2	{'NVIDIA RTX A5000': 1}
shiroe40	4	38.0	13.0	1282.9	1292.01	0.0	0.57	cycy233-nemo-p-e-v3-c3_v1	13B	cycy233/nemo-p-e-v3-c3	auto	21067	16838687	0.56	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	cycy233/nemo-p-e-v3-c3	2024-09-23	single	1.2	{'NVIDIA RTX A5000': 1}
chace9580	6	39.0	24.0	1282.78	1286.79	0.58	0.6	jic062-dpo-v3-0-nemo-e3_v1	13B	jic062/dpo-v3.0-Nemo-e3	jic062-dpo-v3-0-nemo-e3_v1	7769	3425408	0.54	0.57	basic	8.0	1024.0	64.0	MistralForCausalLM	jic062/dpo-v3.0-Nemo-e3	2024-10-13	single
Nitral-AI	5	40.0	14.0	1282.76	1290.86	0.57	0.6	nitral-ai-captain-bmo-12b_v7	13B	Nitral-AI/Captain_BMO-12B	nitral-ai-captain-bmo-12b_v1	9088	6192795	0.53	0.61	basic	8.0	1024.0	64.0	MistralForCausalLM	Nitral-AI/Captain_BMO-12	2024-11-03	single