rirv938-mistral-24b-dpo_27903

developer_uid: rirv938

submission_id: rirv938-mistral-24b-dpo_27903_v1

model_name: rirv938-mistral-24b-dpo_27903_v1

model_group: rirv938/mistral_24b_dpo_

status: torndown

timestamp: 2025-02-23T00:33:00+00:00

num_battles: 7928

num_wins: 3845

celo_rating: 1263.69

family_friendly_score: 0.6392

family_friendly_standard_error: 0.0067915147058664315

submission_type: basic

model_repo: rirv938/mistral_24b_dpo_20k_625_with_instruct_format_v2

model_architecture: MistralForCausalLM

model_num_parameters: 24096691200.0

best_of: 8

max_input_tokens: 768

max_output_tokens: 64

latencies: [{'batch_size': 1, 'throughput': 0.38719468964397386, 'latency_mean': 2.5825813102722166, 'latency_p50': 2.5864245891571045, 'latency_p90': 2.8598580837249754}, {'batch_size': 3, 'throughput': 0.7915596342602792, 'latency_mean': 3.772233179807663, 'latency_p50': 3.8214744329452515, 'latency_p90': 4.167552185058594}, {'batch_size': 5, 'throughput': 1.0471403339522398, 'latency_mean': 4.759129170179367, 'latency_p50': 4.738274931907654, 'latency_p90': 5.291270184516907}, {'batch_size': 6, 'throughput': 1.1316425584915082, 'latency_mean': 5.286062144041061, 'latency_p50': 5.264192461967468, 'latency_p90': 5.826109218597412}, {'batch_size': 10, 'throughput': 1.2977103784323345, 'latency_mean': 7.629220923185349, 'latency_p50': 7.59215235710144, 'latency_p90': 8.720422744750977}]

gpu_counts: {'NVIDIA RTX A6000': 1}

display_name: rirv938-mistral-24b-dpo_27903_v1

is_internal_developer: True

language_model: rirv938/mistral_24b_dpo_20k_625_with_instruct_format_v2

model_size: 24B

ranking_group: single

throughput_3p7s: 0.78

us_pacific_date: 2025-02-22

win_ratio: 0.4849899091826438

generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.6, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>', '###', 'You:'], 'max_input_tokens': 768, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': '[INST]', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '[/INST]{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name rirv938-mistral-24b-dpo-27903-v1-mkmlizer
Waiting for job on rirv938-mistral-24b-dpo-27903-v1-mkmlizer to finish
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: ║     _____            __           __                                ║
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: ║       /___/                                                         ║
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: ║                                                                     ║
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: ║  Version: 0.12.8                                                    ║
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: ║  https://mk1.ai                                                     ║
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: ║                                                                     ║
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: ║  belonging to:                                                      ║
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: ║                                                                     ║
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: ║  Chai Research Corp.                                                ║
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: ║  Expiration: 2025-04-15 23:59:59                                    ║
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: ║                                                                     ║
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
Failed to get response for submission rirv938-mistral-24b-bon_67508_v2: ('http://rirv938-mistral-24b-bon-67508-v2-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission rirv938-mistral-24b-bon_67508_v1: ('http://rirv938-mistral-24b-bon-67508-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission rirv938-mistral-24b-bon_67508_v1: ('http://rirv938-mistral-24b-bon-67508-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission rirv938-mistral-24b-bon_67508_v1: ('http://rirv938-mistral-24b-bon-67508-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: Downloaded to shared memory in 202.315s
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmp7kb77a3y, device:0
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
Failed to get response for submission rirv938-mistral-24b-bon_67508_v1: ('http://rirv938-mistral-24b-bon-67508-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: quantized model in 67.576s
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: Processed model rirv938/mistral_24b_dpo_20k_625_with_instruct_format_v2 in 269.900s
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: creating bucket guanaco-mkml-models
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/rirv938-mistral-24b-dpo-27903-v1
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/rirv938-mistral-24b-dpo-27903-v1/config.json
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/rirv938-mistral-24b-dpo-27903-v1/special_tokens_map.json
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/rirv938-mistral-24b-dpo-27903-v1/tokenizer_config.json
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/rirv938-mistral-24b-dpo-27903-v1/tokenizer.json
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/rirv938-mistral-24b-dpo-27903-v1/flywheel_model.1.safetensors
Failed to get response for submission rirv938-mistral-24b-bon_67508_v2: ('http://rirv938-mistral-24b-bon-67508-v2-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/rirv938-mistral-24b-dpo-27903-v1/flywheel_model.0.safetensors
rirv938-mistral-24b-dpo-27903-v1-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3/363 [00:00<00:17, 20.94it/s]
Loading 0:   2%|▏         | 6/363 [00:00<00:30, 11.58it/s]
Loading 0:   3%|▎         | 10/363 [00:00<00:19, 17.97it/s]
Loading 0:   4%|▎         | 13/363 [00:00<00:28, 12.34it/s]
Loading 0:   4%|▍         | 15/363 [00:01<00:34, 10.10it/s]
Loading 0:   5%|▌         | 19/363 [00:01<00:23, 14.52it/s]
Loading 0:   6%|▌         | 22/363 [00:01<00:24, 14.00it/s]
Loading 0:   7%|▋         | 24/363 [00:01<00:25, 13.12it/s]
Loading 0:   8%|▊         | 28/363 [00:01<00:19, 16.97it/s]
Loading 0:   9%|▉         | 32/363 [00:02<00:16, 20.09it/s]
Loading 0:  10%|▉         | 35/363 [00:02<00:24, 13.66it/s]
Loading 0:  10%|█         | 37/363 [00:02<00:25, 12.81it/s]
Loading 0:  11%|█         | 39/363 [00:02<00:24, 13.49it/s]
Loading 0:  11%|█▏        | 41/363 [00:03<00:30, 10.66it/s]
Loading 0:  13%|█▎        | 46/363 [00:03<00:20, 15.75it/s]
Loading 0:  14%|█▍        | 50/363 [00:03<00:16, 18.57it/s]
Loading 0:  15%|█▍        | 53/363 [00:03<00:24, 12.81it/s]
Loading 0:  15%|█▌        | 55/363 [00:03<00:24, 12.33it/s]
Loading 0:  16%|█▌        | 57/363 [00:04<00:23, 13.01it/s]
Loading 0:  16%|█▋        | 59/363 [00:04<00:29, 10.45it/s]
Loading 0:  18%|█▊        | 64/363 [00:04<00:19, 15.58it/s]
Loading 0:  19%|█▊        | 68/363 [00:04<00:15, 18.48it/s]
Loading 0:  20%|█▉        | 71/363 [00:05<00:22, 13.13it/s]
Loading 0:  20%|██        | 73/363 [00:05<00:23, 12.40it/s]
Loading 0:  21%|██        | 75/363 [00:05<00:21, 13.24it/s]
Loading 0:  21%|██        | 77/363 [00:05<00:26, 10.71it/s]
Loading 0:  23%|██▎       | 82/363 [00:05<00:17, 16.02it/s]
Loading 0:  24%|██▎       | 86/363 [00:05<00:14, 19.03it/s]
Loading 0:  25%|██▍       | 89/363 [00:06<00:20, 13.69it/s]
Loading 0:  25%|██▌       | 91/363 [00:06<00:20, 13.20it/s]
Loading 0:  26%|██▌       | 95/363 [00:06<00:15, 16.95it/s]
Loading 0:  27%|██▋       | 99/363 [00:06<00:13, 20.04it/s]
Loading 0:  28%|██▊       | 102/363 [00:07<00:14, 18.14it/s]
Loading 0:  29%|██▉       | 105/363 [00:07<00:18, 13.66it/s]
Loading 0:  29%|██▉       | 107/363 [00:07<00:20, 12.66it/s]
Loading 0:  30%|███       | 109/363 [00:07<00:20, 12.16it/s]
Loading 0:  31%|███       | 111/363 [00:07<00:19, 13.06it/s]
Loading 0:  31%|███       | 113/363 [00:08<00:23, 10.47it/s]
Loading 0:  33%|███▎      | 118/363 [00:08<00:15, 16.21it/s]
Loading 0:  34%|███▎      | 122/363 [00:08<00:12, 19.39it/s]
Loading 0:  34%|███▍      | 125/363 [00:08<00:17, 13.26it/s]
Loading 0:  35%|███▍      | 127/363 [00:09<00:18, 12.67it/s]
Loading 0:  36%|███▌      | 129/363 [00:09<00:17, 13.52it/s]
Loading 0:  36%|███▌      | 131/363 [00:09<00:21, 10.80it/s]
Loading 0:  37%|███▋      | 136/363 [00:09<00:13, 16.25it/s]
Loading 0:  39%|███▊      | 140/363 [00:09<00:11, 19.47it/s]
Loading 0:  39%|███▉      | 143/363 [00:10<00:16, 13.69it/s]
Loading 0:  40%|███▉      | 145/363 [00:10<00:16, 13.25it/s]
Loading 0:  40%|████      | 147/363 [00:10<00:15, 14.16it/s]
Loading 0:  41%|████      | 149/363 [00:10<00:18, 11.48it/s]
Loading 0:  42%|████▏     | 154/363 [00:10<00:12, 17.12it/s]
Loading 0:  44%|████▎     | 158/363 [00:10<00:10, 20.14it/s]
Loading 0:  44%|████▍     | 161/363 [00:11<00:14, 14.16it/s]
Loading 0:  45%|████▍     | 163/363 [00:11<00:14, 13.41it/s]
Loading 0:  45%|████▌     | 165/363 [00:11<00:13, 14.15it/s]
Loading 0:  46%|████▌     | 167/363 [00:11<00:17, 11.28it/s]
Loading 0:  47%|████▋     | 172/363 [00:12<00:11, 16.49it/s]
Loading 0:  48%|████▊     | 176/363 [00:12<00:09, 19.46it/s]
Loading 0:  49%|████▉     | 179/363 [00:12<00:13, 13.49it/s]
Loading 0:  50%|████▉     | 181/363 [00:12<00:14, 12.59it/s]
Loading 0:  50%|█████     | 183/363 [00:12<00:13, 13.33it/s]
Loading 0:  51%|█████     | 185/363 [00:13<00:16, 10.79it/s]
Loading 0:  52%|█████▏    | 190/363 [00:13<00:10, 16.02it/s]
Loading 0:  53%|█████▎    | 194/363 [00:13<00:08, 19.13it/s]
Loading 0:  54%|█████▍    | 197/363 [00:13<00:12, 13.43it/s]
Loading 0:  55%|█████▍    | 199/363 [00:14<00:13, 12.58it/s]
Loading 0:  55%|█████▌    | 201/363 [00:29<04:57,  1.84s/it]
Loading 0:  56%|█████▌    | 203/363 [00:29<03:47,  1.42s/it]
Loading 0:  57%|█████▋    | 207/363 [00:30<02:12,  1.18it/s]
Loading 0:  58%|█████▊    | 210/363 [00:30<01:32,  1.66it/s]
Loading 0:  59%|█████▊    | 213/363 [00:30<01:07,  2.22it/s]
Loading 0:  59%|█████▉    | 215/363 [00:30<00:55,  2.69it/s]
Loading 0:  60%|█████▉    | 217/363 [00:30<00:44,  3.30it/s]
Loading 0:  60%|██████    | 219/363 [00:31<00:34,  4.18it/s]
Loading 0:  61%|██████    | 221/363 [00:31<00:30,  4.68it/s]
Loading 0:  62%|██████▏   | 226/363 [00:31<00:16,  8.18it/s]
Loading 0:  63%|██████▎   | 230/363 [00:31<00:12, 11.01it/s]
Loading 0:  64%|██████▍   | 233/363 [00:31<00:13,  9.85it/s]
Loading 0:  65%|██████▍   | 235/363 [00:32<00:12, 10.10it/s]
Loading 0:  65%|██████▌   | 237/363 [00:32<00:11, 11.31it/s]
Loading 0:  66%|██████▌   | 239/363 [00:32<00:12,  9.95it/s]
Loading 0:  67%|██████▋   | 244/363 [00:32<00:07, 15.55it/s]
Loading 0:  68%|██████▊   | 248/363 [00:32<00:06, 19.02it/s]
Loading 0:  69%|██████▉   | 251/363 [00:33<00:07, 14.13it/s]
Loading 0:  70%|██████▉   | 254/363 [00:33<00:07, 14.91it/s]
Loading 0:  71%|███████   | 256/363 [00:33<00:07, 13.52it/s]
Loading 0:  71%|███████   | 258/363 [00:33<00:08, 12.96it/s]
Loading 0:  72%|███████▏  | 262/363 [00:33<00:05, 17.13it/s]
Loading 0:  73%|███████▎  | 266/363 [00:33<00:04, 21.01it/s]
Loading 0:  74%|███████▍  | 269/363 [00:34<00:06, 15.09it/s]
Loading 0:  75%|███████▍  | 272/363 [00:34<00:05, 15.86it/s]
Loading 0:  75%|███████▌  | 274/363 [00:34<00:06, 14.04it/s]
Loading 0:  76%|███████▌  | 276/363 [00:34<00:06, 12.67it/s]
Loading 0:  77%|███████▋  | 280/363 [00:34<00:04, 16.80it/s]
Loading 0:  78%|███████▊  | 284/363 [00:35<00:03, 20.65it/s]
Loading 0:  79%|███████▉  | 287/363 [00:35<00:05, 14.95it/s]
Loading 0:  80%|███████▉  | 289/363 [00:35<00:05, 14.19it/s]
Loading 0:  80%|████████  | 291/363 [00:35<00:04, 14.87it/s]
Loading 0:  81%|████████  | 293/363 [00:35<00:05, 11.85it/s]
Loading 0:  82%|████████▏ | 298/363 [00:36<00:03, 17.84it/s]
Loading 0:  83%|████████▎ | 302/363 [00:36<00:02, 21.36it/s]
Loading 0:  84%|████████▍ | 305/363 [00:36<00:03, 15.21it/s]
Loading 0:  85%|████████▍ | 308/363 [00:36<00:03, 15.65it/s]
Loading 0:  85%|████████▌ | 310/363 [00:36<00:03, 13.82it/s]
Loading 0:  86%|████████▌ | 312/363 [00:37<00:03, 13.19it/s]
Loading 0:  87%|████████▋ | 316/363 [00:37<00:02, 17.28it/s]
Loading 0:  88%|████████▊ | 320/363 [00:37<00:02, 20.97it/s]
Loading 0:  89%|████████▉ | 323/363 [00:37<00:02, 14.71it/s]
Loading 0:  90%|████████▉ | 325/363 [00:37<00:02, 13.56it/s]
Loading 0:  90%|█████████ | 327/363 [00:38<00:02, 14.37it/s]
Loading 0:  91%|█████████ | 329/363 [00:38<00:02, 11.50it/s]
Loading 0:  92%|█████████▏| 334/363 [00:38<00:01, 17.34it/s]
Loading 0:  93%|█████████▎| 338/363 [00:38<00:01, 20.83it/s]
Loading 0:  94%|█████████▍| 341/363 [00:38<00:01, 14.90it/s]
Loading 0:  95%|█████████▍| 344/363 [00:39<00:01, 15.74it/s]
Loading 0:  95%|█████████▌| 346/363 [00:39<00:01, 14.24it/s]
Loading 0:  96%|█████████▌| 348/363 [00:39<00:01, 13.50it/s]
Loading 0:  97%|█████████▋| 352/363 [00:39<00:00, 16.78it/s]
Loading 0:  98%|█████████▊| 356/363 [00:39<00:00, 20.25it/s]
Loading 0:  99%|█████████▉| 359/363 [00:47<00:02,  1.39it/s]
Loading 0:  99%|█████████▉| 361/363 [00:47<00:01,  1.68it/s]
                                                            
Job rirv938-mistral-24b-dpo-27903-v1-mkmlizer completed after 330.22s with status: succeeded
Stopping job with name rirv938-mistral-24b-dpo-27903-v1-mkmlizer
Pipeline stage MKMLizer completed in 330.72s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.16s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service rirv938-mistral-24b-dpo-27903-v1
Waiting for inference service rirv938-mistral-24b-dpo-27903-v1 to be ready
Failed to get response for submission rirv938-mistral-24b-bon_67508_v2: ('http://rirv938-mistral-24b-bon-67508-v2-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Inference service rirv938-mistral-24b-dpo-27903-v1 ready after 221.04616713523865s
Pipeline stage MKMLDeployer completed in 221.52s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.73976731300354s
Received healthy response to inference request in 2.2215449810028076s
Received healthy response to inference request in 1.841057538986206s
Received healthy response to inference request in 1.7224195003509521s
5 requests
1 failed requests
5th percentile: 1.7461471080780029
10th percentile: 1.7698747158050536
20th percentile: 1.8173299312591553
30th percentile: 1.9171550273895264
40th percentile: 2.069350004196167
50th percentile: 2.2215449810028076
60th percentile: 2.4288339138031008
70th percentile: 2.6361228466033935
80th percentile: 6.217019557952884
90th percentile: 13.171524047851564
95th percentile: 16.6487762928009
99th percentile: 19.430578088760374
mean time: 5.73016357421875
%s, retrying in %s seconds...
Received healthy response to inference request in 1.9825828075408936s
Received healthy response to inference request in 1.8227436542510986s
Received healthy response to inference request in 2.250554084777832s
Received healthy response to inference request in 2.5589773654937744s
Received healthy response to inference request in 2.0019609928131104s
5 requests
0 failed requests
5th percentile: 1.8547114849090576
10th percentile: 1.8866793155670165
20th percentile: 1.9506149768829346
30th percentile: 1.9864584445953368
40th percentile: 1.9942097187042236
50th percentile: 2.0019609928131104
60th percentile: 2.101398229598999
70th percentile: 2.2008354663848877
80th percentile: 2.3122387409210208
90th percentile: 2.4356080532073974
95th percentile: 2.4972927093505857
99th percentile: 2.5466404342651368
mean time: 2.1233637809753416
Pipeline stage StressChecker completed in 41.80s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.63s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 0.63s
Shutdown handler de-registered
rirv938-mistral-24b-dpo_27903_v1 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 5490.19s
Shutdown handler de-registered
rirv938-mistral-24b-dpo_27903_v1 status is now inactive due to auto deactivation removed underperforming models
rirv938-mistral-24b-dpo_27903_v1 status is now torndown due to DeploymentManager action

ChatRequest

Bot Name

Generation Params

Prompt Formatter

ChatMessage 1

Sender

Message

User Message