developer_uid: rirv938
submission_id: rirv938-nitral-40k-1875_16875_v1
model_name: rirv938-nitral-40k-1875_16875_v1
model_group: rirv938/nitral_40k_1875_
status: torndown
timestamp: 2025-01-31T18:42:54+00:00
num_battles: 5789
num_wins: 3051
celo_rating: 1285.05
family_friendly_score: 0.583
family_friendly_standard_error: 0.006972962067873307
submission_type: basic
model_repo: rirv938/nitral_40k_1875_13ff_10w_bo32_old_rm_v2
model_architecture: MistralForCausalLM
model_num_parameters: 12772070400.0
best_of: 8
max_input_tokens: 768
max_output_tokens: 64
display_name: rirv938-nitral-40k-1875_16875_v1
is_internal_developer: True
language_model: rirv938/nitral_40k_1875_13ff_10w_bo32_old_rm_v2
model_size: 13B
ranking_group: single
us_pacific_date: 2025-01-31
win_ratio: 0.5270340300570047
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '####', 'Bot:', 'User:', 'You:', '<|im_end|>', '<|eot_id|>'], 'max_input_tokens': 768, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name rirv938-nitral-40k-1875-16875-v1-mkmlizer
Waiting for job on rirv938-nitral-40k-1875-16875-v1-mkmlizer to finish
rirv938-nitral-40k-1875-16875-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
rirv938-nitral-40k-1875-16875-v1-mkmlizer: ║     _____            __           __                                ║
rirv938-nitral-40k-1875-16875-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
rirv938-nitral-40k-1875-16875-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
rirv938-nitral-40k-1875-16875-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
rirv938-nitral-40k-1875-16875-v1-mkmlizer: ║       /___/                                                         ║
rirv938-nitral-40k-1875-16875-v1-mkmlizer: ║                                                                     ║
rirv938-nitral-40k-1875-16875-v1-mkmlizer: ║  Version: 0.11.12                                                   ║
rirv938-nitral-40k-1875-16875-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
rirv938-nitral-40k-1875-16875-v1-mkmlizer: ║  https://mk1.ai                                                     ║
rirv938-nitral-40k-1875-16875-v1-mkmlizer: ║                                                                     ║
rirv938-nitral-40k-1875-16875-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
rirv938-nitral-40k-1875-16875-v1-mkmlizer: ║  belonging to:                                                      ║
rirv938-nitral-40k-1875-16875-v1-mkmlizer: ║                                                                     ║
rirv938-nitral-40k-1875-16875-v1-mkmlizer: ║  Chai Research Corp.                                                ║
rirv938-nitral-40k-1875-16875-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
rirv938-nitral-40k-1875-16875-v1-mkmlizer: ║  Expiration: 2025-04-15 23:59:59                                    ║
rirv938-nitral-40k-1875-16875-v1-mkmlizer: ║                                                                     ║
rirv938-nitral-40k-1875-16875-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
rirv938-nitral-40k-1875-16875-v1-mkmlizer: quantized model in 43.593s
rirv938-nitral-40k-1875-16875-v1-mkmlizer: Processed model rirv938/nitral_40k_1875_13ff_10w_bo32_old_rm_v2 in 126.079s
rirv938-nitral-40k-1875-16875-v1-mkmlizer: creating bucket guanaco-mkml-models
rirv938-nitral-40k-1875-16875-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
rirv938-nitral-40k-1875-16875-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/rirv938-nitral-40k-1875-16875-v1
rirv938-nitral-40k-1875-16875-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/rirv938-nitral-40k-1875-16875-v1/config.json
rirv938-nitral-40k-1875-16875-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/rirv938-nitral-40k-1875-16875-v1/special_tokens_map.json
rirv938-nitral-40k-1875-16875-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/rirv938-nitral-40k-1875-16875-v1/tokenizer_config.json
rirv938-nitral-40k-1875-16875-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/rirv938-nitral-40k-1875-16875-v1/tokenizer.json
rirv938-nitral-40k-1875-16875-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/rirv938-nitral-40k-1875-16875-v1/flywheel_model.0.safetensors
rirv938-nitral-40k-1875-16875-v1-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|▏         | 5/363 [00:00<00:18, 19.31it/s]
Loading 0:   3%|▎         | 10/363 [00:00<00:13, 25.57it/s]
Loading 0:   4%|▍         | 14/363 [00:00<00:15, 22.58it/s]
Loading 0:   5%|▌         | 19/363 [00:00<00:11, 29.00it/s]
Loading 0:   6%|▋         | 23/363 [00:01<00:15, 21.75it/s]
Loading 0:   7%|▋         | 26/363 [00:01<00:17, 19.48it/s]
Loading 0:   9%|▊         | 31/363 [00:01<00:13, 25.11it/s]
Loading 0:  10%|▉         | 35/363 [00:01<00:12, 26.48it/s]
Loading 0:  11%|█         | 39/363 [00:01<00:11, 27.54it/s]
Loading 0:  12%|█▏        | 43/363 [00:01<00:12, 26.53it/s]
Loading 0:  13%|█▎        | 46/363 [00:01<00:11, 27.04it/s]
Loading 0:  13%|█▎        | 49/363 [00:01<00:11, 27.74it/s]
Loading 0:  14%|█▍        | 52/363 [00:02<00:11, 26.53it/s]
Loading 0:  15%|█▌        | 56/363 [00:02<00:11, 26.67it/s]
Loading 0:  17%|█▋        | 60/363 [00:02<00:10, 28.95it/s]
Loading 0:  17%|█▋        | 63/363 [00:02<00:14, 20.41it/s]
Loading 0:  18%|█▊        | 66/363 [00:02<00:13, 21.34it/s]
Loading 0:  20%|█▉        | 71/363 [00:02<00:11, 24.91it/s]
Loading 0:  20%|██        | 74/363 [00:02<00:11, 25.32it/s]
Loading 0:  21%|██        | 77/363 [00:03<00:13, 21.73it/s]
Loading 0:  23%|██▎       | 82/363 [00:03<00:10, 27.07it/s]
Loading 0:  24%|██▎       | 86/363 [00:03<00:11, 24.06it/s]
Loading 0:  25%|██▌       | 91/363 [00:03<00:09, 28.93it/s]
Loading 0:  26%|██▌       | 95/363 [00:03<00:10, 25.01it/s]
Loading 0:  28%|██▊       | 100/363 [00:03<00:08, 29.49it/s]
Loading 0:  29%|██▊       | 104/363 [00:04<00:14, 18.37it/s]
Loading 0:  31%|███       | 111/363 [00:04<00:10, 24.80it/s]
Loading 0:  32%|███▏      | 115/363 [00:04<00:09, 24.80it/s]
Loading 0:  33%|███▎      | 120/363 [00:04<00:09, 26.79it/s]
Loading 0:  34%|███▍      | 124/363 [00:04<00:09, 26.30it/s]
Loading 0:  36%|███▌      | 129/363 [00:05<00:08, 28.36it/s]
Loading 0:  37%|███▋      | 133/363 [00:05<00:08, 27.24it/s]
Loading 0:  38%|███▊      | 137/363 [00:05<00:08, 27.09it/s]
Loading 0:  39%|███▉      | 141/363 [00:05<00:07, 29.34it/s]
Loading 0:  40%|███▉      | 145/363 [00:05<00:11, 18.61it/s]
Loading 0:  41%|████      | 149/363 [00:06<00:11, 18.93it/s]
Loading 0:  42%|████▏     | 154/363 [00:06<00:08, 23.61it/s]
Loading 0:  44%|████▎     | 158/363 [00:06<00:09, 22.46it/s]
Loading 0:  45%|████▍     | 163/363 [00:06<00:07, 27.13it/s]
Loading 0:  46%|████▌     | 167/363 [00:06<00:08, 24.47it/s]
Loading 0:  47%|████▋     | 172/363 [00:06<00:06, 29.03it/s]
Loading 0:  48%|████▊     | 176/363 [00:07<00:07, 25.67it/s]
Loading 0:  50%|████▉     | 181/363 [00:07<00:06, 30.00it/s]
Loading 0:  51%|█████     | 185/363 [00:07<00:09, 18.92it/s]
Loading 0:  52%|█████▏    | 190/363 [00:07<00:07, 23.41it/s]
Loading 0:  53%|█████▎    | 194/363 [00:07<00:07, 22.45it/s]
Loading 0:  55%|█████▍    | 199/363 [00:08<00:06, 27.09it/s]
Loading 0:  56%|█████▌    | 203/363 [00:08<00:06, 24.43it/s]
Loading 0:  57%|█████▋    | 208/363 [00:08<00:05, 29.04it/s]
Loading 0:  58%|█████▊    | 212/363 [00:08<00:05, 25.77it/s]
Loading 0:  60%|█████▉    | 217/363 [00:08<00:04, 30.11it/s]
Loading 0:  61%|██████    | 222/363 [00:08<00:04, 30.76it/s]
Loading 0:  62%|██████▏   | 226/363 [00:09<00:06, 21.41it/s]
Loading 0:  63%|██████▎   | 230/363 [00:09<00:06, 20.74it/s]
Loading 0:  65%|██████▍   | 235/363 [00:09<00:05, 25.51it/s]
Loading 0:  66%|██████▌   | 239/363 [00:09<00:05, 23.38it/s]
Loading 0:  67%|██████▋   | 244/363 [00:09<00:04, 28.17it/s]
Loading 0:  68%|██████▊   | 248/363 [00:09<00:04, 25.11it/s]
Loading 0:  70%|██████▉   | 253/363 [00:10<00:03, 29.61it/s]
Loading 0:  71%|███████   | 257/363 [00:10<00:04, 25.66it/s]
Loading 0:  72%|███████▏  | 262/363 [00:10<00:03, 30.38it/s]
Loading 0:  73%|███████▎  | 266/363 [00:10<00:05, 19.12it/s]
Loading 0:  75%|███████▍  | 271/363 [00:10<00:03, 23.70it/s]
Loading 0:  76%|███████▌  | 275/363 [00:11<00:03, 22.46it/s]
Loading 0:  77%|███████▋  | 280/363 [00:11<00:03, 27.13it/s]
Loading 0:  78%|███████▊  | 284/363 [00:11<00:03, 24.91it/s]
Loading 0:  80%|███████▉  | 289/363 [00:11<00:02, 29.21it/s]
Loading 0:  81%|████████  | 293/363 [00:11<00:02, 25.31it/s]
Loading 0:  82%|████████▏ | 298/363 [00:11<00:02, 29.68it/s]
Loading 0:  83%|████████▎ | 303/363 [00:12<00:01, 30.13it/s]
Loading 0:  85%|████████▍ | 307/363 [00:12<00:02, 19.32it/s]
Loading 0:  86%|████████▌ | 311/363 [00:12<00:02, 19.09it/s]
Loading 0:  87%|████████▋ | 316/363 [00:12<00:01, 23.61it/s]
Loading 0:  88%|████████▊ | 320/363 [00:12<00:01, 22.22it/s]
Loading 0:  90%|████████▉ | 325/363 [00:13<00:01, 26.78it/s]
Loading 0:  91%|█████████ | 329/363 [00:13<00:01, 24.50it/s]
Loading 0:  92%|█████████▏| 334/363 [00:13<00:01, 28.81it/s]
Loading 0:  93%|█████████▎| 338/363 [00:13<00:01, 24.92it/s]
Loading 0:  94%|█████████▍| 343/363 [00:13<00:00, 29.65it/s]
Loading 0:  96%|█████████▌| 347/363 [00:20<00:07,  2.00it/s]
Loading 0:  96%|█████████▋| 350/363 [00:20<00:05,  2.52it/s]
Loading 0:  97%|█████████▋| 353/363 [00:20<00:03,  3.21it/s]
Loading 0:  98%|█████████▊| 357/363 [00:21<00:01,  4.39it/s]
                                                            

Job rirv938-nitral-40k-1875-16875-v1-mkmlizer completed after 155.69s with status: succeeded
Stopping job with name rirv938-nitral-40k-1875-16875-v1-mkmlizer
Pipeline stage MKMLizer completed in 156.15s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.15s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service rirv938-nitral-40k-1875-16875-v1
Waiting for inference service rirv938-nitral-40k-1875-16875-v1 to be ready
Inference service rirv938-nitral-40k-1875-16875-v1 ready after 210.87139749526978s
Pipeline stage MKMLDeployer completed in 211.46s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.865788221359253s
Received healthy response to inference request in 1.5783088207244873s
Received healthy response to inference request in 1.5191819667816162s
Received healthy response to inference request in 1.389822006225586s
Received healthy response to inference request in 1.4649114608764648s
5 requests
0 failed requests
5th percentile: 1.4048398971557616
10th percentile: 1.4198577880859375
20th percentile: 1.4498935699462892
30th percentile: 1.4757655620574952
40th percentile: 1.4974737644195557
50th percentile: 1.5191819667816162
60th percentile: 1.5428327083587647
70th percentile: 1.566483449935913
80th percentile: 1.6358047008514405
90th percentile: 1.7507964611053466
95th percentile: 1.8082923412322998
99th percentile: 1.8542890453338623
mean time: 1.5636024951934815
Pipeline stage StressChecker completed in 9.05s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.66s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 0.64s
Shutdown handler de-registered
rirv938-nitral-40k-1875_16875_v1 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2382.32s
Shutdown handler de-registered
rirv938-nitral-40k-1875_16875_v1 status is now inactive due to auto deactivation removed underperforming models
rirv938-nitral-40k-1875_16875_v1 status is now torndown due to DeploymentManager action
ChatRequest
Generation Params
Prompt Formatter
Chat History
ChatMessage 1