nitral-ai-captain-bmo-12b

developer_uid: Nitral-AI
submission_id: nitral-ai-captain-bmo-12b_v4
model_name: nitral-ai-captain-bmo-12b_v1
model_group: Nitral-AI/Captain_BMO-12
status: torndown
timestamp: 2024-11-04T02:53:22+00:00
num_battles: 8886
num_wins: 4760
celo_rating: 1284.15
family_friendly_score: 0.5684
family_friendly_standard_error: 0.007004590494811242
submission_type: basic
model_repo: Nitral-AI/Captain_BMO-12B
model_architecture: MistralForCausalLM
model_num_parameters: 12772070400.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
display_name: nitral-ai-captain-bmo-12b_v1
is_internal_developer: False
language_model: Nitral-AI/Captain_BMO-12B
model_size: 13B
ranking_group: single
us_pacific_date: 2024-11-03
win_ratio: 0.5356740940805762
generation_params: {'temperature': 0.85, 'top_p': 0.8, 'min_p': 0.1, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', '\n\n', '\nYou:', '<|im_end|>', '[/INST]'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '[INST]system\n{memory}[/INST]\n', 'prompt_template': '[INST]user\n{prompt}[/INST]\n', 'bot_template': '[INST]assistant\n{bot_name}: {message}[/INST]\n', 'user_template': '[INST]user\n{user_name}: {message}[/INST]\n', 'response_template': '[INST]assistant\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Starting job with name nitral-ai-captain-bmo-12b-v4-mkmlizer
Running pipeline stage MKMLizer
Waiting for job on nitral-ai-captain-bmo-12b-v4-mkmlizer to finish
Starting job with name nitral-ai-captain-bmo-12b-v5-mkmlizer
Waiting for job on nitral-ai-captain-bmo-12b-v5-mkmlizer to finish
nitral-ai-captain-bmo-12b-v4-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
nitral-ai-captain-bmo-12b-v4-mkmlizer: ║     _____            __           __                                ║
nitral-ai-captain-bmo-12b-v5-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
nitral-ai-captain-bmo-12b-v4-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
nitral-ai-captain-bmo-12b-v5-mkmlizer: ║     _____            __           __                                ║
nitral-ai-captain-bmo-12b-v4-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
nitral-ai-captain-bmo-12b-v5-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
nitral-ai-captain-bmo-12b-v4-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
nitral-ai-captain-bmo-12b-v5-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
nitral-ai-captain-bmo-12b-v4-mkmlizer: ║       /___/                                                         ║
nitral-ai-captain-bmo-12b-v5-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
nitral-ai-captain-bmo-12b-v4-mkmlizer: ║                                                                     ║
nitral-ai-captain-bmo-12b-v5-mkmlizer: ║       /___/                                                         ║
nitral-ai-captain-bmo-12b-v4-mkmlizer: ║  Version: 0.11.12                                                   ║
nitral-ai-captain-bmo-12b-v5-mkmlizer: ║                                                                     ║
nitral-ai-captain-bmo-12b-v4-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
nitral-ai-captain-bmo-12b-v5-mkmlizer: ║  Version: 0.11.12                                                   ║
nitral-ai-captain-bmo-12b-v4-mkmlizer: ║  https://mk1.ai                                                     ║
nitral-ai-captain-bmo-12b-v5-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
nitral-ai-captain-bmo-12b-v4-mkmlizer: ║                                                                     ║
nitral-ai-captain-bmo-12b-v5-mkmlizer: ║  https://mk1.ai                                                     ║
nitral-ai-captain-bmo-12b-v4-mkmlizer: ║  The license key for the current software has been verified as      ║
nitral-ai-captain-bmo-12b-v5-mkmlizer: ║                                                                     ║
nitral-ai-captain-bmo-12b-v4-mkmlizer: ║  belonging to:                                                      ║
nitral-ai-captain-bmo-12b-v5-mkmlizer: ║  The license key for the current software has been verified as      ║
nitral-ai-captain-bmo-12b-v4-mkmlizer: ║                                                                     ║
nitral-ai-captain-bmo-12b-v5-mkmlizer: ║  belonging to:                                                      ║
nitral-ai-captain-bmo-12b-v4-mkmlizer: ║  Chai Research Corp.                                                ║
nitral-ai-captain-bmo-12b-v5-mkmlizer: ║                                                                     ║
nitral-ai-captain-bmo-12b-v4-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
nitral-ai-captain-bmo-12b-v5-mkmlizer: ║  Chai Research Corp.                                                ║
nitral-ai-captain-bmo-12b-v4-mkmlizer: ║  Expiration: 2025-01-15 23:59:59                                    ║
nitral-ai-captain-bmo-12b-v5-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
nitral-ai-captain-bmo-12b-v4-mkmlizer: ║                                                                     ║
nitral-ai-captain-bmo-12b-v5-mkmlizer: ║  Expiration: 2025-01-15 23:59:59                                    ║
nitral-ai-captain-bmo-12b-v4-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
nitral-ai-captain-bmo-12b-v5-mkmlizer: ║                                                                     ║
nitral-ai-captain-bmo-12b-v5-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
nitral-ai-captain-bmo-12b-v4-mkmlizer: Downloaded to shared memory in 33.102s
nitral-ai-captain-bmo-12b-v4-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpqkg18fye, device:0
nitral-ai-captain-bmo-12b-v4-mkmlizer: Saving flywheel model at /dev/shm/model_cache
nitral-ai-captain-bmo-12b-v5-mkmlizer: Downloaded to shared memory in 31.155s
nitral-ai-captain-bmo-12b-v5-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpvs7jymfo, device:0
nitral-ai-captain-bmo-12b-v5-mkmlizer: Saving flywheel model at /dev/shm/model_cache
nitral-ai-captain-bmo-12b-v4-mkmlizer: quantized model in 37.412s
nitral-ai-captain-bmo-12b-v4-mkmlizer: Processed model Nitral-AI/Captain_BMO-12B in 70.514s
nitral-ai-captain-bmo-12b-v5-mkmlizer: quantized model in 37.532s
nitral-ai-captain-bmo-12b-v4-mkmlizer: creating bucket guanaco-mkml-models
nitral-ai-captain-bmo-12b-v5-mkmlizer: Processed model Nitral-AI/Captain_BMO-12B in 68.688s
nitral-ai-captain-bmo-12b-v4-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
nitral-ai-captain-bmo-12b-v5-mkmlizer: creating bucket guanaco-mkml-models
nitral-ai-captain-bmo-12b-v4-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/nitral-ai-captain-bmo-12b-v4
nitral-ai-captain-bmo-12b-v5-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
nitral-ai-captain-bmo-12b-v4-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/nitral-ai-captain-bmo-12b-v4/config.json
nitral-ai-captain-bmo-12b-v5-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/nitral-ai-captain-bmo-12b-v5
nitral-ai-captain-bmo-12b-v4-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/nitral-ai-captain-bmo-12b-v4/special_tokens_map.json
nitral-ai-captain-bmo-12b-v5-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/nitral-ai-captain-bmo-12b-v5/config.json
nitral-ai-captain-bmo-12b-v4-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/nitral-ai-captain-bmo-12b-v4/tokenizer_config.json
nitral-ai-captain-bmo-12b-v5-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/nitral-ai-captain-bmo-12b-v5/special_tokens_map.json
nitral-ai-captain-bmo-12b-v4-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/nitral-ai-captain-bmo-12b-v4/tokenizer.json
nitral-ai-captain-bmo-12b-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/nitral-ai-captain-bmo-12b-v5/tokenizer_config.json
nitral-ai-captain-bmo-12b-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/nitral-ai-captain-bmo-12b-v5/tokenizer.json
nitral-ai-captain-bmo-12b-v4-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/nitral-ai-captain-bmo-12b-v4/flywheel_model.0.safetensors
nitral-ai-captain-bmo-12b-v4-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 2/363 [00:06<18:25,  3.06s/it]
Loading 0:   2%|▏         | 6/363 [00:06<04:54,  1.21it/s]
Loading 0:   3%|▎         | 11/363 [00:06<02:09,  2.72it/s]
Loading 0:   4%|▍         | 15/363 [00:06<01:22,  4.24it/s]
Loading 0:   6%|▌         | 22/363 [00:06<00:43,  7.90it/s]
Loading 0:   7%|▋         | 27/363 [00:06<00:31, 10.82it/s]
Loading 0:   9%|▉         | 32/363 [00:06<00:23, 14.23it/s]
Loading 0:  10%|█         | 37/363 [00:07<00:17, 18.14it/s]
Loading 0:  12%|█▏        | 42/363 [00:07<00:19, 16.24it/s]
Loading 0:  13%|█▎        | 49/363 [00:07<00:13, 22.67it/s]
Loading 0:  15%|█▍        | 54/363 [00:07<00:11, 25.78it/s]
Loading 0:  16%|█▋        | 59/363 [00:07<00:10, 28.91it/s]
Loading 0:  18%|█▊        | 64/363 [00:07<00:09, 31.99it/s]
Loading 0:  19%|█▉        | 69/363 [00:08<00:10, 28.87it/s]
Loading 0:  21%|██        | 76/363 [00:08<00:08, 35.83it/s]
Loading 0:  22%|██▏       | 81/363 [00:08<00:07, 36.31it/s]
Loading 0:  24%|██▎       | 86/363 [00:08<00:07, 36.76it/s]
Loading 0:  25%|██▌       | 91/363 [00:08<00:07, 38.18it/s]
Loading 0:  26%|██▋       | 96/363 [00:08<00:08, 31.57it/s]
Loading 0:  28%|██▊       | 103/363 [00:08<00:06, 37.79it/s]
Loading 0:  30%|██▉       | 108/363 [00:09<00:06, 38.18it/s]
Loading 0:  31%|███       | 113/363 [00:09<00:06, 38.30it/s]
Loading 0:  33%|███▎      | 118/363 [00:09<00:06, 39.96it/s]
Loading 0:  34%|███▍      | 123/363 [00:09<00:09, 25.18it/s]
Loading 0:  36%|███▌      | 130/363 [00:09<00:07, 31.98it/s]
Loading 0:  37%|███▋      | 135/363 [00:09<00:06, 33.46it/s]
Loading 0:  39%|███▊      | 140/363 [00:10<00:06, 34.89it/s]
Loading 0:  40%|███▉      | 144/363 [00:10<00:06, 35.55it/s]
Loading 0:  41%|████      | 148/363 [00:10<00:05, 36.25it/s]
Loading 0:  42%|████▏     | 152/363 [00:10<00:05, 35.64it/s]
Loading 0:  43%|████▎     | 157/363 [00:10<00:05, 37.89it/s]
Loading 0:  44%|████▍     | 161/363 [00:10<00:05, 36.84it/s]
Loading 0:  46%|████▌     | 166/363 [00:10<00:05, 39.05it/s]
Loading 0:  47%|████▋     | 170/363 [00:10<00:05, 37.12it/s]
Loading 0:  48%|████▊     | 175/363 [00:10<00:04, 38.36it/s]
Loading 0:  49%|████▉     | 179/363 [00:11<00:04, 37.03it/s]
Loading 0:  51%|█████     | 184/363 [00:11<00:04, 39.13it/s]
Loading 0:  52%|█████▏    | 188/363 [00:11<00:04, 36.82it/s]
Loading 0:  53%|█████▎    | 193/363 [00:11<00:04, 38.73it/s]
Loading 0:  54%|█████▍    | 197/363 [00:11<00:04, 36.68it/s]
Loading 0:  56%|█████▌    | 202/363 [00:11<00:05, 27.74it/s]
Loading 0:  57%|█████▋    | 206/363 [00:11<00:05, 28.73it/s]
Loading 0:  58%|█████▊    | 211/363 [00:12<00:04, 32.56it/s]
Loading 0:  59%|█████▉    | 215/363 [00:12<00:04, 32.90it/s]
Loading 0:  61%|██████    | 220/363 [00:12<00:03, 36.06it/s]
Loading 0:  62%|██████▏   | 224/363 [00:12<00:03, 35.61it/s]
Loading 0:  63%|██████▎   | 229/363 [00:12<00:03, 38.57it/s]
Loading 0:  64%|██████▍   | 233/363 [00:12<00:03, 37.13it/s]
Loading 0:  66%|██████▌   | 238/363 [00:12<00:03, 38.72it/s]
Loading 0:  67%|██████▋   | 242/363 [00:12<00:03, 36.07it/s]
Loading 0:  68%|██████▊   | 247/363 [00:12<00:03, 38.52it/s]
Loading 0:  69%|██████▉   | 251/363 [00:13<00:02, 37.75it/s]
Loading 0:  71%|███████   | 256/363 [00:13<00:02, 40.27it/s]
Loading 0:  72%|███████▏  | 261/363 [00:13<00:02, 40.62it/s]
Loading 0:  73%|███████▎  | 266/363 [00:13<00:02, 40.77it/s]
Loading 0:  75%|███████▍  | 271/363 [00:13<00:02, 41.50it/s]
Loading 0:  76%|███████▌  | 276/363 [00:13<00:02, 33.19it/s]
Loading 0:  78%|███████▊  | 283/363 [00:14<00:02, 29.24it/s]
Loading 0:  79%|███████▉  | 287/363 [00:14<00:02, 29.90it/s]
Loading 0:  80%|████████  | 292/363 [00:14<00:02, 32.94it/s]
Loading 0:  82%|████████▏ | 296/363 [00:14<00:02, 32.95it/s]
Loading 0:  83%|████████▎ | 301/363 [00:14<00:01, 35.77it/s]
Loading 0:  84%|████████▍ | 305/363 [00:14<00:01, 35.07it/s]
Loading 0:  85%|████████▌ | 310/363 [00:14<00:01, 37.50it/s]
Loading 0:  87%|████████▋ | 314/363 [00:14<00:01, 36.46it/s]
Loading 0:  88%|████████▊ | 319/363 [00:15<00:01, 38.91it/s]
Loading 0:  89%|████████▉ | 323/363 [00:15<00:01, 37.61it/s]
Loading 0:  90%|█████████ | 328/363 [00:15<00:00, 39.57it/s]
Loading 0:  91%|█████████▏| 332/363 [00:15<00:00, 38.01it/s]
Loading 0:  93%|█████████▎| 337/363 [00:15<00:00, 40.01it/s]
Loading 0:  94%|█████████▍| 342/363 [00:15<00:00, 39.53it/s]
Loading 0:  95%|█████████▌| 346/363 [00:15<00:00, 39.00it/s]
Loading 0:  96%|█████████▋| 350/363 [00:15<00:00, 37.32it/s]
Loading 0:  98%|█████████▊| 355/363 [00:15<00:00, 39.52it/s]
Loading 0:  99%|█████████▉| 359/363 [00:16<00:00, 37.50it/s]
                                                            
Job nitral-ai-captain-bmo-12b-v4-mkmlizer completed after 96.23s with status: succeeded
nitral-ai-captain-bmo-12b-v5-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/nitral-ai-captain-bmo-12b-v5/flywheel_model.0.safetensors
Stopping job with name nitral-ai-captain-bmo-12b-v4-mkmlizer
nitral-ai-captain-bmo-12b-v5-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 2/363 [00:06<18:20,  3.05s/it]
Loading 0:   2%|▏         | 6/363 [00:06<04:53,  1.22it/s]
Loading 0:   3%|▎         | 11/363 [00:06<02:08,  2.73it/s]
Loading 0:   4%|▍         | 15/363 [00:06<01:21,  4.25it/s]
Loading 0:   6%|▌         | 22/363 [00:06<00:42,  7.96it/s]
Loading 0:   7%|▋         | 27/363 [00:06<00:30, 10.87it/s]
Loading 0:   9%|▉         | 32/363 [00:06<00:23, 14.30it/s]
Loading 0:  10%|█         | 37/363 [00:06<00:17, 18.20it/s]
Loading 0:  12%|█▏        | 42/363 [00:07<00:19, 16.57it/s]
Loading 0:  13%|█▎        | 49/363 [00:07<00:13, 23.19it/s]
Loading 0:  15%|█▍        | 54/363 [00:07<00:11, 26.05it/s]
Loading 0:  16%|█▋        | 59/363 [00:07<00:10, 29.24it/s]
Loading 0:  18%|█▊        | 64/363 [00:07<00:09, 32.57it/s]
Loading 0:  19%|█▉        | 69/363 [00:08<00:09, 29.69it/s]
Loading 0:  21%|██        | 76/363 [00:08<00:07, 36.95it/s]
Loading 0:  22%|██▏       | 81/363 [00:08<00:07, 37.33it/s]
Loading 0:  24%|██▎       | 86/363 [00:08<00:07, 37.91it/s]
Loading 0:  25%|██▌       | 91/363 [00:08<00:06, 38.96it/s]
Loading 0:  26%|██▋       | 96/363 [00:08<00:08, 31.18it/s]
Loading 0:  28%|██▊       | 103/363 [00:08<00:06, 37.17it/s]
Loading 0:  30%|██▉       | 108/363 [00:08<00:06, 37.30it/s]
Loading 0:  31%|███       | 113/363 [00:09<00:06, 37.67it/s]
Loading 0:  32%|███▏      | 117/363 [00:09<00:06, 37.51it/s]
Loading 0:  33%|███▎      | 121/363 [00:09<00:08, 27.04it/s]
Loading 0:  34%|███▍      | 125/363 [00:09<00:08, 28.36it/s]
Loading 0:  36%|███▌      | 130/363 [00:09<00:07, 32.17it/s]
Loading 0:  37%|███▋      | 134/363 [00:09<00:07, 31.73it/s]
Loading 0:  38%|███▊      | 139/363 [00:09<00:06, 34.80it/s]
Loading 0:  39%|███▉      | 143/363 [00:10<00:06, 34.07it/s]
Loading 0:  41%|████      | 148/363 [00:10<00:05, 36.92it/s]
Loading 0:  42%|████▏     | 152/363 [00:10<00:05, 36.00it/s]
Loading 0:  43%|████▎     | 157/363 [00:10<00:05, 38.07it/s]
Loading 0:  44%|████▍     | 161/363 [00:10<00:05, 36.34it/s]
Loading 0:  46%|████▌     | 166/363 [00:10<00:05, 38.62it/s]
Loading 0:  47%|████▋     | 170/363 [00:10<00:05, 36.55it/s]
Loading 0:  48%|████▊     | 175/363 [00:10<00:04, 38.92it/s]
Loading 0:  49%|████▉     | 179/363 [00:11<00:04, 37.68it/s]
Loading 0:  51%|█████     | 184/363 [00:11<00:04, 39.80it/s]
Loading 0:  52%|█████▏    | 189/363 [00:11<00:04, 38.39it/s]
Loading 0:  53%|█████▎    | 193/363 [00:11<00:04, 37.82it/s]
Loading 0:  54%|█████▍    | 197/363 [00:11<00:04, 33.63it/s]
Loading 0:  56%|█████▌    | 202/363 [00:11<00:06, 25.62it/s]
Loading 0:  56%|█████▋    | 205/363 [00:11<00:06, 25.58it/s]
Loading 0:  58%|█████▊    | 211/363 [00:12<00:04, 31.86it/s]
Loading 0:  59%|█████▉    | 215/363 [00:12<00:04, 32.52it/s]
Loading 0:  61%|██████    | 220/363 [00:12<00:03, 35.79it/s]
Loading 0:  62%|██████▏   | 224/363 [00:12<00:03, 35.36it/s]
Loading 0:  63%|██████▎   | 229/363 [00:12<00:03, 38.41it/s]
Loading 0:  64%|██████▍   | 233/363 [00:12<00:03, 36.99it/s]
Loading 0:  66%|██████▌   | 238/363 [00:12<00:03, 38.66it/s]
Loading 0:  67%|██████▋   | 242/363 [00:12<00:03, 36.93it/s]
Loading 0:  68%|██████▊   | 247/363 [00:12<00:02, 39.46it/s]
Loading 0:  69%|██████▉   | 252/363 [00:13<00:02, 39.78it/s]
Loading 0:  71%|███████   | 257/363 [00:13<00:02, 39.68it/s]
Loading 0:  72%|███████▏  | 261/363 [00:13<00:02, 39.41it/s]
Loading 0:  73%|███████▎  | 265/363 [00:13<00:02, 38.09it/s]
Loading 0:  74%|███████▍  | 269/363 [00:13<00:02, 36.35it/s]
Loading 0:  75%|███████▌  | 274/363 [00:13<00:02, 38.67it/s]
Loading 0:  77%|███████▋  | 278/363 [00:13<00:02, 36.80it/s]
Loading 0:  78%|███████▊  | 283/363 [00:14<00:02, 27.39it/s]
Loading 0:  79%|███████▉  | 287/363 [00:14<00:02, 28.63it/s]
Loading 0:  80%|████████  | 292/363 [00:14<00:02, 32.35it/s]
Loading 0:  82%|████████▏ | 296/363 [00:14<00:02, 32.55it/s]
Loading 0:  83%|████████▎ | 301/363 [00:14<00:01, 35.74it/s]
Loading 0:  84%|████████▍ | 305/363 [00:14<00:01, 34.97it/s]
Loading 0:  85%|████████▌ | 310/363 [00:14<00:01, 37.54it/s]
Loading 0:  87%|████████▋ | 314/363 [00:14<00:01, 36.29it/s]
Loading 0:  88%|████████▊ | 319/363 [00:15<00:01, 38.76it/s]
Loading 0:  89%|████████▉ | 323/363 [00:15<00:01, 37.31it/s]
Loading 0:  90%|█████████ | 328/363 [00:15<00:00, 39.19it/s]
Loading 0:  91%|█████████▏| 332/363 [00:15<00:00, 37.68it/s]
Loading 0:  93%|█████████▎| 337/363 [00:15<00:00, 39.99it/s]
Loading 0:  94%|█████████▍| 342/363 [00:15<00:00, 39.74it/s]
Loading 0:  95%|█████████▌| 346/363 [00:15<00:00, 39.40it/s]
Loading 0:  96%|█████████▋| 350/363 [00:15<00:00, 37.70it/s]
Loading 0:  98%|█████████▊| 355/363 [00:15<00:00, 39.87it/s]
Loading 0:  99%|█████████▉| 360/363 [00:16<00:00, 38.96it/s]
                                                            
Job nitral-ai-captain-bmo-12b-v5-mkmlizer completed after 96.31s with status: succeeded
Pipeline stage MKMLizer completed in 97.72s
Stopping job with name nitral-ai-captain-bmo-12b-v5-mkmlizer
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLizer completed in 97.18s
run pipeline stage %s
Pipeline stage MKMLTemplater completed in 0.27s
Running pipeline stage MKMLTemplater
run pipeline stage %s
Running pipeline stage MKMLDeployer
Pipeline stage MKMLTemplater completed in 0.30s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service nitral-ai-captain-bmo-12b-v4
Creating inference service nitral-ai-captain-bmo-12b-v5
Waiting for inference service nitral-ai-captain-bmo-12b-v4 to be ready
Waiting for inference service nitral-ai-captain-bmo-12b-v5 to be ready
Inference service nitral-ai-captain-bmo-12b-v4 ready after 150.5695836544037s
Pipeline stage MKMLDeployer completed in 151.66s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.247955322265625s
Received healthy response to inference request in 1.7887120246887207s
Received healthy response to inference request in 1.8042442798614502s
Received healthy response to inference request in 1.8395867347717285s
Inference service nitral-ai-captain-bmo-12b-v5 ready after 160.95537900924683s
Received healthy response to inference request in 1.7064435482025146s
Pipeline stage MKMLDeployer completed in 161.89s
5 requests
run pipeline stage %s
0 failed requests
Running pipeline stage StressChecker
5th percentile: 1.7228972434997558
10th percentile: 1.739350938796997
20th percentile: 1.7722583293914795
30th percentile: 1.7918184757232667
40th percentile: 1.7980313777923584
50th percentile: 1.8042442798614502
60th percentile: 1.8183812618255615
70th percentile: 1.8325182437896728
80th percentile: 1.921260452270508
90th percentile: 2.0846078872680662
95th percentile: 2.1662816047668456
99th percentile: 2.231620578765869
mean time: 1.8773883819580077
Pipeline stage StressChecker completed in 12.69s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
Received healthy response to inference request in 2.1828017234802246s
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Received healthy response to inference request in 3.3385655879974365s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 1.6754405498504639s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 5.78s
Shutdown handler de-registered
nitral-ai-captain-bmo-12b_v4 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2634.75s
Shutdown handler de-registered
nitral-ai-captain-bmo-12b_v4 status is now inactive due to auto deactivation removed underperforming models
nitral-ai-captain-bmo-12b_v4 status is now torndown due to DeploymentManager action