chaixmk1-trainer-bajem-2_3089

developer_uid: richhx
submission_id: chaixmk1-trainer-bajem-2_3089_v3
model_name: chaixmk1-trainer-bajem-2_3089_v3
model_group: ChaixMK1/trainer_bajem_2
status: torndown
timestamp: 2025-05-29T23:58:33+00:00
num_battles: 9330
num_wins: 4557
celo_rating: 1274.57
family_friendly_score: 0.505
family_friendly_standard_error: 0.007070714249635605
submission_type: basic
model_repo: ChaixMK1/trainer_bajem_2025-03-06-checkpoint-10
model_architecture: LlamaForSequenceClassification
model_num_parameters: 8030261248.0
best_of: 1
max_input_tokens: 256
max_output_tokens: 1
reward_model: default
display_name: chaixmk1-trainer-bajem-2_3089_v3
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaixMK1/trainer_bajem_2025-03-06-checkpoint-10
model_size: 8B
ranking_group: single
us_pacific_date: 2025-05-29
win_ratio: 0.4884244372990354
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 256, 'best_of': 1, 'max_output_tokens': 1}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaixmk1-trainer-bajem-2-3089-v3-mkmlizer
Waiting for job on chaixmk1-trainer-bajem-2-3089-v3-mkmlizer to finish
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: ║     _____            __           __                                ║
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: ║       /___/                                                         ║
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: ║                                                                     ║
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: ║  Version: 0.12.8                                                    ║
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: ║  https://mk1.ai                                                     ║
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: ║                                                                     ║
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: ║  The license key for the current software has been verified as      ║
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: ║  belonging to:                                                      ║
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: ║                                                                     ║
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: ║  Chai Research Corp.                                                ║
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: ║                                                                     ║
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: quantized model in 85.247s
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: Processed model ChaixMK1/trainer_bajem_2025-03-06-checkpoint-10 in 110.313s
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: creating bucket guanaco-mkml-models
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaixmk1-trainer-bajem-2-3089-v3
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaixmk1-trainer-bajem-2-3089-v3/config.json
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaixmk1-trainer-bajem-2-3089-v3/special_tokens_map.json
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaixmk1-trainer-bajem-2-3089-v3/tokenizer_config.json
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaixmk1-trainer-bajem-2-3089-v3/tokenizer.json
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaixmk1-trainer-bajem-2-3089-v3/flywheel_model.0.safetensors
chaixmk1-trainer-bajem-2-3089-v3-mkmlizer: 
Loading 0:   0%|          | 0/291 [00:00<?, ?it/s]
Loading 0:   1%|          | 3/291 [00:00<00:56,  5.09it/s]
Loading 0:   1%|▏         | 4/291 [00:01<01:31,  3.13it/s]
Loading 0:   2%|▏         | 5/291 [00:01<02:03,  2.32it/s]
Loading 0:   3%|▎         | 8/291 [00:02<01:03,  4.43it/s]
Loading 0:   3%|▎         | 9/291 [00:02<01:02,  4.50it/s]
Loading 0:   3%|▎         | 10/291 [00:02<00:54,  5.14it/s]
Loading 0:   4%|▍         | 12/291 [00:02<01:04,  4.30it/s]
Loading 0:   4%|▍         | 13/291 [00:03<01:25,  3.23it/s]
Loading 0:   5%|▍         | 14/291 [00:04<01:48,  2.56it/s]
Loading 0:   6%|▌         | 17/291 [00:04<01:02,  4.41it/s]
Loading 0:   6%|▌         | 18/291 [00:04<00:58,  4.65it/s]
Loading 0:   7%|▋         | 19/291 [00:04<00:52,  5.19it/s]
Loading 0:   7%|▋         | 21/291 [00:05<01:02,  4.33it/s]
Loading 0:   8%|▊         | 22/291 [00:05<01:22,  3.27it/s]
Loading 0:   8%|▊         | 23/291 [00:06<01:44,  2.57it/s]
Loading 0:   9%|▉         | 26/291 [00:06<01:00,  4.39it/s]
Loading 0:   9%|▉         | 27/291 [00:06<00:56,  4.63it/s]
Loading 0:  10%|█         | 30/291 [00:07<00:57,  4.53it/s]
Loading 0:  11%|█         | 31/291 [00:08<01:14,  3.51it/s]
Loading 0:  11%|█         | 32/291 [00:08<01:33,  2.76it/s]
Loading 0:  12%|█▏        | 35/291 [00:08<00:57,  4.42it/s]
Loading 0:  12%|█▏        | 36/291 [00:09<00:54,  4.65it/s]
Loading 0:  13%|█▎        | 37/291 [00:09<00:48,  5.20it/s]
Loading 0:  13%|█▎        | 39/291 [00:09<00:57,  4.38it/s]
Loading 0:  14%|█▎        | 40/291 [00:10<01:16,  3.30it/s]
Loading 0:  14%|█▍        | 41/291 [00:11<01:37,  2.57it/s]
Loading 0:  15%|█▌        | 44/291 [00:11<00:56,  4.34it/s]
Loading 0:  15%|█▌        | 45/291 [00:11<00:53,  4.58it/s]
Loading 0:  16%|█▌        | 46/291 [00:11<00:47,  5.15it/s]
Loading 0:  16%|█▋        | 48/291 [00:12<00:56,  4.33it/s]
Loading 0:  17%|█▋        | 49/291 [00:12<01:14,  3.27it/s]
Loading 0:  17%|█▋        | 50/291 [00:13<01:33,  2.59it/s]
Loading 0:  18%|█▊        | 53/291 [00:13<00:54,  4.39it/s]
Loading 0:  19%|█▊        | 54/291 [00:13<00:51,  4.64it/s]
Loading 0:  19%|█▉        | 55/291 [00:13<00:45,  5.24it/s]
Loading 0:  20%|█▉        | 57/291 [00:14<00:53,  4.38it/s]
Loading 0:  20%|█▉        | 58/291 [00:15<01:10,  3.31it/s]
Loading 0:  20%|██        | 59/291 [00:15<01:29,  2.60it/s]
Loading 0:  21%|██▏       | 62/291 [00:15<00:51,  4.47it/s]
Loading 0:  22%|██▏       | 63/291 [00:16<00:48,  4.71it/s]
Loading 0:  22%|██▏       | 64/291 [00:16<00:42,  5.28it/s]
Loading 0:  23%|██▎       | 66/291 [00:16<00:51,  4.40it/s]
Loading 0:  23%|██▎       | 67/291 [00:17<01:07,  3.31it/s]
Loading 0:  23%|██▎       | 68/291 [00:17<01:25,  2.60it/s]
Loading 0:  24%|██▍       | 71/291 [00:18<00:49,  4.49it/s]
Loading 0:  25%|██▍       | 72/291 [00:18<00:46,  4.72it/s]
Loading 0:  25%|██▌       | 73/291 [00:18<00:41,  5.30it/s]
Loading 0:  26%|██▌       | 75/291 [00:18<00:49,  4.36it/s]
Loading 0:  26%|██▌       | 76/291 [00:19<01:05,  3.28it/s]
Loading 0:  26%|██▋       | 77/291 [00:20<01:23,  2.57it/s]
Loading 0:  27%|██▋       | 80/291 [00:20<00:48,  4.36it/s]
Loading 0:  28%|██▊       | 81/291 [00:20<00:45,  4.61it/s]
Loading 0:  29%|██▊       | 83/291 [00:20<00:39,  5.24it/s]
Loading 0:  29%|██▉       | 84/291 [00:21<00:55,  3.71it/s]
Loading 0:  29%|██▉       | 85/291 [00:22<01:09,  2.95it/s]
Loading 0:  30%|██▉       | 86/291 [00:22<01:24,  2.42it/s]
Loading 0:  31%|███       | 89/291 [00:22<00:47,  4.23it/s]
Loading 0:  31%|███       | 90/291 [00:23<00:44,  4.48it/s]
Loading 0:  31%|███▏      | 91/291 [00:23<00:39,  5.08it/s]
Loading 0:  32%|███▏      | 93/291 [00:23<00:45,  4.31it/s]
Loading 0:  32%|███▏      | 94/291 [00:24<01:00,  3.28it/s]
Loading 0:  33%|███▎      | 95/291 [00:24<01:15,  2.59it/s]
Loading 0:  34%|███▎      | 98/291 [00:25<00:43,  4.41it/s]
Loading 0:  34%|███▍      | 99/291 [00:25<00:41,  4.66it/s]
Loading 0:  34%|███▍      | 100/291 [00:25<00:36,  5.26it/s]
Loading 0:  35%|███▌      | 102/291 [00:26<00:42,  4.40it/s]
Loading 0:  35%|███▌      | 103/291 [00:26<00:57,  3.29it/s]
Loading 0:  36%|███▌      | 104/291 [00:27<01:11,  2.60it/s]
Loading 0:  37%|███▋      | 107/291 [00:27<00:41,  4.48it/s]
Loading 0:  37%|███▋      | 108/291 [00:27<00:38,  4.71it/s]
Loading 0:  38%|███▊      | 110/291 [00:27<00:27,  6.47it/s]
Loading 0:  38%|███▊      | 112/291 [00:28<00:52,  3.38it/s]
Loading 0:  39%|███▉      | 113/291 [00:29<01:04,  2.74it/s]
Loading 0:  40%|███▉      | 116/291 [00:29<00:40,  4.35it/s]
Loading 0:  40%|████      | 117/291 [00:29<00:38,  4.57it/s]
Loading 0:  41%|████      | 118/291 [00:29<00:33,  5.09it/s]
Loading 0:  41%|████      | 120/291 [00:30<00:39,  4.34it/s]
Loading 0:  42%|████▏     | 121/291 [00:31<00:51,  3.32it/s]
Loading 0:  42%|████▏     | 122/291 [00:31<01:04,  2.63it/s]
Loading 0:  43%|████▎     | 125/291 [00:31<00:37,  4.47it/s]
Loading 0:  43%|████▎     | 126/291 [00:32<00:35,  4.71it/s]
Loading 0:  44%|████▎     | 127/291 [00:32<00:31,  5.24it/s]
Loading 0:  44%|████▍     | 129/291 [00:32<00:36,  4.39it/s]
Loading 0:  45%|████▍     | 130/291 [00:33<00:48,  3.32it/s]
Loading 0:  45%|████▌     | 131/291 [00:34<01:00,  2.63it/s]
Loading 0:  46%|████▌     | 134/291 [00:34<00:34,  4.52it/s]
Loading 0:  46%|████▋     | 135/291 [00:34<00:32,  4.76it/s]
Loading 0:  47%|████▋     | 138/291 [00:35<00:33,  4.60it/s]
Loading 0:  48%|████▊     | 139/291 [00:35<00:42,  3.57it/s]
Loading 0:  48%|████▊     | 140/291 [00:36<00:53,  2.84it/s]
Loading 0:  49%|████▉     | 143/291 [00:36<00:32,  4.59it/s]
Loading 0:  49%|████▉     | 144/291 [00:36<00:30,  4.80it/s]
Loading 0:  51%|█████     | 147/291 [00:37<00:31,  4.64it/s]
Loading 0:  51%|█████     | 148/291 [00:37<00:39,  3.61it/s]
Loading 0:  51%|█████     | 149/291 [00:38<00:49,  2.85it/s]
Loading 0:  52%|█████▏    | 152/291 [00:38<00:30,  4.58it/s]
Loading 0:  53%|█████▎    | 153/291 [00:38<00:28,  4.79it/s]
Loading 0:  53%|█████▎    | 154/291 [00:38<00:25,  5.33it/s]
Loading 0:  54%|█████▎    | 156/291 [00:39<00:30,  4.46it/s]
Loading 0:  54%|█████▍    | 157/291 [00:40<00:39,  3.37it/s]
Loading 0:  54%|█████▍    | 158/291 [00:40<00:49,  2.67it/s]
Loading 0:  55%|█████▌    | 161/291 [00:40<00:28,  4.55it/s]
Loading 0:  56%|█████▌    | 162/291 [00:41<00:26,  4.78it/s]
Loading 0:  56%|█████▌    | 163/291 [00:41<00:23,  5.37it/s]
Loading 0:  57%|█████▋    | 165/291 [00:41<00:28,  4.45it/s]
Loading 0:  57%|█████▋    | 166/291 [00:42<00:37,  3.35it/s]
Loading 0:  57%|█████▋    | 167/291 [00:43<00:47,  2.63it/s]
Loading 0:  58%|█████▊    | 170/291 [00:43<00:26,  4.51it/s]
Loading 0:  59%|█████▉    | 171/291 [00:43<00:25,  4.75it/s]
Loading 0:  59%|█████▉    | 173/291 [00:44<00:30,  3.93it/s]
Loading 0:  60%|██████    | 175/291 [00:44<00:23,  5.00it/s]
Loading 0:  60%|██████    | 176/291 [00:44<00:22,  5.18it/s]
Loading 0:  61%|██████    | 177/291 [00:44<00:19,  5.72it/s]
Loading 0:  62%|██████▏   | 179/291 [00:45<00:24,  4.59it/s]
Loading 0:  62%|██████▏   | 180/291 [00:45<00:32,  3.40it/s]
Loading 0:  62%|██████▏   | 181/291 [00:46<00:41,  2.67it/s]
Loading 0:  63%|██████▎   | 184/291 [00:46<00:23,  4.58it/s]
Loading 0:  64%|██████▎   | 185/291 [00:46<00:22,  4.80it/s]
Loading 0:  64%|██████▍   | 186/291 [00:46<00:19,  5.34it/s]
Loading 0:  64%|██████▍   | 187/291 [00:46<00:19,  5.47it/s]
Loading 0:  65%|██████▍   | 188/291 [00:47<00:28,  3.58it/s]
Loading 0:  65%|██████▍   | 189/291 [00:48<00:38,  2.68it/s]
Loading 0:  66%|██████▌   | 192/291 [00:48<00:27,  3.61it/s]
Loading 0:  66%|██████▋   | 193/291 [00:49<00:32,  2.97it/s]
Loading 0:  67%|██████▋   | 194/291 [00:49<00:39,  2.48it/s]
Loading 0:  68%|██████▊   | 197/291 [00:50<00:22,  4.23it/s]
Loading 0:  68%|██████▊   | 198/291 [00:50<00:20,  4.48it/s]
Loading 0:  68%|██████▊   | 199/291 [00:50<00:18,  5.05it/s]
Loading 0:  69%|██████▉   | 201/291 [00:50<00:21,  4.28it/s]
Loading 0:  69%|██████▉   | 202/291 [00:51<00:27,  3.28it/s]
Loading 0:  70%|██████▉   | 203/291 [00:52<00:33,  2.62it/s]
Loading 0:  71%|███████   | 206/291 [00:52<00:19,  4.42it/s]
Loading 0:  71%|███████   | 207/291 [00:52<00:17,  4.67it/s]
Loading 0:  71%|███████▏  | 208/291 [00:52<00:15,  5.26it/s]
Loading 0:  72%|███████▏  | 210/291 [00:53<00:18,  4.42it/s]
Loading 0:  73%|███████▎  | 211/291 [00:53<00:24,  3.33it/s]
Loading 0:  73%|███████▎  | 212/291 [00:54<00:29,  2.64it/s]
Loading 0:  74%|███████▍  | 215/291 [00:54<00:16,  4.52it/s]
Loading 0:  74%|███████▍  | 216/291 [00:54<00:15,  4.75it/s]
Loading 0:  75%|███████▍  | 217/291 [00:54<00:14,  5.27it/s]
Loading 0:  75%|███████▌  | 219/291 [00:55<00:16,  4.40it/s]
Loading 0:  76%|███████▌  | 220/291 [00:56<00:21,  3.33it/s]
Loading 0:  76%|███████▌  | 221/291 [00:56<00:26,  2.63it/s]
Loading 0:  77%|███████▋  | 224/291 [00:56<00:14,  4.52it/s]
Loading 0:  77%|███████▋  | 225/291 [00:56<00:13,  4.81it/s]
Loading 0:  78%|███████▊  | 226/291 [00:57<00:12,  5.31it/s]
Loading 0:  78%|███████▊  | 228/291 [00:57<00:14,  4.44it/s]
Loading 0:  79%|███████▊  | 229/291 [00:58<00:18,  3.34it/s]
Loading 0:  79%|███████▉  | 230/291 [00:58<00:23,  2.64it/s]
Loading 0:  80%|████████  | 233/291 [00:59<00:12,  4.55it/s]
Loading 0:  80%|████████  | 234/291 [00:59<00:11,  4.86it/s]
Loading 0:  81%|████████  | 235/291 [00:59<00:10,  5.47it/s]
Loading 0:  81%|████████▏ | 237/291 [00:59<00:12,  4.50it/s]
Loading 0:  82%|████████▏ | 238/291 [01:00<00:15,  3.35it/s]
Loading 0:  82%|████████▏ | 239/291 [01:01<00:19,  2.65it/s]
Loading 0:  83%|████████▎ | 242/291 [01:01<00:10,  4.55it/s]
Loading 0:  84%|████████▎ | 243/291 [01:01<00:10,  4.78it/s]
Loading 0:  84%|████████▍ | 244/291 [01:01<00:08,  5.37it/s]
Loading 0:  85%|████████▍ | 246/291 [01:02<00:10,  4.44it/s]
Loading 0:  85%|████████▍ | 247/291 [01:02<00:13,  3.35it/s]
Loading 0:  85%|████████▌ | 248/291 [01:03<00:16,  2.65it/s]
Loading 0:  86%|████████▋ | 251/291 [01:03<00:08,  4.50it/s]
Loading 0:  87%|████████▋ | 252/291 [01:03<00:08,  4.73it/s]
Loading 0:  87%|████████▋ | 253/291 [01:03<00:07,  5.31it/s]
Loading 0:  88%|████████▊ | 255/291 [01:04<00:08,  4.41it/s]
Loading 0:  88%|████████▊ | 256/291 [01:04<00:10,  3.33it/s]
Loading 0:  88%|████████▊ | 257/291 [01:05<00:12,  2.63it/s]
Loading 0:  89%|████████▉ | 260/291 [01:05<00:06,  4.53it/s]
Loading 0:  90%|████████▉ | 261/291 [01:05<00:06,  4.76it/s]
Loading 0:  90%|█████████ | 262/291 [01:06<00:05,  5.35it/s]
Loading 0:  91%|█████████ | 264/291 [01:06<00:06,  4.43it/s]
Loading 0:  91%|█████████ | 265/291 [01:07<00:07,  3.31it/s]
Loading 0:  91%|█████████▏| 266/291 [01:07<00:09,  2.62it/s]
Loading 0:  92%|█████████▏| 269/291 [01:08<00:04,  4.45it/s]
Loading 0:  93%|█████████▎| 270/291 [01:08<00:04,  4.68it/s]
Loading 0:  93%|█████████▎| 271/291 [01:08<00:03,  5.22it/s]
Loading 0:  94%|█████████▍| 273/291 [01:08<00:04,  4.37it/s]
Loading 0:  94%|█████████▍| 274/291 [01:09<00:05,  3.31it/s]
Loading 0:  95%|█████████▍| 275/291 [01:10<00:06,  2.63it/s]
Loading 0:  96%|█████████▌| 278/291 [01:10<00:02,  4.51it/s]
Loading 0:  96%|█████████▌| 279/291 [01:10<00:02,  4.74it/s]
Loading 0:  96%|█████████▌| 280/291 [01:10<00:02,  5.33it/s]
Loading 0:  97%|█████████▋| 281/291 [01:11<00:02,  3.58it/s]
Loading 0:  97%|█████████▋| 282/291 [01:11<00:03,  2.70it/s]
Loading 0:  98%|█████████▊| 284/291 [01:12<00:01,  3.87it/s]
Loading 0:  98%|█████████▊| 285/291 [01:12<00:01,  4.22it/s]
Loading 0:  98%|█████████▊| 286/291 [01:12<00:01,  4.92it/s]
Loading 0:  99%|█████████▊| 287/291 [01:12<00:00,  5.14it/s]
Loading 0:  99%|█████████▉| 288/291 [01:13<00:00,  3.31it/s]
                                                            
Job chaixmk1-trainer-bajem-2-3089-v3-mkmlizer completed after 135.19s with status: succeeded
Stopping job with name chaixmk1-trainer-bajem-2-3089-v3-mkmlizer
Pipeline stage MKMLizer completed in 135.65s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.16s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaixmk1-trainer-bajem-2-3089-v3
Waiting for inference service chaixmk1-trainer-bajem-2-3089-v3 to be ready
Inference service chaixmk1-trainer-bajem-2-3089-v3 ready after 150.64174056053162s
Pipeline stage MKMLDeployer completed in 151.15s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.199554920196533s
Received healthy response to inference request in 3.5235867500305176s
Received healthy response to inference request in 2.4632761478424072s
Received healthy response to inference request in 2.506443977355957s
Received healthy response to inference request in 4.142733812332153s
5 requests
0 failed requests
5th percentile: 2.4719097137451174
10th percentile: 2.480543279647827
20th percentile: 2.497810411453247
30th percentile: 2.709872531890869
40th percentile: 3.1167296409606933
50th percentile: 3.5235867500305176
60th percentile: 3.771245574951172
70th percentile: 4.018904399871826
80th percentile: 4.154098033905029
90th percentile: 4.176826477050781
95th percentile: 4.188190698623657
99th percentile: 4.197282075881958
mean time: 3.3671191215515135
%s, retrying in %s seconds...
Received healthy response to inference request in 2.976022481918335s
Received healthy response to inference request in 4.080828905105591s
Received healthy response to inference request in 2.7339367866516113s
Received healthy response to inference request in 2.747797727584839s
Received healthy response to inference request in 4.7098002433776855s
5 requests
0 failed requests
5th percentile: 2.736708974838257
10th percentile: 2.7394811630249025
20th percentile: 2.7450255393981933
30th percentile: 2.7934426784515383
40th percentile: 2.8847325801849366
50th percentile: 2.976022481918335
60th percentile: 3.417945051193237
70th percentile: 3.8598676204681395
80th percentile: 4.20662317276001
90th percentile: 4.4582117080688475
95th percentile: 4.584005975723266
99th percentile: 4.684641389846802
mean time: 3.4496772289276123
%s, retrying in %s seconds...
Received healthy response to inference request in 3.4423444271087646s
Received healthy response to inference request in 4.0981903076171875s
Received healthy response to inference request in 3.4380509853363037s
Received healthy response to inference request in 2.665351152420044s
Received healthy response to inference request in 3.072727918624878s
5 requests
0 failed requests
5th percentile: 2.746826505661011
10th percentile: 2.8283018589019777
20th percentile: 2.991252565383911
30th percentile: 3.145792531967163
40th percentile: 3.2919217586517333
50th percentile: 3.4380509853363037
60th percentile: 3.439768362045288
70th percentile: 3.4414857387542725
80th percentile: 3.5735136032104493
90th percentile: 3.835851955413818
95th percentile: 3.967021131515503
99th percentile: 4.071956472396851
mean time: 3.3433329582214357
Pipeline stage StressChecker completed in 54.22s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.68s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 0.65s
Shutdown handler de-registered
chaixmk1-trainer-bajem-2_3089_v3 status is now deployed due to DeploymentManager action
Shutdown handler registered
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3138.26s
Shutdown handler de-registered
chaixmk1-trainer-bajem-2_3089_v3 status is now inactive due to auto deactivation removed underperforming models
chaixmk1-trainer-bajem-2_3089_v3 status is now torndown due to DeploymentManager action