christiansgao-test-blu_98235

developer_uid: christiansgao
submission_id: christiansgao-test-blu_98235_v36
model_name: christiansgao-test-blu_98235_v36
model_group: christiansgao/test-bluem
status: torndown
timestamp: 2025-09-07T14:36:31+00:00
num_battles: 6064
num_wins: 3032
celo_rating: 1245.72
family_friendly_score: 0.5866
family_friendly_standard_error: 0.0069642004566209895
submission_type: basic
model_repo: christiansgao/test-bluemoon-model
model_architecture: MistralForCausalLM
model_num_parameters: 12772070400.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
reward_model: default
latencies: [{'batch_size': 1, 'throughput': 0.9377363080303281, 'latency_mean': 1.066284646987915, 'latency_p50': 1.0588470697402954, 'latency_p90': 1.1947105646133422}, {'batch_size': 5, 'throughput': 2.407715368235125, 'latency_mean': 2.060427248477936, 'latency_p50': 2.0564377307891846, 'latency_p90': 2.288358235359192}, {'batch_size': 10, 'throughput': 3.0203526517416925, 'latency_mean': 3.2838604629039763, 'latency_p50': 3.2862213850021362, 'latency_p90': 3.772424054145813}, {'batch_size': 15, 'throughput': 3.2292664591534717, 'latency_mean': 4.5806390821933745, 'latency_p50': 4.607024431228638, 'latency_p90': 5.242154049873352}, {'batch_size': 20, 'throughput': 3.2554339637852703, 'latency_mean': 6.024947477579117, 'latency_p50': 6.1021294593811035, 'latency_p90': 6.918737268447876}]
gpu_counts: {'NVIDIA L40S': 1}
display_name: christiansgao-test-blu_98235_v36
ineligible_reason: num_battles<10000
is_internal_developer: True
language_model: christiansgao/test-bluemoon-model
model_size: 13B
ranking_group: single
throughput_3p7s: 3.14
us_pacific_date: 2025-09-07
win_ratio: 0.5
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name christiansgao-test-blu-98235-v36-mkmlizer
Waiting for job on christiansgao-test-blu-98235-v36-mkmlizer to finish
christiansgao-test-blu-98235-v36-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
christiansgao-test-blu-98235-v36-mkmlizer: ║                                                                     ║
christiansgao-test-blu-98235-v36-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
christiansgao-test-blu-98235-v36-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
christiansgao-test-blu-98235-v36-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
christiansgao-test-blu-98235-v36-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
christiansgao-test-blu-98235-v36-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
christiansgao-test-blu-98235-v36-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
christiansgao-test-blu-98235-v36-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
christiansgao-test-blu-98235-v36-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
christiansgao-test-blu-98235-v36-mkmlizer: ║                                                                     ║
christiansgao-test-blu-98235-v36-mkmlizer: ║  Version: 0.30.2                                                    ║
christiansgao-test-blu-98235-v36-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
christiansgao-test-blu-98235-v36-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
christiansgao-test-blu-98235-v36-mkmlizer: ║  https://mk1.ai                                                     ║
christiansgao-test-blu-98235-v36-mkmlizer: ║                                                                     ║
christiansgao-test-blu-98235-v36-mkmlizer: ║  The license key for the current software has been verified as      ║
christiansgao-test-blu-98235-v36-mkmlizer: ║  belonging to:                                                      ║
christiansgao-test-blu-98235-v36-mkmlizer: ║                                                                     ║
christiansgao-test-blu-98235-v36-mkmlizer: ║  Chai Research Corp.                                                ║
christiansgao-test-blu-98235-v36-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
christiansgao-test-blu-98235-v36-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
christiansgao-test-blu-98235-v36-mkmlizer: ║                                                                     ║
christiansgao-test-blu-98235-v36-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
HTTP Request: %s %s "%s %d %s"
christiansgao-test-blu-98235-v36-mkmlizer: Downloaded to shared memory in 60.239s
christiansgao-test-blu-98235-v36-mkmlizer: Checking if christiansgao/test-bluemoon-model already exists in ChaiML
christiansgao-test-blu-98235-v36-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpqo6rtqw7, device:0
christiansgao-test-blu-98235-v36-mkmlizer: Saving flywheel model at /dev/shm/model_cache
christiansgao-test-blu-98235-v36-mkmlizer: quantized model in 145.669s
christiansgao-test-blu-98235-v36-mkmlizer: Processed model christiansgao/test-bluemoon-model in 205.929s
christiansgao-test-blu-98235-v36-mkmlizer: creating bucket guanaco-mkml-models
christiansgao-test-blu-98235-v36-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
christiansgao-test-blu-98235-v36-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/christiansgao-test-blu-98235-v36/nvidia
christiansgao-test-blu-98235-v36-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/christiansgao-test-blu-98235-v36/nvidia/config.json
christiansgao-test-blu-98235-v36-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/christiansgao-test-blu-98235-v36/nvidia/special_tokens_map.json
christiansgao-test-blu-98235-v36-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/christiansgao-test-blu-98235-v36/nvidia/tokenizer_config.json
christiansgao-test-blu-98235-v36-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/christiansgao-test-blu-98235-v36/nvidia/tokenizer.json
christiansgao-test-blu-98235-v36-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/christiansgao-test-blu-98235-v36/nvidia/flywheel_model.0.safetensors
christiansgao-test-blu-98235-v36-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3/363 [00:00<01:43,  3.49it/s]
Loading 0:   1%|          | 4/363 [00:01<02:49,  2.12it/s]
Loading 0:   1%|▏         | 5/363 [00:02<03:44,  1.59it/s]
Loading 0:   2%|▏         | 8/363 [00:03<01:56,  3.05it/s]
Loading 0:   2%|▏         | 9/363 [00:03<01:52,  3.15it/s]
Loading 0:   3%|▎         | 10/363 [00:03<01:36,  3.67it/s]
Loading 0:   3%|▎         | 12/363 [00:04<01:57,  2.98it/s]
Loading 0:   4%|▎         | 13/363 [00:05<02:38,  2.21it/s]
Loading 0:   4%|▍         | 14/363 [00:06<03:17,  1.76it/s]
Loading 0:   5%|▍         | 17/363 [00:06<01:54,  3.03it/s]
Loading 0:   5%|▍         | 18/363 [00:06<01:48,  3.18it/s]
Loading 0:   5%|▌         | 19/363 [00:06<01:33,  3.69it/s]
Loading 0:   6%|▌         | 21/363 [00:07<01:53,  3.01it/s]
Loading 0:   6%|▌         | 22/363 [00:08<02:31,  2.25it/s]
Loading 0:   6%|▋         | 23/363 [00:09<03:09,  1.80it/s]
Loading 0:   7%|▋         | 26/363 [00:09<01:49,  3.08it/s]
Loading 0:   7%|▋         | 27/363 [00:09<01:43,  3.26it/s]
Loading 0:   8%|▊         | 28/363 [00:09<01:28,  3.77it/s]
Loading 0:   8%|▊         | 30/363 [00:10<01:49,  3.05it/s]
Loading 0:   9%|▊         | 31/363 [00:11<02:26,  2.27it/s]
Loading 0:   9%|▉         | 32/363 [00:12<03:02,  1.81it/s]
Loading 0:  10%|▉         | 35/363 [00:12<01:46,  3.07it/s]
Loading 0:  10%|▉         | 36/363 [00:13<01:41,  3.21it/s]
Loading 0:  10%|█         | 37/363 [00:13<01:29,  3.64it/s]
Loading 0:  11%|█         | 39/363 [00:14<01:48,  2.99it/s]
Loading 0:  11%|█         | 40/363 [00:15<02:23,  2.25it/s]
Loading 0:  11%|█▏        | 41/363 [00:15<02:58,  1.80it/s]
Loading 0:  12%|█▏        | 44/363 [00:16<01:43,  3.08it/s]
Loading 0:  12%|█▏        | 45/363 [00:16<01:38,  3.23it/s]
Loading 0:  13%|█▎        | 46/363 [00:16<01:24,  3.73it/s]
Loading 0:  13%|█▎        | 48/363 [00:17<01:43,  3.03it/s]
Loading 0:  13%|█▎        | 49/363 [00:18<02:18,  2.26it/s]
Loading 0:  14%|█▍        | 50/363 [00:19<02:53,  1.80it/s]
Loading 0:  15%|█▍        | 53/363 [00:19<01:41,  3.05it/s]
Loading 0:  15%|█▍        | 54/363 [00:19<01:36,  3.20it/s]
Loading 0:  15%|█▌        | 55/363 [00:19<01:23,  3.68it/s]
Loading 0:  15%|█▌        | 56/363 [00:20<02:06,  2.43it/s]
Loading 0:  16%|█▌        | 58/363 [00:21<01:32,  3.30it/s]
Loading 0:  16%|█▋        | 59/363 [00:21<01:28,  3.45it/s]
Loading 0:  17%|█▋        | 60/363 [00:21<01:15,  4.00it/s]
Loading 0:  17%|█▋        | 61/363 [00:21<01:05,  4.62it/s]
Loading 0:  17%|█▋        | 62/363 [00:22<01:58,  2.54it/s]
Loading 0:  17%|█▋        | 63/363 [00:23<02:36,  1.91it/s]
Loading 0:  18%|█▊        | 64/363 [00:24<03:10,  1.57it/s]
Loading 0:  18%|█▊        | 67/363 [00:24<01:40,  2.94it/s]
Loading 0:  19%|█▊        | 68/363 [00:24<01:34,  3.12it/s]
Loading 0:  19%|█▉        | 69/363 [00:24<01:20,  3.66it/s]
Loading 0:  20%|█▉        | 71/363 [00:25<01:38,  2.97it/s]
Loading 0:  20%|█▉        | 72/363 [00:26<02:11,  2.22it/s]
Loading 0:  20%|██        | 73/363 [00:27<02:43,  1.77it/s]
Loading 0:  21%|██        | 76/363 [00:27<01:34,  3.03it/s]
Loading 0:  21%|██        | 77/363 [00:28<01:29,  3.19it/s]
Loading 0:  21%|██▏       | 78/363 [00:28<01:17,  3.69it/s]
Loading 0:  22%|██▏       | 80/363 [00:29<01:34,  2.99it/s]
Loading 0:  22%|██▏       | 81/363 [00:29<02:06,  2.23it/s]
Loading 0:  23%|██▎       | 82/363 [00:30<02:37,  1.78it/s]
Loading 0:  23%|██▎       | 85/363 [00:31<01:31,  3.03it/s]
Loading 0:  24%|██▎       | 86/363 [00:31<01:26,  3.19it/s]
Loading 0:  24%|██▍       | 87/363 [00:31<01:15,  3.68it/s]
Loading 0:  25%|██▍       | 89/363 [00:32<01:31,  3.00it/s]
Loading 0:  25%|██▍       | 90/363 [00:33<02:01,  2.24it/s]
Loading 0:  25%|██▌       | 91/363 [00:34<02:32,  1.78it/s]
Loading 0:  26%|██▌       | 94/363 [00:34<01:28,  3.06it/s]
Loading 0:  26%|██▌       | 95/363 [00:34<01:23,  3.21it/s]
Loading 0:  26%|██▋       | 96/363 [00:34<01:12,  3.70it/s]
Loading 0:  27%|██▋       | 98/363 [00:35<01:27,  3.02it/s]
Loading 0:  27%|██▋       | 99/363 [00:36<01:57,  2.25it/s]
Loading 0:  28%|██▊       | 100/363 [00:37<02:26,  1.80it/s]
Loading 0:  28%|██▊       | 103/363 [00:37<01:25,  3.06it/s]
Loading 0:  29%|██▊       | 104/363 [00:37<01:20,  3.21it/s]
Loading 0:  29%|██▉       | 105/363 [00:38<01:09,  3.71it/s]
Loading 0:  29%|██▉       | 106/363 [00:38<01:45,  2.44it/s]
Loading 0:  30%|██▉       | 108/363 [00:39<01:16,  3.31it/s]
Loading 0:  30%|███       | 109/363 [00:39<01:13,  3.46it/s]
Loading 0:  30%|███       | 110/363 [00:39<01:03,  4.01it/s]
Loading 0:  31%|███       | 112/363 [00:40<01:21,  3.10it/s]
Loading 0:  31%|███       | 113/363 [00:41<01:54,  2.19it/s]
Loading 0:  32%|███▏      | 116/363 [00:42<01:32,  2.68it/s]
Loading 0:  32%|███▏      | 117/363 [00:43<01:54,  2.15it/s]
Loading 0:  33%|███▎      | 118/363 [00:44<02:17,  1.78it/s]
Loading 0:  33%|███▎      | 121/363 [00:44<01:22,  2.93it/s]
Loading 0:  34%|███▎      | 122/363 [00:44<01:17,  3.09it/s]
Loading 0:  34%|███▍      | 123/363 [00:44<01:08,  3.52it/s]
Loading 0:  34%|███▍      | 125/363 [00:45<01:21,  2.91it/s]
Loading 0:  35%|███▍      | 126/363 [00:46<01:46,  2.22it/s]
Loading 0:  35%|███▍      | 127/363 [00:47<02:11,  1.79it/s]
Loading 0:  36%|███▌      | 130/363 [00:47<01:16,  3.03it/s]
Loading 0:  36%|███▌      | 131/363 [00:47<01:12,  3.19it/s]
Loading 0:  36%|███▋      | 132/363 [00:48<01:03,  3.66it/s]
Loading 0:  37%|███▋      | 134/363 [00:48<01:16,  3.00it/s]
Loading 0:  37%|███▋      | 135/363 [00:49<01:41,  2.25it/s]
Loading 0:  37%|███▋      | 136/363 [00:50<02:06,  1.80it/s]
Loading 0:  38%|███▊      | 139/363 [00:50<01:13,  3.05it/s]
Loading 0:  39%|███▊      | 140/363 [00:51<01:09,  3.20it/s]
Loading 0:  39%|███▉      | 141/363 [00:51<01:00,  3.70it/s]
Loading 0:  39%|███▉      | 142/363 [00:51<00:52,  4.23it/s]
Loading 0:  39%|███▉      | 143/363 [00:52<01:26,  2.54it/s]
Loading 0:  40%|███▉      | 144/363 [00:53<01:56,  1.88it/s]
Loading 0:  40%|████      | 147/363 [00:54<01:27,  2.48it/s]
Loading 0:  41%|████      | 148/363 [00:54<01:46,  2.02it/s]
Loading 0:  41%|████      | 149/363 [00:55<02:07,  1.68it/s]
Loading 0:  42%|████▏     | 152/363 [00:56<01:13,  2.86it/s]
Loading 0:  42%|████▏     | 153/363 [00:56<01:09,  3.03it/s]
Loading 0:  42%|████▏     | 154/363 [00:56<00:59,  3.49it/s]
Loading 0:  43%|████▎     | 156/363 [00:57<01:10,  2.92it/s]
Loading 0:  43%|████▎     | 157/363 [00:58<01:33,  2.21it/s]
Loading 0:  44%|████▎     | 158/363 [00:59<01:55,  1.78it/s]
Loading 0:  44%|████▍     | 161/363 [00:59<01:06,  3.02it/s]
Loading 0:  45%|████▍     | 162/363 [00:59<01:03,  3.17it/s]
Loading 0:  45%|████▍     | 163/363 [00:59<00:54,  3.65it/s]
Loading 0:  45%|████▌     | 165/363 [01:00<01:06,  3.00it/s]
Loading 0:  46%|████▌     | 166/363 [01:01<01:27,  2.24it/s]
Loading 0:  46%|████▌     | 167/363 [01:02<01:48,  1.80it/s]
Loading 0:  47%|████▋     | 170/363 [01:02<01:02,  3.07it/s]
Loading 0:  47%|████▋     | 171/363 [01:03<00:59,  3.22it/s]
Loading 0:  47%|████▋     | 172/363 [01:03<00:52,  3.67it/s]
Loading 0:  48%|████▊     | 174/363 [01:04<01:02,  3.01it/s]
Loading 0:  48%|████▊     | 175/363 [01:04<01:23,  2.25it/s]
Loading 0:  48%|████▊     | 176/363 [01:05<01:43,  1.80it/s]
Loading 0:  49%|████▉     | 179/363 [01:06<01:00,  3.05it/s]
Loading 0:  50%|████▉     | 180/363 [01:06<00:57,  3.20it/s]
Loading 0:  50%|████▉     | 181/363 [01:06<00:49,  3.69it/s]
Loading 0:  50%|█████     | 183/363 [01:07<00:59,  3.02it/s]
Loading 0:  51%|█████     | 184/363 [01:08<01:19,  2.25it/s]
Loading 0:  51%|█████     | 185/363 [01:09<01:38,  1.80it/s]
Loading 0:  52%|█████▏    | 188/363 [01:09<00:57,  3.05it/s]
Loading 0:  52%|█████▏    | 189/363 [01:09<00:54,  3.20it/s]
Loading 0:  52%|█████▏    | 190/363 [01:09<00:46,  3.69it/s]
Loading 0:  53%|█████▎    | 192/363 [01:10<00:56,  3.02it/s]
Loading 0:  53%|█████▎    | 193/363 [01:11<01:15,  2.25it/s]
Loading 0:  53%|█████▎    | 194/363 [01:12<01:34,  1.80it/s]
Loading 0:  54%|█████▍    | 197/363 [01:12<00:54,  3.04it/s]
Loading 0:  55%|█████▍    | 198/363 [01:12<00:51,  3.19it/s]
Loading 0:  55%|█████▍    | 199/363 [01:13<00:44,  3.70it/s]
Loading 0:  55%|█████▌    | 201/363 [01:13<00:53,  3.02it/s]
Loading 0:  56%|█████▌    | 202/363 [01:14<01:11,  2.25it/s]
Loading 0:  56%|█████▌    | 203/363 [01:15<01:28,  1.80it/s]
Loading 0:  57%|█████▋    | 206/363 [01:16<00:51,  3.04it/s]
Loading 0:  57%|█████▋    | 207/363 [01:16<00:48,  3.20it/s]
Loading 0:  57%|█████▋    | 208/363 [01:16<00:42,  3.64it/s]
Loading 0:  58%|█████▊    | 210/363 [01:17<00:51,  2.99it/s]
Loading 0:  58%|█████▊    | 211/363 [01:18<01:07,  2.24it/s]
Loading 0:  58%|█████▊    | 212/363 [01:19<01:24,  1.79it/s]
Loading 0:  59%|█████▉    | 215/363 [01:19<00:49,  3.02it/s]
Loading 0:  60%|█████▉    | 216/363 [01:19<00:46,  3.17it/s]
Loading 0:  60%|█████▉    | 217/363 [01:19<00:39,  3.65it/s]
Loading 0:  60%|██████    | 218/363 [01:20<00:59,  2.43it/s]
Loading 0:  61%|██████    | 220/363 [01:20<00:43,  3.31it/s]
Loading 0:  61%|██████    | 221/363 [01:21<00:41,  3.45it/s]
Loading 0:  61%|██████    | 222/363 [01:21<00:34,  4.04it/s]
Loading 0:  61%|██████▏   | 223/363 [01:21<00:30,  4.58it/s]
Loading 0:  62%|██████▏   | 224/363 [01:22<00:54,  2.56it/s]
Loading 0:  62%|██████▏   | 225/363 [01:23<01:14,  1.86it/s]
Loading 0:  63%|██████▎   | 228/363 [01:24<00:54,  2.49it/s]
Loading 0:  63%|██████▎   | 229/363 [01:24<01:06,  2.02it/s]
Loading 0:  63%|██████▎   | 230/363 [01:25<01:18,  1.69it/s]
Loading 0:  64%|██████▍   | 233/363 [01:26<00:44,  2.89it/s]
Loading 0:  64%|██████▍   | 234/363 [01:26<00:42,  3.06it/s]
Loading 0:  65%|██████▍   | 235/363 [01:26<00:36,  3.52it/s]
Loading 0:  65%|██████▌   | 237/363 [01:27<00:42,  2.95it/s]
Loading 0:  66%|██████▌   | 238/363 [01:28<00:56,  2.23it/s]
Loading 0:  66%|██████▌   | 239/363 [01:29<01:09,  1.78it/s]
Loading 0:  67%|██████▋   | 242/363 [01:29<00:40,  3.02it/s]
Loading 0:  67%|██████▋   | 243/363 [01:29<00:37,  3.17it/s]
Loading 0:  67%|██████▋   | 244/363 [01:29<00:32,  3.67it/s]
Loading 0:  68%|██████▊   | 246/363 [01:30<00:39,  2.97it/s]
Loading 0:  68%|██████▊   | 247/363 [01:31<00:52,  2.23it/s]
Loading 0:  68%|██████▊   | 248/363 [01:32<01:04,  1.78it/s]
Loading 0:  69%|██████▉   | 251/363 [01:32<00:36,  3.03it/s]
Loading 0:  69%|██████▉   | 252/363 [01:33<00:34,  3.19it/s]
Loading 0:  70%|██████▉   | 253/363 [01:33<00:29,  3.68it/s]
Loading 0:  70%|███████   | 255/363 [01:33<00:35,  3.01it/s]
Loading 0:  71%|███████   | 256/363 [01:34<00:47,  2.25it/s]
Loading 0:  71%|███████   | 257/363 [01:35<00:58,  1.81it/s]
Loading 0:  72%|███████▏  | 260/363 [01:36<00:33,  3.09it/s]
Loading 0:  72%|███████▏  | 261/363 [01:36<00:31,  3.24it/s]
Loading 0:  72%|███████▏  | 262/363 [01:36<00:26,  3.74it/s]
Loading 0:  73%|███████▎  | 264/363 [01:37<00:32,  3.04it/s]
Loading 0:  73%|███████▎  | 265/363 [01:38<00:43,  2.26it/s]
Loading 0:  73%|███████▎  | 266/363 [01:39<00:54,  1.79it/s]
Loading 0:  74%|███████▍  | 269/363 [01:39<00:30,  3.04it/s]
Loading 0:  74%|███████▍  | 270/363 [01:39<00:29,  3.19it/s]
Loading 0:  75%|███████▍  | 271/363 [01:39<00:24,  3.69it/s]
Loading 0:  75%|███████▌  | 273/363 [01:40<00:29,  3.01it/s]
Loading 0:  75%|███████▌  | 274/363 [01:41<00:39,  2.25it/s]
Loading 0:  76%|███████▌  | 275/363 [01:42<00:48,  1.80it/s]
Loading 0:  77%|███████▋  | 278/363 [01:42<00:28,  3.04it/s]
Loading 0:  77%|███████▋  | 279/363 [01:42<00:26,  3.19it/s]
Loading 0:  77%|███████▋  | 280/363 [01:43<00:22,  3.68it/s]
Loading 0:  78%|███████▊  | 282/363 [01:43<00:26,  3.01it/s]
Loading 0:  78%|███████▊  | 283/363 [01:44<00:35,  2.25it/s]
Loading 0:  78%|███████▊  | 284/363 [01:45<00:44,  1.80it/s]
Loading 0:  79%|███████▉  | 287/363 [01:45<00:25,  3.03it/s]
Loading 0:  79%|███████▉  | 288/363 [01:46<00:23,  3.19it/s]
Loading 0:  80%|███████▉  | 289/363 [01:46<00:20,  3.66it/s]
Loading 0:  80%|████████  | 291/363 [01:47<00:23,  3.00it/s]
Loading 0:  80%|████████  | 292/363 [01:48<00:31,  2.25it/s]
Loading 0:  81%|████████  | 293/363 [01:48<00:38,  1.80it/s]
Loading 0:  82%|████████▏ | 296/363 [01:49<00:22,  3.04it/s]
Loading 0:  82%|████████▏ | 297/363 [01:49<00:20,  3.19it/s]
Loading 0:  82%|████████▏ | 298/363 [01:49<00:17,  3.67it/s]
Loading 0:  82%|████████▏ | 299/363 [01:50<00:26,  2.43it/s]
Loading 0:  83%|████████▎ | 301/363 [01:50<00:19,  3.25it/s]
Loading 0:  83%|████████▎ | 302/363 [01:51<00:17,  3.40it/s]
Loading 0:  83%|████████▎ | 303/363 [01:51<00:15,  3.92it/s]
Loading 0:  84%|████████▎ | 304/363 [01:51<00:15,  3.72it/s]
Loading 0:  84%|████████▍ | 306/363 [01:52<00:19,  2.97it/s]
Loading 0:  85%|████████▍ | 307/363 [01:53<00:26,  2.12it/s]
Loading 0:  85%|████████▌ | 310/363 [01:54<00:20,  2.64it/s]
Loading 0:  86%|████████▌ | 311/363 [01:55<00:24,  2.13it/s]
Loading 0:  86%|████████▌ | 312/363 [01:55<00:28,  1.76it/s]
Loading 0:  87%|████████▋ | 315/363 [01:56<00:16,  2.91it/s]
Loading 0:  87%|████████▋ | 316/363 [01:56<00:15,  3.07it/s]
Loading 0:  87%|████████▋ | 317/363 [01:56<00:13,  3.51it/s]
Loading 0:  88%|████████▊ | 319/363 [01:57<00:14,  2.95it/s]
Loading 0:  88%|████████▊ | 320/363 [01:58<00:19,  2.23it/s]
Loading 0:  88%|████████▊ | 321/363 [01:59<00:23,  1.80it/s]
Loading 0:  89%|████████▉ | 324/363 [01:59<00:12,  3.02it/s]
Loading 0:  90%|████████▉ | 325/363 [01:59<00:11,  3.18it/s]
Loading 0:  90%|████████▉ | 326/363 [01:59<00:10,  3.68it/s]
Loading 0:  90%|█████████ | 328/363 [02:00<00:11,  3.02it/s]
Loading 0:  91%|█████████ | 329/363 [02:01<00:15,  2.26it/s]
Loading 0:  91%|█████████ | 330/363 [02:02<00:18,  1.81it/s]
Loading 0:  92%|█████████▏| 333/363 [02:02<00:09,  3.09it/s]
Loading 0:  92%|█████████▏| 334/363 [02:03<00:08,  3.24it/s]
Loading 0:  92%|█████████▏| 335/363 [02:03<00:07,  3.75it/s]
Loading 0:  93%|█████████▎| 337/363 [02:04<00:08,  3.03it/s]
Loading 0:  93%|█████████▎| 338/363 [02:04<00:11,  2.26it/s]
Loading 0:  93%|█████████▎| 339/363 [02:05<00:13,  1.81it/s]
Loading 0:  94%|█████████▍| 342/363 [02:06<00:06,  3.09it/s]
Loading 0:  94%|█████████▍| 343/363 [02:06<00:06,  3.24it/s]
Loading 0:  95%|█████████▍| 344/363 [02:06<00:05,  3.74it/s]
Loading 0:  95%|█████████▌| 346/363 [02:07<00:05,  3.02it/s]
Loading 0:  96%|█████████▌| 347/363 [02:08<00:07,  2.25it/s]
Loading 0:  96%|█████████▌| 348/363 [02:09<00:08,  1.79it/s]
Loading 0:  97%|█████████▋| 351/363 [02:09<00:03,  3.07it/s]
Loading 0:  97%|█████████▋| 352/363 [02:09<00:03,  3.22it/s]
Loading 0:  97%|█████████▋| 353/363 [02:09<00:02,  3.69it/s]
Loading 0:  98%|█████████▊| 355/363 [02:10<00:02,  2.94it/s]
Loading 0:  98%|█████████▊| 356/363 [02:11<00:03,  2.22it/s]
Loading 0:  98%|█████████▊| 357/363 [02:12<00:03,  1.78it/s]
Loading 0:  99%|█████████▉| 360/363 [02:12<00:00,  3.05it/s]
Loading 0:  99%|█████████▉| 361/363 [02:13<00:00,  3.20it/s]
Loading 0: 100%|█████████▉| 362/363 [02:13<00:00,  3.70it/s]
                                                            
Job christiansgao-test-blu-98235-v36-mkmlizer completed after 238.62s with status: succeeded
Stopping job with name christiansgao-test-blu-98235-v36-mkmlizer
Pipeline stage MKMLizer completed in 239.06s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.15s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service christiansgao-test-blu-98235-v36
Waiting for inference service christiansgao-test-blu-98235-v36 to be ready
HTTP Request: %s %s "%s %d %s"
Inference service christiansgao-test-blu-98235-v36 ready after 60.10701322555542s
Pipeline stage MKMLDeployer completed in 60.50s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 6.775319576263428s
Received healthy response to inference request in 7.612856388092041s
Received healthy response to inference request in 1.6000912189483643s
Received healthy response to inference request in 7.657021522521973s
Received healthy response to inference request in 2.0031845569610596s
5 requests
0 failed requests
5th percentile: 1.6807098865509034
10th percentile: 1.7613285541534425
20th percentile: 1.9225658893585205
30th percentile: 2.957611560821533
40th percentile: 4.8664655685424805
50th percentile: 6.775319576263428
60th percentile: 7.110334300994873
70th percentile: 7.445349025726318
80th percentile: 7.621689414978027
90th percentile: 7.63935546875
95th percentile: 7.648188495635987
99th percentile: 7.6552549171447755
mean time: 5.129694652557373
%s, retrying in %s seconds...
Received healthy response to inference request in 5.9990739822387695s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 1.5240874290466309s
Received healthy response to inference request in 1.1795709133148193s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 1.2716047763824463s
Received healthy response to inference request in 5.657299518585205s
5 requests
0 failed requests
5th percentile: 1.1979776859283446
10th percentile: 1.2163844585418702
20th percentile: 1.253198003768921
30th percentile: 1.3221013069152832
40th percentile: 1.4230943679809571
50th percentile: 1.5240874290466309
60th percentile: 3.1773722648620604
70th percentile: 4.83065710067749
80th percentile: 5.725654411315918
90th percentile: 5.862364196777344
95th percentile: 5.930719089508057
99th percentile: 5.985403003692627
mean time: 3.126327323913574
%s, retrying in %s seconds...
Received healthy response to inference request in 1.2678773403167725s
Received healthy response to inference request in 1.2421672344207764s
Received healthy response to inference request in 0.7996220588684082s
Received healthy response to inference request in 1.0077016353607178s
Received healthy response to inference request in 6.913433313369751s
5 requests
0 failed requests
5th percentile: 0.8412379741668701
10th percentile: 0.882853889465332
20th percentile: 0.9660857200622559
30th percentile: 1.0545947551727295
40th percentile: 1.148380994796753
50th percentile: 1.2421672344207764
60th percentile: 1.252451276779175
70th percentile: 1.2627353191375732
80th percentile: 2.3969885349273694
90th percentile: 4.655210924148561
95th percentile: 5.784322118759154
99th percentile: 6.687611074447632
mean time: 2.246160316467285
Pipeline stage StressChecker completed in 56.75s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.75s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 0.96s
Shutdown handler de-registered
christiansgao-test-blu_98235_v36 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2288.50s
Shutdown handler de-registered
christiansgao-test-blu_98235_v36 status is now inactive due to auto deactivation removed underperforming models
christiansgao-test-blu_98235_v36 status is now torndown due to DeploymentManager action