developer_uid: rirv938
submission_id: rirv938-reward-model-re_76185_v3
model_name: rirv938-reward-model-re_76185_v3
model_group: rirv938/reward_model_ret
status: inactive
timestamp: 2025-03-31T19:13:13+00:00
num_battles: 10855
num_wins: 5812
celo_rating: 1312.17
family_friendly_score: 0.5472
family_friendly_standard_error: 0.0070394908906823645
submission_type: basic
model_repo: rirv938/reward_model_retuned_1_old_multihead
model_architecture: LlamaForSequenceClassification
model_num_parameters: 8030261248.0
best_of: 1
max_input_tokens: 512
max_output_tokens: 1
display_name: rirv938-reward-model-re_76185_v3
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: rirv938/reward_model_retuned_1_old_multihead
model_size: 8B
ranking_group: single
us_pacific_date: 2025-03-31
win_ratio: 0.5354214647627821
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 1, 'max_output_tokens': 1}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name rirv938-reward-model-re-76185-v3-mkmlizer
Waiting for job on rirv938-reward-model-re-76185-v3-mkmlizer to finish
rirv938-reward-model-re-76185-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
rirv938-reward-model-re-76185-v3-mkmlizer: ║     _____            __           __                                ║
rirv938-reward-model-re-76185-v3-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
rirv938-reward-model-re-76185-v3-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
rirv938-reward-model-re-76185-v3-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
rirv938-reward-model-re-76185-v3-mkmlizer: ║       /___/                                                         ║
rirv938-reward-model-re-76185-v3-mkmlizer: ║                                                                     ║
rirv938-reward-model-re-76185-v3-mkmlizer: ║  Version: 0.12.8                                                    ║
rirv938-reward-model-re-76185-v3-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
rirv938-reward-model-re-76185-v3-mkmlizer: ║  https://mk1.ai                                                     ║
rirv938-reward-model-re-76185-v3-mkmlizer: ║                                                                     ║
rirv938-reward-model-re-76185-v3-mkmlizer: ║  The license key for the current software has been verified as      ║
rirv938-reward-model-re-76185-v3-mkmlizer: ║  belonging to:                                                      ║
rirv938-reward-model-re-76185-v3-mkmlizer: ║                                                                     ║
rirv938-reward-model-re-76185-v3-mkmlizer: ║  Chai Research Corp.                                                ║
rirv938-reward-model-re-76185-v3-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
rirv938-reward-model-re-76185-v3-mkmlizer: ║  Expiration: 2025-04-15 23:59:59                                    ║
rirv938-reward-model-re-76185-v3-mkmlizer: ║                                                                     ║
rirv938-reward-model-re-76185-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
rirv938-reward-model-re-76185-v3-mkmlizer: Downloaded to shared memory in 24.494s
rirv938-reward-model-re-76185-v3-mkmlizer: quantizing model to /dev/shm/model_cache, profile:t0, folder:/tmp/tmp62battwo, device:0
rirv938-reward-model-re-76185-v3-mkmlizer: Saving flywheel model at /dev/shm/model_cache
rirv938-reward-model-re-76185-v3-mkmlizer: quantized model in 87.033s
rirv938-reward-model-re-76185-v3-mkmlizer: Processed model rirv938/reward_model_retuned_1_old_multihead in 111.528s
rirv938-reward-model-re-76185-v3-mkmlizer: creating bucket guanaco-mkml-models
rirv938-reward-model-re-76185-v3-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
rirv938-reward-model-re-76185-v3-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/rirv938-reward-model-re-76185-v3
rirv938-reward-model-re-76185-v3-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/rirv938-reward-model-re-76185-v3/special_tokens_map.json
rirv938-reward-model-re-76185-v3-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/rirv938-reward-model-re-76185-v3/config.json
rirv938-reward-model-re-76185-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/rirv938-reward-model-re-76185-v3/tokenizer_config.json
rirv938-reward-model-re-76185-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/rirv938-reward-model-re-76185-v3/tokenizer.json
rirv938-reward-model-re-76185-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/rirv938-reward-model-re-76185-v3/flywheel_model.0.safetensors
rirv938-reward-model-re-76185-v3-mkmlizer: 
Loading 0:   0%|          | 0/291 [00:00<?, ?it/s]
Loading 0:   1%|          | 3/291 [00:00<00:54,  5.27it/s]
Loading 0:   1%|▏         | 4/291 [00:01<01:29,  3.21it/s]
Loading 0:   2%|▏         | 5/291 [00:01<02:02,  2.34it/s]
Loading 0:   3%|▎         | 8/291 [00:02<01:03,  4.46it/s]
Loading 0:   3%|▎         | 9/291 [00:02<01:02,  4.54it/s]
Loading 0:   3%|▎         | 10/291 [00:02<00:55,  5.05it/s]
Loading 0:   4%|▍         | 12/291 [00:02<01:04,  4.30it/s]
Loading 0:   4%|▍         | 13/291 [00:03<01:25,  3.24it/s]
Loading 0:   5%|▍         | 14/291 [00:04<01:48,  2.55it/s]
Loading 0:   6%|▌         | 17/291 [00:04<01:02,  4.38it/s]
Loading 0:   6%|▌         | 18/291 [00:04<00:59,  4.60it/s]
Loading 0:   7%|▋         | 19/291 [00:04<00:53,  5.11it/s]
Loading 0:   7%|▋         | 21/291 [00:05<01:02,  4.33it/s]
Loading 0:   8%|▊         | 22/291 [00:05<01:22,  3.26it/s]
Loading 0:   8%|▊         | 23/291 [00:06<01:44,  2.57it/s]
Loading 0:   9%|▉         | 26/291 [00:06<01:00,  4.35it/s]
Loading 0:   9%|▉         | 27/291 [00:06<00:57,  4.56it/s]
Loading 0:  10%|▉         | 28/291 [00:06<00:51,  5.08it/s]
Loading 0:  10%|█         | 30/291 [00:07<01:00,  4.29it/s]
Loading 0:  11%|█         | 31/291 [00:08<01:20,  3.24it/s]
Loading 0:  11%|█         | 32/291 [00:08<01:41,  2.54it/s]
Loading 0:  12%|█▏        | 35/291 [00:09<00:58,  4.35it/s]
Loading 0:  12%|█▏        | 36/291 [00:09<00:55,  4.57it/s]
Loading 0:  13%|█▎        | 37/291 [00:09<00:50,  5.02it/s]
Loading 0:  13%|█▎        | 39/291 [00:09<00:59,  4.25it/s]
Loading 0:  14%|█▎        | 40/291 [00:10<01:17,  3.22it/s]
Loading 0:  14%|█▍        | 41/291 [00:11<01:39,  2.52it/s]
Loading 0:  15%|█▌        | 44/291 [00:11<00:57,  4.31it/s]
Loading 0:  15%|█▌        | 45/291 [00:11<00:53,  4.56it/s]
Loading 0:  16%|█▌        | 46/291 [00:11<00:48,  5.06it/s]
Loading 0:  16%|█▋        | 48/291 [00:12<00:56,  4.26it/s]
Loading 0:  17%|█▋        | 49/291 [00:12<01:14,  3.24it/s]
Loading 0:  17%|█▋        | 50/291 [00:13<01:35,  2.51it/s]
Loading 0:  18%|█▊        | 53/291 [00:13<00:55,  4.28it/s]
Loading 0:  19%|█▊        | 54/291 [00:13<00:52,  4.53it/s]
Loading 0:  19%|█▉        | 55/291 [00:14<00:46,  5.06it/s]
Loading 0:  20%|█▉        | 57/291 [00:14<00:54,  4.27it/s]
Loading 0:  20%|█▉        | 58/291 [00:15<01:11,  3.24it/s]
Loading 0:  20%|██        | 59/291 [00:15<01:31,  2.54it/s]
Loading 0:  21%|██▏       | 62/291 [00:16<00:52,  4.35it/s]
Loading 0:  22%|██▏       | 63/291 [00:16<00:49,  4.60it/s]
Loading 0:  22%|██▏       | 64/291 [00:16<00:43,  5.16it/s]
Loading 0:  23%|██▎       | 66/291 [00:16<00:51,  4.38it/s]
Loading 0:  23%|██▎       | 67/291 [00:17<01:07,  3.31it/s]
Loading 0:  23%|██▎       | 68/291 [00:18<01:26,  2.59it/s]
Loading 0:  24%|██▍       | 71/291 [00:18<00:50,  4.38it/s]
Loading 0:  25%|██▍       | 72/291 [00:18<00:47,  4.61it/s]
Loading 0:  25%|██▌       | 73/291 [00:18<00:42,  5.17it/s]
Loading 0:  26%|██▌       | 75/291 [00:19<00:49,  4.32it/s]
Loading 0:  26%|██▌       | 76/291 [00:19<01:05,  3.26it/s]
Loading 0:  26%|██▋       | 77/291 [00:20<01:22,  2.58it/s]
Loading 0:  27%|██▋       | 80/291 [00:20<00:48,  4.37it/s]
Loading 0:  28%|██▊       | 81/291 [00:20<00:45,  4.61it/s]
Loading 0:  28%|██▊       | 82/291 [00:20<00:40,  5.18it/s]
Loading 0:  29%|██▊       | 83/291 [00:21<00:39,  5.30it/s]
Loading 0:  29%|██▉       | 84/291 [00:21<00:59,  3.46it/s]
Loading 0:  29%|██▉       | 85/291 [00:22<01:15,  2.72it/s]
Loading 0:  30%|██▉       | 86/291 [00:22<01:32,  2.22it/s]
Loading 0:  31%|███       | 89/291 [00:23<00:48,  4.14it/s]
Loading 0:  31%|███       | 90/291 [00:23<00:45,  4.43it/s]
Loading 0:  31%|███▏      | 91/291 [00:23<00:40,  4.98it/s]
Loading 0:  32%|███▏      | 93/291 [00:24<00:47,  4.20it/s]
Loading 0:  32%|███▏      | 94/291 [00:24<01:01,  3.19it/s]
Loading 0:  33%|███▎      | 95/291 [00:25<01:18,  2.51it/s]
Loading 0:  34%|███▎      | 98/291 [00:25<00:44,  4.37it/s]
Loading 0:  34%|███▍      | 99/291 [00:25<00:41,  4.63it/s]
Loading 0:  34%|███▍      | 100/291 [00:25<00:37,  5.16it/s]
Loading 0:  35%|███▌      | 102/291 [00:26<00:43,  4.31it/s]
Loading 0:  35%|███▌      | 103/291 [00:26<00:57,  3.25it/s]
Loading 0:  36%|███▌      | 104/291 [00:27<01:13,  2.55it/s]
Loading 0:  37%|███▋      | 107/291 [00:27<00:41,  4.40it/s]
Loading 0:  37%|███▋      | 108/291 [00:27<00:39,  4.65it/s]
Loading 0:  37%|███▋      | 109/291 [00:28<00:35,  5.13it/s]
Loading 0:  38%|███▊      | 111/291 [00:28<00:41,  4.30it/s]
Loading 0:  38%|███▊      | 112/291 [00:29<00:55,  3.25it/s]
Loading 0:  39%|███▉      | 113/291 [00:29<01:10,  2.53it/s]
Loading 0:  40%|███▉      | 116/291 [00:30<00:40,  4.36it/s]
Loading 0:  40%|████      | 117/291 [00:30<00:37,  4.59it/s]
Loading 0:  41%|████      | 118/291 [00:30<00:33,  5.11it/s]
Loading 0:  41%|████      | 120/291 [00:30<00:39,  4.31it/s]
Loading 0:  42%|████▏     | 121/291 [00:31<00:52,  3.26it/s]
Loading 0:  42%|████▏     | 122/291 [00:32<01:06,  2.56it/s]
Loading 0:  43%|████▎     | 125/291 [00:32<00:38,  4.36it/s]
Loading 0:  43%|████▎     | 126/291 [00:32<00:35,  4.59it/s]
Loading 0:  44%|████▎     | 127/291 [00:32<00:32,  5.05it/s]
Loading 0:  44%|████▍     | 129/291 [00:33<00:37,  4.27it/s]
Loading 0:  45%|████▍     | 130/291 [00:33<00:49,  3.24it/s]
Loading 0:  45%|████▌     | 131/291 [00:34<01:02,  2.55it/s]
Loading 0:  46%|████▌     | 134/291 [00:34<00:35,  4.38it/s]
Loading 0:  46%|████▋     | 135/291 [00:34<00:33,  4.61it/s]
Loading 0:  47%|████▋     | 136/291 [00:35<00:30,  5.13it/s]
Loading 0:  47%|████▋     | 138/291 [00:35<00:35,  4.33it/s]
Loading 0:  48%|████▊     | 139/291 [00:36<00:46,  3.27it/s]
Loading 0:  48%|████▊     | 140/291 [00:36<00:59,  2.55it/s]
Loading 0:  49%|████▉     | 143/291 [00:37<00:33,  4.41it/s]
Loading 0:  49%|████▉     | 144/291 [00:37<00:31,  4.66it/s]
Loading 0:  50%|████▉     | 145/291 [00:37<00:28,  5.16it/s]
Loading 0:  51%|█████     | 147/291 [00:37<00:33,  4.35it/s]
Loading 0:  51%|█████     | 148/291 [00:38<00:43,  3.27it/s]
Loading 0:  51%|█████     | 149/291 [00:39<00:55,  2.56it/s]
Loading 0:  52%|█████▏    | 152/291 [00:39<00:31,  4.35it/s]
Loading 0:  53%|█████▎    | 153/291 [00:39<00:29,  4.60it/s]
Loading 0:  53%|█████▎    | 154/291 [00:39<00:26,  5.12it/s]
Loading 0:  54%|█████▎    | 156/291 [00:40<00:31,  4.30it/s]
Loading 0:  54%|█████▍    | 157/291 [00:40<00:41,  3.25it/s]
Loading 0:  54%|█████▍    | 158/291 [00:41<00:52,  2.55it/s]
Loading 0:  55%|█████▌    | 161/291 [00:41<00:29,  4.34it/s]
Loading 0:  56%|█████▌    | 162/291 [00:41<00:28,  4.59it/s]
Loading 0:  56%|█████▌    | 163/291 [00:41<00:25,  5.08it/s]
Loading 0:  57%|█████▋    | 165/291 [00:42<00:29,  4.30it/s]
Loading 0:  57%|█████▋    | 166/291 [00:43<00:38,  3.26it/s]
Loading 0:  57%|█████▋    | 167/291 [00:43<00:48,  2.57it/s]
Loading 0:  58%|█████▊    | 170/291 [00:43<00:27,  4.36it/s]
Loading 0:  59%|█████▉    | 171/291 [00:44<00:26,  4.61it/s]
Loading 0:  59%|█████▉    | 172/291 [00:44<00:23,  5.11it/s]
Loading 0:  59%|█████▉    | 173/291 [00:44<00:33,  3.50it/s]
Loading 0:  60%|██████    | 175/291 [00:45<00:24,  4.81it/s]
Loading 0:  60%|██████    | 176/291 [00:45<00:22,  5.02it/s]
Loading 0:  61%|██████    | 177/291 [00:45<00:20,  5.60it/s]
Loading 0:  62%|██████▏   | 179/291 [00:45<00:25,  4.45it/s]
Loading 0:  62%|██████▏   | 180/291 [00:46<00:33,  3.30it/s]
Loading 0:  62%|██████▏   | 181/291 [00:47<00:42,  2.57it/s]
Loading 0:  63%|██████▎   | 184/291 [00:47<00:24,  4.41it/s]
Loading 0:  64%|██████▎   | 185/291 [00:47<00:22,  4.66it/s]
Loading 0:  64%|██████▍   | 186/291 [00:47<00:20,  5.22it/s]
Loading 0:  64%|██████▍   | 187/291 [00:47<00:19,  5.22it/s]
Loading 0:  65%|██████▍   | 188/291 [00:48<00:29,  3.46it/s]
Loading 0:  65%|██████▍   | 189/291 [00:49<00:39,  2.59it/s]
Loading 0:  66%|██████▌   | 192/291 [00:49<00:28,  3.52it/s]
Loading 0:  66%|██████▋   | 193/291 [00:50<00:33,  2.90it/s]
Loading 0:  67%|██████▋   | 194/291 [00:50<00:40,  2.40it/s]
Loading 0:  68%|██████▊   | 197/291 [00:51<00:23,  4.07it/s]
Loading 0:  68%|██████▊   | 198/291 [00:51<00:21,  4.32it/s]
Loading 0:  68%|██████▊   | 199/291 [00:51<00:19,  4.83it/s]
Loading 0:  69%|██████▉   | 201/291 [00:51<00:21,  4.19it/s]
Loading 0:  69%|██████▉   | 202/291 [00:52<00:27,  3.21it/s]
Loading 0:  70%|██████▉   | 203/291 [00:53<00:34,  2.56it/s]
Loading 0:  71%|███████   | 206/291 [00:53<00:19,  4.34it/s]
Loading 0:  71%|███████   | 207/291 [00:53<00:18,  4.58it/s]
Loading 0:  71%|███████▏  | 208/291 [00:53<00:16,  5.08it/s]
Loading 0:  72%|███████▏  | 210/291 [00:54<00:18,  4.33it/s]
Loading 0:  73%|███████▎  | 211/291 [00:54<00:24,  3.28it/s]
Loading 0:  73%|███████▎  | 212/291 [00:55<00:30,  2.58it/s]
Loading 0:  74%|███████▍  | 215/291 [00:55<00:17,  4.43it/s]
Loading 0:  74%|███████▍  | 216/291 [00:55<00:16,  4.67it/s]
Loading 0:  75%|███████▍  | 217/291 [00:55<00:14,  5.20it/s]
Loading 0:  75%|███████▌  | 219/291 [00:56<00:16,  4.38it/s]
Loading 0:  76%|███████▌  | 220/291 [00:57<00:21,  3.32it/s]
Loading 0:  76%|███████▌  | 221/291 [00:57<00:26,  2.62it/s]
Loading 0:  77%|███████▋  | 224/291 [00:57<00:14,  4.49it/s]
Loading 0:  77%|███████▋  | 225/291 [00:58<00:14,  4.71it/s]
Loading 0:  78%|███████▊  | 226/291 [00:58<00:12,  5.22it/s]
Loading 0:  78%|███████▊  | 228/291 [00:58<00:14,  4.38it/s]
Loading 0:  79%|███████▊  | 229/291 [00:59<00:18,  3.30it/s]
Loading 0:  79%|███████▉  | 230/291 [01:00<00:23,  2.60it/s]
Loading 0:  80%|████████  | 233/291 [01:00<00:12,  4.49it/s]
Loading 0:  80%|████████  | 234/291 [01:00<00:12,  4.72it/s]
Loading 0:  81%|████████  | 235/291 [01:00<00:10,  5.20it/s]
Loading 0:  81%|████████▏ | 237/291 [01:01<00:12,  4.36it/s]
Loading 0:  82%|████████▏ | 238/291 [01:01<00:16,  3.29it/s]
Loading 0:  82%|████████▏ | 239/291 [01:02<00:20,  2.56it/s]
Loading 0:  83%|████████▎ | 242/291 [01:02<00:11,  4.36it/s]
Loading 0:  84%|████████▎ | 243/291 [01:02<00:10,  4.59it/s]
Loading 0:  84%|████████▍ | 244/291 [01:02<00:09,  5.06it/s]
Loading 0:  85%|████████▍ | 246/291 [01:03<00:10,  4.31it/s]
Loading 0:  85%|████████▍ | 247/291 [01:03<00:13,  3.28it/s]
Loading 0:  85%|████████▌ | 248/291 [01:04<00:16,  2.59it/s]
Loading 0:  86%|████████▋ | 251/291 [01:04<00:09,  4.43it/s]
Loading 0:  87%|████████▋ | 252/291 [01:04<00:08,  4.69it/s]
Loading 0:  87%|████████▋ | 253/291 [01:05<00:07,  5.23it/s]
Loading 0:  88%|████████▊ | 255/291 [01:05<00:08,  4.37it/s]
Loading 0:  88%|████████▊ | 256/291 [01:06<00:10,  3.31it/s]
Loading 0:  88%|████████▊ | 257/291 [01:06<00:13,  2.59it/s]
Loading 0:  89%|████████▉ | 260/291 [01:07<00:06,  4.48it/s]
Loading 0:  90%|████████▉ | 261/291 [01:07<00:06,  4.73it/s]
Loading 0:  90%|█████████ | 262/291 [01:07<00:05,  5.22it/s]
Loading 0:  91%|█████████ | 264/291 [01:07<00:06,  4.41it/s]
Loading 0:  91%|█████████ | 265/291 [01:08<00:07,  3.32it/s]
Loading 0:  91%|█████████▏| 266/291 [01:09<00:09,  2.63it/s]
Loading 0:  92%|█████████▏| 269/291 [01:09<00:04,  4.48it/s]
Loading 0:  93%|█████████▎| 270/291 [01:09<00:04,  4.74it/s]
Loading 0:  93%|█████████▎| 271/291 [01:09<00:03,  5.30it/s]
Loading 0:  94%|█████████▍| 273/291 [01:10<00:04,  4.42it/s]
Loading 0:  94%|█████████▍| 274/291 [01:10<00:05,  3.34it/s]
Loading 0:  95%|█████████▍| 275/291 [01:11<00:06,  2.63it/s]
Loading 0:  96%|█████████▌| 278/291 [01:11<00:02,  4.46it/s]
Loading 0:  96%|█████████▌| 279/291 [01:11<00:02,  4.72it/s]
Loading 0:  96%|█████████▌| 280/291 [01:11<00:02,  5.23it/s]
Loading 0:  97%|█████████▋| 281/291 [01:12<00:02,  3.54it/s]
Loading 0:  97%|█████████▋| 282/291 [01:13<00:03,  2.66it/s]
Loading 0:  98%|█████████▊| 284/291 [01:13<00:01,  3.85it/s]
Loading 0:  98%|█████████▊| 285/291 [01:13<00:01,  4.20it/s]
Loading 0:  98%|█████████▊| 286/291 [01:13<00:01,  4.82it/s]
Loading 0:  99%|█████████▊| 287/291 [01:13<00:00,  4.94it/s]
Loading 0:  99%|█████████▉| 288/291 [01:14<00:00,  3.33it/s]
                                                            

Job rirv938-reward-model-re-76185-v3-mkmlizer completed after 145.42s with status: succeeded
Stopping job with name rirv938-reward-model-re-76185-v3-mkmlizer
Pipeline stage MKMLizer completed in 145.89s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.18s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service rirv938-reward-model-re-76185-v3
Waiting for inference service rirv938-reward-model-re-76185-v3 to be ready
Inference service rirv938-reward-model-re-76185-v3 ready after 110.66574716567993s
Pipeline stage MKMLDeployer completed in 111.20s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.45778751373291s
Received healthy response to inference request in 4.57768988609314s
Received healthy response to inference request in 3.6141302585601807s
Received healthy response to inference request in 2.2681713104248047s
Received healthy response to inference request in 1.9662575721740723s
5 requests
0 failed requests
5th percentile: 2.0266403198242187
10th percentile: 2.087023067474365
20th percentile: 2.2077885627746583
30th percentile: 2.5373631000518797
40th percentile: 3.0757466793060306
50th percentile: 3.6141302585601807
60th percentile: 3.9515931606292725
70th percentile: 4.289056062698364
80th percentile: 4.481767988204956
90th percentile: 4.529728937149048
95th percentile: 4.553709411621094
99th percentile: 4.57289379119873
mean time: 3.3768073081970216
%s, retrying in %s seconds...
Received healthy response to inference request in 5.210137128829956s
Received healthy response to inference request in 4.822422027587891s
Received healthy response to inference request in 3.911994457244873s
Received healthy response to inference request in 3.096283197402954s
Received healthy response to inference request in 3.147547483444214s
5 requests
0 failed requests
5th percentile: 3.106536054611206
10th percentile: 3.116788911819458
20th percentile: 3.137294626235962
30th percentile: 3.3004368782043456
40th percentile: 3.6062156677246096
50th percentile: 3.911994457244873
60th percentile: 4.27616548538208
70th percentile: 4.640336513519287
80th percentile: 4.899965047836304
90th percentile: 5.05505108833313
95th percentile: 5.132594108581543
99th percentile: 5.194628524780273
mean time: 4.037676858901977
%s, retrying in %s seconds...
Received healthy response to inference request in 3.234138250350952s
Received healthy response to inference request in 3.80234956741333s
Received healthy response to inference request in 1.9057819843292236s
Received healthy response to inference request in 1.9611232280731201s
Received healthy response to inference request in 5.735729455947876s
5 requests
0 failed requests
5th percentile: 1.9168502330780028
10th percentile: 1.9279184818267823
20th percentile: 1.950054979324341
30th percentile: 2.2157262325286866
40th percentile: 2.7249322414398196
50th percentile: 3.234138250350952
60th percentile: 3.4614227771759034
70th percentile: 3.6887073040008542
80th percentile: 4.18902554512024
90th percentile: 4.962377500534058
95th percentile: 5.349053478240966
99th percentile: 5.658394260406494
mean time: 3.3278244972229003
Pipeline stage StressChecker completed in 57.89s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.71s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 0.74s
Shutdown handler de-registered
rirv938-reward-model-re_76185_v3 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage MKMLProfilerDeleter completed in 0.12s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.11s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service rirv938-reward-model-re-76185-v3-profiler
Waiting for inference service rirv938-reward-model-re-76185-v3-profiler to be ready
Inference service rirv938-reward-model-re-76185-v3-profiler ready after 110.41977190971375s
Pipeline stage MKMLProfilerDeployer completed in 110.92s
run pipeline stage %s
Running pipeline stage MKMLProfilerRunner
kubectl cp /code/guanaco/guanaco_inference_services/src/inference_scripts tenant-chaiml-guanaco/rirv938-reward-modelb8364f9c999962cb2fbeb30b320801dc-deplockmmq:/code/chaiverse_profiler_1743448858 --namespace tenant-chaiml-guanaco
kubectl exec -it rirv938-reward-modelb8364f9c999962cb2fbeb30b320801dc-deplockmmq --namespace tenant-chaiml-guanaco -- sh -c 'cd /code/chaiverse_profiler_1743448858 && python profiles.py profile --best_of_n 1 --auto_batch 5 --batches 1,5,10,15,20,25,30,35,40,45,50,55,60,65,70,75,80,85,90,95,100,105,110,115,120,125,130,135,140,145,150,155,160,165,170,175,180,185,190,195 --samples 200 --input_tokens 512 --output_tokens 1 --summary /code/chaiverse_profiler_1743448858/summary.json'
Received signal 15, running shutdown handler
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Checking if service rirv938-reward-model-re-76185-v3-profiler is running
Tearing down inference service rirv938-reward-model-re-76185-v3-profiler
Service rirv938-reward-model-re-76185-v3-profiler has been torndown
Pipeline stage MKMLProfilerDeleter completed in 1.67s
Shutdown handler de-registered
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Checking if service rirv938-reward-model-re-76185-v3-profiler is running
Skipping teardown as no inference service was found
Pipeline stage MKMLProfilerDeleter completed in 1.55s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.11s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service rirv938-reward-model-re-76185-v3-profiler
Waiting for inference service rirv938-reward-model-re-76185-v3-profiler to be ready
Inference service rirv938-reward-model-re-76185-v3-profiler ready after 40.177587270736694s
Pipeline stage MKMLProfilerDeployer completed in 40.55s
run pipeline stage %s
Running pipeline stage MKMLProfilerRunner
kubectl cp /code/guanaco/guanaco_inference_services/src/inference_scripts tenant-chaiml-guanaco/rirv938-reward-modelb8364f9c999962cb2fbeb30b320801dc-deplokrkzl:/code/chaiverse_profiler_1743452412 --namespace tenant-chaiml-guanaco
kubectl exec -it rirv938-reward-modelb8364f9c999962cb2fbeb30b320801dc-deplokrkzl --namespace tenant-chaiml-guanaco -- sh -c 'cd /code/chaiverse_profiler_1743452412 && python profiles.py profile --best_of_n 1 --auto_batch 5 --batches 1,5,10,15,20,25,30,35,40,45,50,55,60,65,70,75,80,85,90,95,100,105,110,115,120,125,130,135,140,145,150,155,160,165,170,175,180,185,190,195 --samples 200 --input_tokens 512 --output_tokens 1 --summary /code/chaiverse_profiler_1743452412/summary.json'
Received signal 15, running shutdown handler
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Checking if service rirv938-reward-model-re-76185-v3-profiler is running
Tearing down inference service rirv938-reward-model-re-76185-v3-profiler
Service rirv938-reward-model-re-76185-v3-profiler has been torndown
Pipeline stage MKMLProfilerDeleter completed in 1.68s
Shutdown handler de-registered
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Checking if service rirv938-reward-model-re-76185-v3-profiler is running
Skipping teardown as no inference service was found
Pipeline stage MKMLProfilerDeleter completed in 1.45s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.12s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service rirv938-reward-model-re-76185-v3-profiler
Waiting for inference service rirv938-reward-model-re-76185-v3-profiler to be ready
Inference service rirv938-reward-model-re-76185-v3-profiler ready after 120.50248980522156s
Pipeline stage MKMLProfilerDeployer completed in 120.91s
run pipeline stage %s
Running pipeline stage MKMLProfilerRunner
kubectl cp /code/guanaco/guanaco_inference_services/src/inference_scripts tenant-chaiml-guanaco/rirv938-reward-modelb8364f9c999962cb2fbeb30b320801dc-deplocg9m9:/code/chaiverse_profiler_1743456111 --namespace tenant-chaiml-guanaco
kubectl exec -it rirv938-reward-modelb8364f9c999962cb2fbeb30b320801dc-deplocg9m9 --namespace tenant-chaiml-guanaco -- sh -c 'cd /code/chaiverse_profiler_1743456111 && python profiles.py profile --best_of_n 1 --auto_batch 5 --batches 1,5,10,15,20,25,30,35,40,45,50,55,60,65,70,75,80,85,90,95,100,105,110,115,120,125,130,135,140,145,150,155,160,165,170,175,180,185,190,195 --samples 200 --input_tokens 512 --output_tokens 1 --summary /code/chaiverse_profiler_1743456111/summary.json'
Received signal 15, running shutdown handler
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Checking if service rirv938-reward-model-re-76185-v3-profiler is running
Tearing down inference service rirv938-reward-model-re-76185-v3-profiler
Service rirv938-reward-model-re-76185-v3-profiler has been torndown
Pipeline stage MKMLProfilerDeleter completed in 1.63s
Shutdown handler de-registered
rirv938-reward-model-re_76185_v3 status is now inactive due to auto deactivation removed underperforming models
ChatRequest
Generation Params
Prompt Formatter
Chat History
ChatMessage 1