chaiml-reward-dpo-62cf-c_8436

developer_uid: rirv938
submission_id: chaiml-reward-dpo-62cf-c_8436_v1
model_name: chaiml-reward-dpo-62cf-c_8436_v1
model_group: ChaiML/reward-dpo-62cf-c
status: inactive
timestamp: 2026-02-28T22:57:34+00:00
num_battles: 10799
num_wins: 5460
celo_rating: 1295.42
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/reward-dpo-62cf-chaiml-glm-air-4-5-sft-_84865_v1
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 9073971200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-reward-dpo-62cf-c_8436_v1
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/reward-dpo-62cf-chaiml-glm-air-4-5-sft-_84865_v1
model_size: 9B
ranking_group: single
us_pacific_date: 2026-02-28
win_ratio: 0.5056023705898695
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 60, 'presence_penalty': 0.1, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', '###', 'You:', '<|im_end|>', '<|im_start|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': '[gMASK]<sop><|system|>\nRespond as a high quality storyteller.<|user|>\n', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-reward-dpo-62cf-c-8436-v1-uploader
Waiting for job on chaiml-reward-dpo-62cf-c-8436-v1-uploader to finish
chaiml-reward-dpo-0e94-c-1216-v2-uploader: Using quantization_mode: none
chaiml-reward-dpo-0e94-c-1216-v2-uploader: Downloading snapshot of ChaiML/reward-dpo-0e94-chaiml-glm-air-4-5-sft-_84865_v1...
chaiml-reward-dpo-2837-10545-v1-uploader: Using quantization_mode: none
chaiml-reward-dpo-2837-10545-v1-uploader: Downloading snapshot of ChaiML/reward-dpo-2837-chaiml-glm-air-4-5-sft-_84865_v1...
chaiml-reward-dpo-62cf-c-8436-v1-uploader: Using quantization_mode: none
chaiml-reward-dpo-62cf-c-8436-v1-uploader: Downloading snapshot of ChaiML/reward-dpo-62cf-chaiml-glm-air-4-5-sft-_84865_v1...
chaiml-reward-dpo-2837-10545-v1-uploader: Downloaded in 66.233s
chaiml-reward-dpo-0e94-c-1216-v2-uploader: Downloaded in 69.556s
chaiml-reward-dpo-62cf-c-8436-v1-uploader: Downloaded in 70.940s
chaiml-reward-dpo-2837-10545-v1-uploader: Processed model ChaiML/reward-dpo-2837-chaiml-glm-air-4-5-sft-_84865_v1 in 142.653s
chaiml-reward-dpo-2837-10545-v1-uploader: creating bucket guanaco-vllm-models
chaiml-reward-dpo-2837-10545-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-reward-dpo-2837-10545-v1-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-reward-dpo-2837-10545-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-reward-dpo-2837-10545-v1-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-reward-dpo-2837-10545-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-reward-dpo-0e94-c-1216-v2-uploader: Processed model ChaiML/reward-dpo-0e94-chaiml-glm-air-4-5-sft-_84865_v1 in 149.509s
chaiml-reward-dpo-2837-10545-v1-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-reward-dpo-0e94-c-1216-v2-uploader: creating bucket guanaco-vllm-models
chaiml-reward-dpo-2837-10545-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-reward-dpo-0e94-c-1216-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-reward-dpo-2837-10545-v1-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-reward-dpo-0e94-c-1216-v2-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-reward-dpo-2837-10545-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-reward-dpo-0e94-c-1216-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-reward-dpo-2837-10545-v1-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-reward-dpo-0e94-c-1216-v2-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-reward-dpo-2837-10545-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-reward-dpo-0e94-c-1216-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-reward-dpo-2837-10545-v1-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-reward-dpo-0e94-c-1216-v2-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-reward-dpo-2837-10545-v1-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-reward-dpo-0e94-c-1216-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-reward-dpo-2837-10545-v1-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-reward-dpo-0e94-c-1216-v2-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-reward-dpo-2837-10545-v1-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-reward-dpo-0e94-c-1216-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-reward-dpo-2837-10545-v1-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-reward-dpo-0e94-c-1216-v2-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-reward-dpo-2837-10545-v1-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-reward-dpo-0e94-c-1216-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-reward-dpo-2837-10545-v1-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default
chaiml-reward-dpo-0e94-c-1216-v2-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/README.md
chaiml-reward-dpo-0e94-c-1216-v2-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/chat_template.jinja
chaiml-reward-dpo-0e94-c-1216-v2-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/.gitattributes
chaiml-reward-dpo-0e94-c-1216-v2-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/args.json s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/args.json
chaiml-reward-dpo-0e94-c-1216-v2-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/config.json
chaiml-reward-dpo-0e94-c-1216-v2-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/special_tokens_map.json
chaiml-reward-dpo-0e94-c-1216-v2-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/tokenizer_config.json
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/.gitattributes
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model.safetensors.index.json
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/config.json
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/tokenizer.json
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/README.md
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/chat_template.jinja
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/tokenizer_config.json
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/args.json s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/args.json
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model.safetensors.index.json
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/special_tokens_map.json
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/tokenizer.json
chaiml-reward-dpo-62cf-c-8436-v1-uploader: Processed model ChaiML/reward-dpo-62cf-chaiml-glm-air-4-5-sft-_84865_v1 in 149.109s
chaiml-reward-dpo-62cf-c-8436-v1-uploader: creating bucket guanaco-vllm-models
chaiml-reward-dpo-62cf-c-8436-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-reward-dpo-62cf-c-8436-v1-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-reward-dpo-62cf-c-8436-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-reward-dpo-62cf-c-8436-v1-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-reward-dpo-62cf-c-8436-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-reward-dpo-62cf-c-8436-v1-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-reward-dpo-62cf-c-8436-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-reward-dpo-62cf-c-8436-v1-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-reward-dpo-62cf-c-8436-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-reward-dpo-62cf-c-8436-v1-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-reward-dpo-62cf-c-8436-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-reward-dpo-62cf-c-8436-v1-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-reward-dpo-62cf-c-8436-v1-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-reward-dpo-62cf-c-8436-v1-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-reward-dpo-62cf-c-8436-v1-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-reward-dpo-62cf-c-8436-v1-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-reward-dpo-62cf-c-8436-v1-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-reward-dpo-62cf-c-8436-v1-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00043-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00043-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00043-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00043-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00043-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00043-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00003-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00003-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00011-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00011-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00036-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00036-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00001-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00001-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00030-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00030-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00006-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00006-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00026-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00026-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00005-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00005-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00042-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00042-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00024-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00024-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00015-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00015-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00041-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00041-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00017-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00017-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00022-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00022-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00027-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00027-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00002-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00002-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00028-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00028-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00007-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00007-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00009-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00009-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00008-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00008-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00023-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00023-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00021-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00021-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00036-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00036-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00012-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00012-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00006-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00006-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00013-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00013-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00034-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00034-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00016-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00016-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00024-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00024-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00010-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00010-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00038-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00038-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00025-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00025-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00001-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00001-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00019-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00019-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00016-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00016-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00018-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00018-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00011-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00011-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00029-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00029-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00037-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00037-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00037-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00037-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00022-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00022-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00004-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00004-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00027-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00027-of-00043.safetensors
chaiml-reward-dpo-2837-10545-v1-uploader: cp /dev/shm/model_output/model-00014-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-2837-10545-v1/default/model-00014-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00042-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00042-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00028-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00028-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00009-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00009-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00003-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00003-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00023-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00023-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00004-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00004-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00031-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00031-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00017-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00017-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00015-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00015-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00020-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00020-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00004-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00004-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00040-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00040-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00006-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00006-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00029-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00029-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00029-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00029-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00025-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00025-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00036-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00036-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00010-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00010-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00024-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00024-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00039-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00039-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00027-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00027-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00002-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00002-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00033-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00033-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00019-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00019-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00025-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00025-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00021-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00021-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00017-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00017-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00041-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00041-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00040-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00040-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00018-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00018-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00013-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00013-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00032-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00032-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00034-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00034-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00035-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00035-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00037-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00037-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00008-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00008-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00030-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00030-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00005-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00005-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00021-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00021-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00012-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00012-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00011-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00011-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00026-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00026-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00010-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00010-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00030-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00030-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00023-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00023-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00014-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00014-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00001-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00001-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00007-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00007-of-00043.safetensors
Job chaiml-reward-dpo-2837-10545-v1-uploader completed after 369.65s with status: succeeded
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00039-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00039-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00033-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00033-of-00043.safetensors
Stopping job with name chaiml-reward-dpo-2837-10545-v1-uploader
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00041-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00041-of-00043.safetensors
chaiml-reward-dpo-0e94-c-1216-v2-uploader: cp /dev/shm/model_output/model-00013-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-0e94-c-1216-v2/default/model-00013-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00022-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00022-of-00043.safetensors
Pipeline stage VLLMUploader completed in 372.37s
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00003-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00003-of-00043.safetensors
run pipeline stage %s
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00015-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00015-of-00043.safetensors
Running pipeline stage VLLMTemplater
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00002-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00002-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00008-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00008-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00031-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00031-of-00043.safetensors
Pipeline stage VLLMTemplater completed in 1.49s
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00028-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00028-of-00043.safetensors
run pipeline stage %s
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00005-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00005-of-00043.safetensors
Running pipeline stage VLLMDeployer
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00026-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00026-of-00043.safetensors
Creating inference service chaiml-reward-dpo-2837-10545-v1
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00018-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00018-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00042-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00042-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00020-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00020-of-00043.safetensors
Waiting for inference service chaiml-reward-dpo-2837-10545-v1 to be ready
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00019-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00019-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00016-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00016-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00007-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00007-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00032-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00032-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00012-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00012-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00014-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00014-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00009-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00009-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00038-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00038-of-00043.safetensors
chaiml-reward-dpo-62cf-c-8436-v1-uploader: cp /dev/shm/model_output/model-00035-of-00043.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-62cf-c-8436-v1/default/model-00035-of-00043.safetensors
Job chaiml-reward-dpo-0e94-c-1216-v2-uploader completed after 387.09s with status: succeeded
Stopping job with name chaiml-reward-dpo-0e94-c-1216-v2-uploader
Pipeline stage VLLMUploader completed in 389.21s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.15s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-reward-dpo-0e94-c-1216-v2
Waiting for inference service chaiml-reward-dpo-0e94-c-1216-v2 to be ready
Job chaiml-reward-dpo-62cf-c-8436-v1-uploader completed after 386.71s with status: succeeded
Stopping job with name chaiml-reward-dpo-62cf-c-8436-v1-uploader
Pipeline stage VLLMUploader completed in 389.35s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.08s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-reward-dpo-62cf-c-8436-v1
Waiting for inference service chaiml-reward-dpo-62cf-c-8436-v1 to be ready
Inference service chaiml-reward-dpo-0e94-c-1216-v2 ready after 577.70707654953s
Inference service chaiml-reward-dpo-2837-10545-v1 ready after 588.2422246932983s
Pipeline stage VLLMDeployer completed in 580.33s
Pipeline stage VLLMDeployer completed in 591.66s
run pipeline stage %s
run pipeline stage %s
Running pipeline stage StressChecker
Running pipeline stage StressChecker
Received healthy response to inference request in 2.80476975440979s
Received healthy response to inference request in 2.5489182472229004s
Received healthy response to inference request in 2.135591506958008s
Received healthy response to inference request in 2.413170576095581s
Received healthy response to inference request in 2.2038583755493164s
Received healthy response to inference request in 2.2338576316833496s
Received healthy response to inference request in 2.179385185241699s
Received healthy response to inference request in 2.2121500968933105s
Received healthy response to inference request in 2.3155007362365723s
Received healthy response to inference request in 2.4397037029266357s
Received healthy response to inference request in 2.259857654571533s
Received healthy response to inference request in 2.3300905227661133s
Inference service chaiml-reward-dpo-62cf-c-8436-v1 ready after 588.5644986629486s
Pipeline stage VLLMDeployer completed in 591.38s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.276501178741455s
Received healthy response to inference request in 2.2182793617248535s
Received healthy response to inference request in 2.3663265705108643s
Received healthy response to inference request in 2.1717023849487305s
Received healthy response to inference request in 2.7309305667877197s
Received healthy response to inference request in 2.255979061126709s
Received healthy response to inference request in 2.8991124629974365s
Received healthy response to inference request in 2.2568085193634033s
Received healthy response to inference request in 2.26534366607666s
Received healthy response to inference request in 2.16520619392395s
Received healthy response to inference request in 2.2023439407348633s
Received healthy response to inference request in 2.236668348312378s
Received healthy response to inference request in 2.3127291202545166s
Received healthy response to inference request in 2.1775810718536377s
Received healthy response to inference request in 2.227276563644409s
Received healthy response to inference request in 2.4297611713409424s
Received healthy response to inference request in 2.3955016136169434s
Received healthy response to inference request in 2.2737324237823486s
Received healthy response to inference request in 2.2356150150299072s
Received healthy response to inference request in 2.260383129119873s
Received healthy response to inference request in 2.277804136276245s
Received healthy response to inference request in 2.212594985961914s
Received healthy response to inference request in 2.2243340015411377s
Received healthy response to inference request in 2.2900149822235107s
Received healthy response to inference request in 2.2643234729766846s
Received healthy response to inference request in 2.1815552711486816s
Received healthy response to inference request in 2.453138589859009s
Received healthy response to inference request in 2.2121524810791016s
Received healthy response to inference request in 2.2047712802886963s
Received healthy response to inference request in 2.3095192909240723s
Received healthy response to inference request in 2.170631170272827s
Received healthy response to inference request in 2.1907663345336914s
Received healthy response to inference request in 2.225254774093628s
Received healthy response to inference request in 2.2393150329589844s
Received healthy response to inference request in 2.199047088623047s
Received healthy response to inference request in 2.288637161254883s
Received healthy response to inference request in 2.2346341609954834s
Received healthy response to inference request in 2.3356270790100098s
Received healthy response to inference request in 2.443577289581299s
Received healthy response to inference request in 2.4734227657318115s
Received healthy response to inference request in 2.194064140319824s
Received healthy response to inference request in 2.378387212753296s
Received healthy response to inference request in 2.3537986278533936s
Received healthy response to inference request in 2.25596284866333s
Received healthy response to inference request in 2.533170223236084s
Received healthy response to inference request in 2.1857755184173584s
Received healthy response to inference request in 2.5152409076690674s
Received healthy response to inference request in 2.508005142211914s
Received healthy response to inference request in 2.278149366378784s
Received healthy response to inference request in 2.23502254486084s
Received healthy response to inference request in 2.1844279766082764s
Received healthy response to inference request in 2.18401837348938s
Received healthy response to inference request in 2.4751694202423096s
Received healthy response to inference request in 2.29789662361145s
Received healthy response to inference request in 2.2654809951782227s
Received healthy response to inference request in 2.2172820568084717s
Received healthy response to inference request in 2.3396284580230713s
Received healthy response to inference request in 2.1621274948120117s
Received healthy response to inference request in 2.3891654014587402s
Received healthy response to inference request in 2.553380250930786s
Received healthy response to inference request in 2.2177202701568604s
Received healthy response to inference request in 2.190366268157959s
Received healthy response to inference request in 2.664092540740967s
Received healthy response to inference request in 2.3915443420410156s
Received healthy response to inference request in 2.340083360671997s
Received healthy response to inference request in 2.4807322025299072s
Received healthy response to inference request in 2.3073172569274902s
Received healthy response to inference request in 2.277682304382324s
Received healthy response to inference request in 2.2933876514434814s
Received healthy response to inference request in 2.3929715156555176s
Received healthy response to inference request in 2.254410743713379s
30 requests
30 requests
0 failed requests
0 failed requests
5th percentile: 2.1793694615364076
5th percentile: 2.167647433280945
10th percentile: 2.18377206325531
10th percentile: 2.17159526348114
Received healthy response to inference request in 2.44807767868042s
20th percentile: 2.1934045791625976
20th percentile: 2.201159954071045
30th percentile: 2.204043078422546
30th percentile: 2.2158759355545046
40th percentile: 2.2180557250976562
40th percentile: 2.2353780269622803
50th percentile: 2.24491024017334
50th percentile: 2.257134199142456
60th percentile: 2.262422275543213
60th percentile: 2.2769736289978026
Received healthy response to inference request in 2.2321126461029053s
70th percentile: 2.3141492366790772
70th percentile: 2.3228755235671996
80th percentile: 2.391829776763916
80th percentile: 2.397284555435181
90th percentile: 2.4158238887786867
90th percentile: 2.4791765689849856
95th percentile: 2.5998784780502313
95th percentile: 2.5337634444236756
99th percentile: 2.7833563899993896
99th percentile: 2.7975561404228215
Received healthy response to inference request in 2.2263479232788086s
mean time: 2.2948934555053713
mean time: 2.306301164627075
Pipeline stage StressChecker completed in 97.70s
Pipeline stage StressChecker completed in 97.49s
run pipeline stage %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
run_pipeline:run_in_cloud %s
Received healthy response to inference request in 2.145850419998169s
starting trigger_guanaco_pipeline args=%s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 3.12s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 3.12s
Shutdown handler de-registered
Received healthy response to inference request in 2.4203906059265137s
chaiml-reward-dpo-0e94-c_1216_v2 status is now deployed due to DeploymentManager action
chaiml-reward-dpo-2837-_10545_v1 status is now deployed due to DeploymentManager action
Received healthy response to inference request in 2.226377010345459s
Received healthy response to inference request in 2.2520511150360107s
30 requests
0 failed requests
5th percentile: 2.2028000354766846
10th percentile: 2.2262386083602905
20th percentile: 2.231145429611206
30th percentile: 2.2548006772994995
40th percentile: 2.2761754512786867
50th percentile: 2.291701316833496
60th percentile: 2.321562957763672
70th percentile: 2.3909882307052612
80th percentile: 2.449089860916138
90th percentile: 2.510521650314331
95th percentile: 2.54428573846817
99th percentile: 2.6319859766960145
mean time: 2.336586284637451
Pipeline stage StressChecker completed in 90.82s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.44s
Shutdown handler de-registered
chaiml-reward-dpo-62cf-c_8436_v1 status is now deployed due to DeploymentManager action
chaiml-reward-dpo-62cf-c_8436_v1 status is now inactive due to auto deactivation removed underperforming models