chaiml-star-trek-open-r_10141

developer_uid: chai_backend_admin

submission_id: chaiml-star-trek-open-r_10141_v2

model_name: chaiml-star-trek-open-r_10141_v2

model_group: ChaiML/Star-Trek-Open-RP

status: torndown

timestamp: 2026-03-03T22:02:58+00:00

num_battles: 2969

num_wins: 1265

celo_rating: 9098.32

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: basic

model_repo: ChaiML/Star-Trek-Open-RP-After-the-Burn260303204351_sft

model_architecture: MistralForCausalLM

model_num_parameters: 24096691200.0

best_of: 8

max_input_tokens: 1024

max_output_tokens: 64

reward_model: default

display_name: chaiml-star-trek-open-r_10141_v2

ineligible_reason: num_battles<10000

is_internal_developer: True

language_model: ChaiML/Star-Trek-Open-RP-After-the-Burn260303204351_sft

model_size: 24B

ranking_group: single

us_pacific_date: 2026-03-03

win_ratio: 0.4260693836308521

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['You:', '</s>', '####\n', '####', '\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}</s>\n', 'user_template': 'You: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': True}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-star-trek-open-r-10141-v2-uploader
Waiting for job on chaiml-star-trek-open-r-10141-v2-uploader to finish
chaiml-star-trek-open-r-10141-v2-uploader: Using quantization_mode: fp8
chaiml-star-trek-open-r-10141-v2-uploader: Checking if ChaiML/Star-Trek-Open-RP-After-the-Burn260303204351_sft-FP8 already exists in ChaiML
chaiml-star-trek-open-r-10141-v2-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-star-trek-open-r-10141-v2-uploader: Downloading snapshot of ChaiML/Star-Trek-Open-RP-After-the-Burn260303204351_sft-FP8...
chaiml-star-trek-open-r-10141-v2-uploader: Downloaded in 22.796s
chaiml-star-trek-open-r-10141-v2-uploader: Processed model ChaiML/Star-Trek-Open-RP-After-the-Burn260303204351_sft in 26.235s
chaiml-star-trek-open-r-10141-v2-uploader: creating bucket guanaco-vllm-models
chaiml-star-trek-open-r-10141-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-star-trek-open-r-10141-v2-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-star-trek-open-r-10141-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-star-trek-open-r-10141-v2-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-star-trek-open-r-10141-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-star-trek-open-r-10141-v2-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-star-trek-open-r-10141-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-star-trek-open-r-10141-v2-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-star-trek-open-r-10141-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-star-trek-open-r-10141-v2-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-star-trek-open-r-10141-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-star-trek-open-r-10141-v2-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-star-trek-open-r-10141-v2-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-star-trek-open-r-10141-v2-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-star-trek-open-r-10141-v2-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-star-trek-open-r-10141-v2-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-star-trek-open-r-10141-v2-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-star-trek-open-r-10141-v2-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-star-trek-open-r-10141-v2/default
chaiml-star-trek-open-r-10141-v2-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-star-trek-open-r-10141-v2/default/recipe.yaml
chaiml-star-trek-open-r-10141-v2-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-star-trek-open-r-10141-v2/default/.gitattributes
chaiml-star-trek-open-r-10141-v2-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-star-trek-open-r-10141-v2/default/generation_config.json
chaiml-star-trek-open-r-10141-v2-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-star-trek-open-r-10141-v2/default/model.safetensors.index.json
chaiml-star-trek-open-r-10141-v2-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-star-trek-open-r-10141-v2/default/config.json
chaiml-star-trek-open-r-10141-v2-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-star-trek-open-r-10141-v2/default/tokenizer_config.json
chaiml-star-trek-open-r-10141-v2-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-star-trek-open-r-10141-v2/default/special_tokens_map.json
chaiml-star-trek-open-r-10141-v2-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-star-trek-open-r-10141-v2/default/tokenizer.json
chaiml-star-trek-open-r-10141-v2-uploader: cp /dev/shm/model_output/model-00006-of-00006.safetensors s3://guanaco-vllm-models/chaiml-star-trek-open-r-10141-v2/default/model-00006-of-00006.safetensors
chaiml-star-trek-open-r-10141-v2-uploader: cp /dev/shm/model_output/model-00001-of-00006.safetensors s3://guanaco-vllm-models/chaiml-star-trek-open-r-10141-v2/default/model-00001-of-00006.safetensors
chaiml-star-trek-open-r-10141-v2-uploader: cp /dev/shm/model_output/model-00002-of-00006.safetensors s3://guanaco-vllm-models/chaiml-star-trek-open-r-10141-v2/default/model-00002-of-00006.safetensors
chaiml-star-trek-open-r-10141-v2-uploader: cp /dev/shm/model_output/model-00003-of-00006.safetensors s3://guanaco-vllm-models/chaiml-star-trek-open-r-10141-v2/default/model-00003-of-00006.safetensors
chaiml-star-trek-open-r-10141-v2-uploader: cp /dev/shm/model_output/model-00004-of-00006.safetensors s3://guanaco-vllm-models/chaiml-star-trek-open-r-10141-v2/default/model-00004-of-00006.safetensors
Job chaiml-star-trek-open-r-10141-v2-uploader completed after 52.4s with status: succeeded
Stopping job with name chaiml-star-trek-open-r-10141-v2-uploader
Pipeline stage VLLMUploader completed in 52.86s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.32s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-star-trek-open-r-10141-v2
Waiting for inference service chaiml-star-trek-open-r-10141-v2 to be ready
Inference service chaiml-star-trek-open-r-10141-v2 ready after 150.4374692440033s
Pipeline stage VLLMDeployer completed in 151.07s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.3253471851348877s
Received healthy response to inference request in 2.5629024505615234s
Received healthy response to inference request in 1.5398149490356445s
Received healthy response to inference request in 2.228433132171631s
Received healthy response to inference request in 3.035825729370117s
Received healthy response to inference request in 1.9030053615570068s
Received healthy response to inference request in 2.937511682510376s
Received healthy response to inference request in 2.4317946434020996s
Received healthy response to inference request in 3.236830949783325s
Received healthy response to inference request in 2.5323591232299805s
Received healthy response to inference request in 3.3303639888763428s
Received healthy response to inference request in 1.9382457733154297s
Received healthy response to inference request in 3.0052778720855713s
Received healthy response to inference request in 3.088282346725464s
Received healthy response to inference request in 1.8295361995697021s
Received healthy response to inference request in 2.9828600883483887s
Received healthy response to inference request in 3.0326619148254395s
Received healthy response to inference request in 2.915377140045166s
Received healthy response to inference request in 1.3669624328613281s
Received healthy response to inference request in 2.2834854125976562s
Received healthy response to inference request in 2.553713321685791s
Received healthy response to inference request in 2.926886796951294s
Received healthy response to inference request in 1.8032701015472412s
Received healthy response to inference request in 2.612677574157715s
Received healthy response to inference request in 2.9326891899108887s
Received healthy response to inference request in 1.9213471412658691s
Received healthy response to inference request in 2.2982897758483887s
Received healthy response to inference request in 1.600555419921875s
Received healthy response to inference request in 1.649686574935913s
Received healthy response to inference request in 2.1031177043914795s
30 requests
0 failed requests
5th percentile: 1.5671481609344482
10th percentile: 1.6447734594345094
20th percentile: 1.888311529159546
30th percentile: 2.0536561250686645
40th percentile: 2.292368030548096
50th percentile: 2.5430362224578857
60th percentile: 2.733757400512695
70th percentile: 2.9341359376907348
80th percentile: 3.010754680633545
90th percentile: 3.10313720703125
95th percentile: 3.2855148792266844
99th percentile: 3.328909115791321
mean time: 2.4636370658874513
Pipeline stage StressChecker completed in 77.38s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.67s
Shutdown handler de-registered
chaiml-star-trek-open-r_10141_v2 status is now deployed due to DeploymentManager action
chaiml-star-trek-open-r_10141_v2 status is now torndown due to DeploymentManager action