chaiml-transfer-student_61902

developer_uid: chai_backend_admin
submission_id: chaiml-transfer-student_61902_v1
model_name: chaiml-transfer-student_61902_v1
model_group: ChaiML/Transfer-student-
status: inactive
timestamp: 2026-03-23T19:16:47+00:00
num_battles: 12333
num_wins: 5820
celo_rating: 8490.47
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/Transfer-student-rpg_Jane-Not-Importan260323173830_sft
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
reward_model: default
display_name: chaiml-transfer-student_61902_v1
is_internal_developer: True
language_model: ChaiML/Transfer-student-rpg_Jane-Not-Importan260323173830_sft
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-23
win_ratio: 0.47190464607151544
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', '####\n', '####', 'You:', '\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}</s>\n', 'user_template': 'You: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-transfer-student-61902-v1-uploader
Waiting for job on chaiml-transfer-student-61902-v1-uploader to finish
chaiml-transfer-student-61902-v1-uploader: Using quantization_mode: fp8
chaiml-transfer-student-61902-v1-uploader: Checking if ChaiML/Transfer-student-rpg_Jane-Not-Importan260323173830_sft-FP8 already exists in ChaiML
chaiml-transfer-student-61902-v1-uploader: Downloading snapshot of ChaiML/Transfer-student-rpg_Jane-Not-Importan260323173830_sft...
chaiml-transfer-student-61902-v1-uploader: Downloaded in 147.401s
chaiml-transfer-student-61902-v1-uploader: Loading /tmp/model_input...
chaiml-transfer-student-61902-v1-uploader: The tokenizer you are loading from '/tmp/model_input' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-transfer-student-61902-v1-uploader: `torch_dtype` is deprecated! Use `dtype` instead!
chaiml-transfer-student-61902-v1-uploader: Some parameters are on the meta device because they were offloaded to the cpu.
chaiml-transfer-student-61902-v1-uploader: Applying quantization...
chaiml-transfer-student-61902-v1-uploader: The tokenizer you are loading from '/tmp/model_input' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-transfer-student-61902-v1-uploader: 2026-03-23T10:54:24.494478-0700 | reset | INFO - Compression lifecycle reset
chaiml-transfer-student-61902-v1-uploader: 2026-03-23T10:54:24.495394-0700 | from_modifiers | INFO - Creating recipe from modifiers
chaiml-transfer-student-61902-v1-uploader: 2026-03-23T10:54:24.566047-0700 | initialize | INFO - Compression lifecycle initialized for 1 modifiers
chaiml-transfer-student-61902-v1-uploader: 2026-03-23T10:54:24.566315-0700 | IndependentPipeline | INFO - Inferred `DataFreePipeline` for `QuantizationModifier`
chaiml-transfer-student-61902-v1-uploader: Some parameters are on the meta device because they were offloaded to the cpu.
chaiml-transfer-student-61902-v1-uploader: 2026-03-23T10:54:54.151550-0700 | finalize | INFO - Compression lifecycle finalized for 1 modifiers
chaiml-transfer-student-61902-v1-uploader: 2026-03-23T10:54:56.253824-0700 | post_process | WARNING - Optimized model is not saved. To save, please provide`output_dir` as input arg.Ex. `oneshot(..., output_dir=...)`
chaiml-transfer-student-61902-v1-uploader: Saving to /dev/shm/model_output...
chaiml-transfer-student-61902-v1-uploader: 2026-03-23T10:54:56.280375-0700 | get_model_compressor | INFO - skip_sparsity_compression_stats set to True. Skipping sparsity compression statistic calculations. No sparsity compressor will be applied.
chaiml-transfer-student-61902-v1-uploader: Cleaning quantization config in /dev/shm/model_output
chaiml-transfer-student-61902-v1-uploader: Pushing to ChaiML/Transfer-student-rpg_Jane-Not-Importan260323173830_sft-FP8
chaiml-transfer-student-61902-v1-uploader: Checking if ChaiML/Transfer-student-rpg_Jane-Not-Importan260323173830_sft-FP8 already exists in ChaiML
chaiml-transfer-student-61902-v1-uploader: Creating repo ChaiML/Transfer-student-rpg_Jane-Not-Importan260323173830_sft-FP8 and uploading /dev/shm/model_output to it
chaiml-transfer-student-61902-v1-uploader: ---------- 2026-03-23 10:55:45 (0:00:00) ----------
chaiml-transfer-student-61902-v1-uploader: Files:   hashed 4/13 (274.2K/24.9G) | pre-uploaded: 0/0 (0.0/24.9G) (+13 unsure) | committed: 0/13 (0.0/24.9G) | ignored: 0
chaiml-transfer-student-61902-v1-uploader: Workers: hashing: 12 | get upload mode: 1 | pre-uploading: 0 | committing: 0 | waiting: 113
chaiml-transfer-student-61902-v1-uploader: ---------------------------------------------------
chaiml-transfer-student-61902-v1-uploader: 
[K[F
[K[F
[K[F
[K[F
[K[F
[K[F
[K[F
chaiml-transfer-student-61902-v1-uploader: ---------- 2026-03-23 10:56:45 (0:01:00) ----------
chaiml-transfer-student-61902-v1-uploader: Files:   hashed 13/13 (24.9G/24.9G) | pre-uploaded: 7/7 (24.9G/24.9G) | committed: 0/13 (0.0/24.9G) | ignored: 0
chaiml-transfer-student-61902-v1-uploader: Workers: hashing: 0 | get upload mode: 0 | pre-uploading: 0 | committing: 1 | waiting: 125
chaiml-transfer-student-61902-v1-uploader: ---------------------------------------------------
chaiml-transfer-student-61902-v1-uploader:                              Processed model ChaiML/Transfer-student-rpg_Jane-Not-Importan260323173830_sft in 318.525s
chaiml-transfer-student-61902-v1-uploader: creating bucket guanaco-vllm-models
chaiml-transfer-student-61902-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-transfer-student-61902-v1-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-transfer-student-61902-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-transfer-student-61902-v1-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-transfer-student-61902-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-transfer-student-61902-v1-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-transfer-student-61902-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-transfer-student-61902-v1-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-transfer-student-61902-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-transfer-student-61902-v1-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-transfer-student-61902-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-transfer-student-61902-v1-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-transfer-student-61902-v1-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-transfer-student-61902-v1-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-transfer-student-61902-v1-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-transfer-student-61902-v1-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-transfer-student-61902-v1-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-transfer-student-61902-v1-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-transfer-student-61902-v1/default
chaiml-transfer-student-61902-v1-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-transfer-student-61902-v1/default/generation_config.json
chaiml-transfer-student-61902-v1-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-transfer-student-61902-v1/default/model.safetensors.index.json
chaiml-transfer-student-61902-v1-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-transfer-student-61902-v1/default/recipe.yaml
chaiml-transfer-student-61902-v1-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-transfer-student-61902-v1/default/config.json
chaiml-transfer-student-61902-v1-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-transfer-student-61902-v1/default/special_tokens_map.json
chaiml-transfer-student-61902-v1-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-transfer-student-61902-v1/default/tokenizer_config.json
chaiml-transfer-student-61902-v1-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-transfer-student-61902-v1/default/tokenizer.json
chaiml-transfer-student-61902-v1-uploader: cp /dev/shm/model_output/model-00006-of-00006.safetensors s3://guanaco-vllm-models/chaiml-transfer-student-61902-v1/default/model-00006-of-00006.safetensors
chaiml-transfer-student-61902-v1-uploader: cp /dev/shm/model_output/model-00005-of-00006.safetensors s3://guanaco-vllm-models/chaiml-transfer-student-61902-v1/default/model-00005-of-00006.safetensors
Job chaiml-transfer-student-61902-v1-uploader completed after 350.67s with status: succeeded
Stopping job with name chaiml-transfer-student-61902-v1-uploader
Pipeline stage VLLMUploader completed in 351.67s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.29s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-transfer-student-61902-v1
Waiting for inference service chaiml-transfer-student-61902-v1 to be ready
Inference service chaiml-transfer-student-61902-v1 ready after 161.80955290794373s
Pipeline stage VLLMDeployer completed in 162.44s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.0323092937469482s
Received healthy response to inference request in 3.3052961826324463s
Received healthy response to inference request in 3.4643332958221436s
Received healthy response to inference request in 2.8033268451690674s
Received healthy response to inference request in 2.9438419342041016s
Received healthy response to inference request in 2.8251914978027344s
Received healthy response to inference request in 3.0913383960723877s
Received healthy response to inference request in 2.9582629203796387s
Received healthy response to inference request in 3.032006025314331s
Received healthy response to inference request in 2.6936099529266357s
Received healthy response to inference request in 2.9994871616363525s
Received healthy response to inference request in 3.085134506225586s
Received healthy response to inference request in 3.0523386001586914s
Received healthy response to inference request in 3.4921562671661377s
Received healthy response to inference request in 2.9015305042266846s
Received healthy response to inference request in 2.7840864658355713s
Received healthy response to inference request in 2.7026798725128174s
Received healthy response to inference request in 2.707974672317505s
Received healthy response to inference request in 3.3440237045288086s
Received healthy response to inference request in 3.3716814517974854s
Received healthy response to inference request in 2.7333755493164062s
Received healthy response to inference request in 3.0288984775543213s
Received healthy response to inference request in 3.2187159061431885s
Received healthy response to inference request in 2.7280948162078857s
Received healthy response to inference request in 3.646489381790161s
Received healthy response to inference request in 3.3002383708953857s
Received healthy response to inference request in 2.9008944034576416s
Received healthy response to inference request in 3.2281064987182617s
Received healthy response to inference request in 3.1575634479522705s
Received healthy response to inference request in 2.768360137939453s
30 requests
0 failed requests
5th percentile: 2.7050625324249267
10th percentile: 2.7260828018188477
20th percentile: 2.780941200256348
30th percentile: 2.8781835317611693
40th percentile: 2.9524945259094237
50th percentile: 3.030452251434326
60th percentile: 3.0654569625854493
70th percentile: 3.175909185409546
80th percentile: 3.301249933242798
90th percentile: 3.380946636199951
95th percentile: 3.4796359300613404
99th percentile: 3.6017327785491946
mean time: 3.043378218015035
Pipeline stage StressChecker completed in 98.38s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.84s
Shutdown handler de-registered
chaiml-transfer-student_61902_v1 status is now deployed due to DeploymentManager action
chaiml-transfer-student_61902_v1 status is now inactive due to auto deactivation removed underperforming models