Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-gspo-glm47-chai-52127-v1-uploader
Waiting for job on chaiml-gspo-glm47-chai-52127-v1-uploader to finish
chaiml-gspo-glm47-combi-36238-v1-uploader: Using quantization_mode: fp8
chaiml-gspo-glm47-combi-36238-v1-uploader: Checking if ChaiML/gspo-glm47-combine-rm82-zy-data-step300-FP8 already exists in ChaiML
chaiml-gspo-glm47-combi-36238-v1-uploader: Downloading snapshot of ChaiML/gspo-glm47-combine-rm82-zy-data-step300...
2026-03-18T02:11:27.151314+00:00 monitor updated for chaiml-gspo-glm47-combi_36238_v1
chaiml-gspo-glm47-chai-52127-v1-uploader: Using quantization_mode: fp8
chaiml-gspo-glm47-chai-52127-v1-uploader: Checking if ChaiML/gspo-glm47-chai-rm-zy-data-step300-FP8 already exists in ChaiML
chaiml-gspo-glm47-chai-52127-v1-uploader: Downloading snapshot of ChaiML/gspo-glm47-chai-rm-zy-data-step300...
2026-03-18T02:12:02.661544+00:00 monitor updated for chaiml-gspo-glm47-chai-_52127_v1
2026-03-18T02:12:27.285082+00:00 monitor updated for chaiml-gspo-glm47-combi_36238_v1
2026-03-18T02:13:02.811162+00:00 monitor updated for chaiml-gspo-glm47-chai-_52127_v1
2026-03-18T02:13:27.421139+00:00 monitor updated for chaiml-gspo-glm47-combi_36238_v1
2026-03-18T02:14:02.950662+00:00 monitor updated for chaiml-gspo-glm47-chai-_52127_v1
2026-03-18T02:14:27.559019+00:00 monitor updated for chaiml-gspo-glm47-combi_36238_v1
2026-03-18T02:15:03.087841+00:00 monitor updated for chaiml-gspo-glm47-chai-_52127_v1
2026-03-18T02:15:27.698858+00:00 monitor updated for chaiml-gspo-glm47-combi_36238_v1
chaiml-gspo-glm47-combi-36238-v1-uploader: Downloaded in 258.934s
chaiml-gspo-glm47-combi-36238-v1-uploader: Loading /tmp/model_input...
chaiml-gspo-glm47-combi-36238-v1-uploader: The tokenizer you are loading from '/tmp/model_input' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-gspo-glm47-combi-36238-v1-uploader: `torch_dtype` is deprecated! Use `dtype` instead!
2026-03-18T02:16:03.227944+00:00 monitor updated for chaiml-gspo-glm47-chai-_52127_v1
chaiml-gspo-glm47-chai-52127-v1-uploader: Downloaded in 251.085s
chaiml-gspo-glm47-chai-52127-v1-uploader: Loading /tmp/model_input...
chaiml-gspo-glm47-chai-52127-v1-uploader: The tokenizer you are loading from '/tmp/model_input' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-gspo-glm47-chai-52127-v1-uploader: `torch_dtype` is deprecated! Use `dtype` instead!
2026-03-18T02:16:27.840284+00:00 monitor updated for chaiml-gspo-glm47-combi_36238_v1
chaiml-gspo-glm47-combi-36238-v1-uploader: Some parameters are on the meta device because they were offloaded to the cpu.
chaiml-gspo-glm47-combi-36238-v1-uploader: Applying quantization...
chaiml-gspo-glm47-combi-36238-v1-uploader: The tokenizer you are loading from '/tmp/model_input' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-gspo-glm47-combi-36238-v1-uploader: 2026-03-17T19:16:24.007939-0700 | reset | INFO - Compression lifecycle reset
chaiml-gspo-glm47-combi-36238-v1-uploader: 2026-03-17T19:16:24.072894-0700 | from_modifiers | INFO - Creating recipe from modifiers
chaiml-gspo-glm47-chai-52127-v1-uploader: Some parameters are on the meta device because they were offloaded to the cpu.
chaiml-gspo-glm47-chai-52127-v1-uploader: Applying quantization...
chaiml-gspo-glm47-chai-52127-v1-uploader: The tokenizer you are loading from '/tmp/model_input' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-gspo-glm47-chai-52127-v1-uploader: 2026-03-17T19:16:49.862898-0700 | reset | INFO - Compression lifecycle reset
chaiml-gspo-glm47-chai-52127-v1-uploader: 2026-03-17T19:16:49.930906-0700 | from_modifiers | INFO - Creating recipe from modifiers
2026-03-18T02:17:03.368810+00:00 monitor updated for chaiml-gspo-glm47-chai-_52127_v1
chaiml-gspo-glm47-combi-36238-v1-uploader: 2026-03-17T19:17:21.279844-0700 | initialize | INFO - Compression lifecycle initialized for 1 modifiers
chaiml-gspo-glm47-combi-36238-v1-uploader: 2026-03-17T19:17:21.280315-0700 | IndependentPipeline | INFO - Inferred `DataFreePipeline` for `QuantizationModifier`
2026-03-18T02:17:28.001542+00:00 monitor updated for chaiml-gspo-glm47-combi_36238_v1
chaiml-gspo-glm47-chai-52127-v1-uploader: 2026-03-17T19:17:46.927994-0700 | initialize | INFO - Compression lifecycle initialized for 1 modifiers
chaiml-gspo-glm47-chai-52127-v1-uploader: 2026-03-17T19:17:46.928468-0700 | IndependentPipeline | INFO - Inferred `DataFreePipeline` for `QuantizationModifier`
chaiml-gspo-glm47-combi-36238-v1-uploader: Some parameters are on the meta device because they were offloaded to the cpu.
2026-03-18T02:18:03.512620+00:00 monitor updated for chaiml-gspo-glm47-chai-_52127_v1
2026-03-18T02:18:28.141546+00:00 monitor updated for chaiml-gspo-glm47-combi_36238_v1
chaiml-gspo-glm47-chai-52127-v1-uploader: Some parameters are on the meta device because they were offloaded to the cpu.
2026-03-18T02:19:03.651678+00:00 monitor updated for chaiml-gspo-glm47-chai-_52127_v1
2026-03-18T02:19:28.290894+00:00 monitor updated for chaiml-gspo-glm47-combi_36238_v1
2026-03-18T02:20:03.797980+00:00 monitor updated for chaiml-gspo-glm47-chai-_52127_v1
2026-03-18T02:20:28.436830+00:00 monitor updated for chaiml-gspo-glm47-combi_36238_v1
2026-03-18T02:21:03.938191+00:00 monitor updated for chaiml-gspo-glm47-chai-_52127_v1
2026-03-18T02:21:28.579411+00:00 monitor updated for chaiml-gspo-glm47-combi_36238_v1
2026-03-18T02:22:04.081536+00:00 monitor updated for chaiml-gspo-glm47-chai-_52127_v1
2026-03-18T02:22:28.715124+00:00 monitor updated for chaiml-gspo-glm47-combi_36238_v1
2026-03-18T02:23:04.214378+00:00 monitor updated for chaiml-gspo-glm47-chai-_52127_v1
2026-03-18T02:23:28.856296+00:00 monitor updated for chaiml-gspo-glm47-combi_36238_v1
2026-03-18T02:24:04.352330+00:00 monitor updated for chaiml-gspo-glm47-chai-_52127_v1
2026-03-18T02:24:28.999978+00:00 monitor updated for chaiml-gspo-glm47-combi_36238_v1
2026-03-18T02:25:04.491847+00:00 monitor updated for chaiml-gspo-glm47-chai-_52127_v1
2026-03-18T02:25:29.138706+00:00 monitor updated for chaiml-gspo-glm47-combi_36238_v1
2026-03-18T02:26:04.625317+00:00 monitor updated for chaiml-gspo-glm47-chai-_52127_v1
2026-03-18T02:26:29.276308+00:00 monitor updated for chaiml-gspo-glm47-combi_36238_v1
2026-03-18T02:27:04.768224+00:00 monitor updated for chaiml-gspo-glm47-chai-_52127_v1
chaiml-gspo-glm47-combi-36238-v1-uploader: 2026-03-17T19:27:06.752175-0700 | finalize | INFO - Compression lifecycle finalized for 1 modifiers
chaiml-gspo-glm47-combi-36238-v1-uploader: 2026-03-17T19:27:13.458072-0700 | post_process | WARNING - Optimized model is not saved. To save, please provide`output_dir` as input arg.Ex. `oneshot(..., output_dir=...)`
chaiml-gspo-glm47-combi-36238-v1-uploader: Saving to /dev/shm/model_output...
chaiml-gspo-glm47-combi-36238-v1-uploader: 2026-03-17T19:27:13.485950-0700 | get_model_compressor | INFO - skip_sparsity_compression_stats set to True. Skipping sparsity compression statistic calculations. No sparsity compressor will be applied.
2026-03-18T02:27:29.419883+00:00 monitor updated for chaiml-gspo-glm47-combi_36238_v1
2026-03-18T02:28:04.906026+00:00 monitor updated for chaiml-gspo-glm47-chai-_52127_v1
2026-03-18T02:28:29.566290+00:00 monitor updated for chaiml-gspo-glm47-combi_36238_v1
2026-03-18T02:29:05.280332+00:00 monitor updated for chaiml-gspo-glm47-chai-_52127_v1
2026-03-18T02:29:29.705343+00:00 monitor updated for chaiml-gspo-glm47-combi_36238_v1
2026-03-18T02:30:05.419476+00:00 monitor updated for chaiml-gspo-glm47-chai-_52127_v1
2026-03-18T02:30:29.836688+00:00 monitor updated for chaiml-gspo-glm47-combi_36238_v1
chaiml-gspo-glm47-chai-_52127_v1 status is now deployed due to DeploymentManager action
chaiml-gspo-glm47-chai-_52127_v1 status is now inactive due to auto deactivation removed underperforming models
chaiml-gspo-glm47-chai-_52127_v1 status is now torndown due to DeploymentManager action