chaiml-bobo-creative-lr_65927

submission_id: chaiml-bobo-creative-lr_65927_v2
developer_uid: Meliodia
status: torndown
model_repo: ChaiML/bobo_creative_lr1_full_run_fixed-step1403-merged
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.0, 'top_k': 64, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['###', '<|turn>', '</s>', '<|im_start|>', '<|redacted_im_end|>', 'You:', '<turn|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
timestamp: 2026-04-08T18:35:55+00:00
model_name: chaiml-bobo-creative-lr_65927_v1
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-bobo-creative-lr-65927-v2-uploader
Waiting for job on chaiml-bobo-creative-lr-65927-v2-uploader to finish
chaiml-bobo-creative-lr-65927-v2-uploader: Traceback (most recent call last):
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/transformers/models/auto/configuration_auto.py", line 1457, in from_pretrained
chaiml-bobo-creative-lr-65927-v2-uploader:     config_class = CONFIG_MAPPING[config_dict["model_type"]]
chaiml-bobo-creative-lr-65927-v2-uploader:                    ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/transformers/models/auto/configuration_auto.py", line 1160, in __getitem__
chaiml-bobo-creative-lr-65927-v2-uploader:     raise KeyError(key)
chaiml-bobo-creative-lr-65927-v2-uploader: KeyError: 'gemma4'
chaiml-bobo-creative-lr-65927-v2-uploader: During handling of the above exception, another exception occurred:
chaiml-bobo-creative-lr-65927-v2-uploader: Traceback (most recent call last):
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/code/uploading/compress.py", line 344, in <module>
chaiml-bobo-creative-lr-65927-v2-uploader:     cli()
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1485, in __call__
chaiml-bobo-creative-lr-65927-v2-uploader:     return self.main(*args, **kwargs)
chaiml-bobo-creative-lr-65927-v2-uploader:            ^^^^^^^^^^^^^^^^^^^^^^^^^^
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1406, in main
chaiml-bobo-creative-lr-65927-v2-uploader:     rv = self.invoke(ctx)
chaiml-bobo-creative-lr-65927-v2-uploader:          ^^^^^^^^^^^^^^^^
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1873, in invoke
chaiml-bobo-creative-lr-65927-v2-uploader:     return _process_result(sub_ctx.command.invoke(sub_ctx))
chaiml-bobo-creative-lr-65927-v2-uploader:                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1269, in invoke
chaiml-bobo-creative-lr-65927-v2-uploader:     return ctx.invoke(self.callback, **ctx.params)
chaiml-bobo-creative-lr-65927-v2-uploader:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 824, in invoke
chaiml-bobo-creative-lr-65927-v2-uploader:     return callback(*args, **kwargs)
chaiml-bobo-creative-lr-65927-v2-uploader:            ^^^^^^^^^^^^^^^^^^^^^^^^^
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/code/uploading/compress.py", line 36, in process
chaiml-bobo-creative-lr-65927-v2-uploader:     config = AutoConfig.from_pretrained(
chaiml-bobo-creative-lr-65927-v2-uploader:              ^^^^^^^^^^^^^^^^^^^^^^^^^^^
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/transformers/models/auto/configuration_auto.py", line 1459, in from_pretrained
chaiml-bobo-creative-lr-65927-v2-uploader:     raise ValueError(
chaiml-bobo-creative-lr-65927-v2-uploader: ValueError: The checkpoint you are trying to load has model type `gemma4` but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.
chaiml-bobo-creative-lr-65927-v2-uploader: You can update Transformers with the command `pip install --upgrade transformers`. If this does not work, and the checkpoint is very new, then there may not be a release version that supports this model yet. In this case, you can get the most up-to-date code by installing Transformers from source with the command `pip install git+https://github.com/huggingface/transformers.git`
Job chaiml-bobo-creative-lr-65927-v2-uploader completed after 21.84s with status: failed
Job failed chaiml-bobo-creative-lr-65927-v2-uploader: 
Stopping job with name chaiml-bobo-creative-lr-65927-v2-uploader
%s, retrying in %s seconds...
Starting job with name chaiml-bobo-creative-lr-65927-v2-uploader
Waiting for job on chaiml-bobo-creative-lr-65927-v2-uploader to finish
chaiml-bobo-creative-lr-65927-v2-uploader: Traceback (most recent call last):
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/transformers/models/auto/configuration_auto.py", line 1457, in from_pretrained
chaiml-bobo-creative-lr-65927-v2-uploader:     config_class = CONFIG_MAPPING[config_dict["model_type"]]
chaiml-bobo-creative-lr-65927-v2-uploader:                    ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/transformers/models/auto/configuration_auto.py", line 1160, in __getitem__
chaiml-bobo-creative-lr-65927-v2-uploader:     raise KeyError(key)
chaiml-bobo-creative-lr-65927-v2-uploader: KeyError: 'gemma4'
chaiml-bobo-creative-lr-65927-v2-uploader: During handling of the above exception, another exception occurred:
chaiml-bobo-creative-lr-65927-v2-uploader: Traceback (most recent call last):
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/code/uploading/compress.py", line 344, in <module>
chaiml-bobo-creative-lr-65927-v2-uploader:     cli()
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1485, in __call__
chaiml-bobo-creative-lr-65927-v2-uploader:     return self.main(*args, **kwargs)
chaiml-bobo-creative-lr-65927-v2-uploader:            ^^^^^^^^^^^^^^^^^^^^^^^^^^
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1406, in main
chaiml-bobo-creative-lr-65927-v2-uploader:     rv = self.invoke(ctx)
chaiml-bobo-creative-lr-65927-v2-uploader:          ^^^^^^^^^^^^^^^^
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1873, in invoke
chaiml-bobo-creative-lr-65927-v2-uploader:     return _process_result(sub_ctx.command.invoke(sub_ctx))
chaiml-bobo-creative-lr-65927-v2-uploader:                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1269, in invoke
chaiml-bobo-creative-lr-65927-v2-uploader:     return ctx.invoke(self.callback, **ctx.params)
chaiml-bobo-creative-lr-65927-v2-uploader:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 824, in invoke
chaiml-bobo-creative-lr-65927-v2-uploader:     return callback(*args, **kwargs)
chaiml-bobo-creative-lr-65927-v2-uploader:            ^^^^^^^^^^^^^^^^^^^^^^^^^
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/code/uploading/compress.py", line 36, in process
chaiml-bobo-creative-lr-65927-v2-uploader:     config = AutoConfig.from_pretrained(
chaiml-bobo-creative-lr-65927-v2-uploader:              ^^^^^^^^^^^^^^^^^^^^^^^^^^^
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/transformers/models/auto/configuration_auto.py", line 1459, in from_pretrained
chaiml-bobo-creative-lr-65927-v2-uploader:     raise ValueError(
chaiml-bobo-creative-lr-65927-v2-uploader: ValueError: The checkpoint you are trying to load has model type `gemma4` but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.
chaiml-bobo-creative-lr-65927-v2-uploader: You can update Transformers with the command `pip install --upgrade transformers`. If this does not work, and the checkpoint is very new, then there may not be a release version that supports this model yet. In this case, you can get the most up-to-date code by installing Transformers from source with the command `pip install git+https://github.com/huggingface/transformers.git`
Retrying (%r) after connection broken by '%r': %s
Retrying (%r) after connection broken by '%r': %s
Job chaiml-bobo-creative-lr-65927-v2-uploader completed after 22.21s with status: failed
Job failed chaiml-bobo-creative-lr-65927-v2-uploader: 
Stopping job with name chaiml-bobo-creative-lr-65927-v2-uploader
%s, retrying in %s seconds...
Starting job with name chaiml-bobo-creative-lr-65927-v2-uploader
Waiting for job on chaiml-bobo-creative-lr-65927-v2-uploader to finish
chaiml-bobo-creative-lr-65927-v2-uploader: Traceback (most recent call last):
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/transformers/models/auto/configuration_auto.py", line 1457, in from_pretrained
chaiml-bobo-creative-lr-65927-v2-uploader:     config_class = CONFIG_MAPPING[config_dict["model_type"]]
chaiml-bobo-creative-lr-65927-v2-uploader:                    ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/transformers/models/auto/configuration_auto.py", line 1160, in __getitem__
chaiml-bobo-creative-lr-65927-v2-uploader:     raise KeyError(key)
chaiml-bobo-creative-lr-65927-v2-uploader: KeyError: 'gemma4'
chaiml-bobo-creative-lr-65927-v2-uploader: During handling of the above exception, another exception occurred:
chaiml-bobo-creative-lr-65927-v2-uploader: Traceback (most recent call last):
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/code/uploading/compress.py", line 344, in <module>
chaiml-bobo-creative-lr-65927-v2-uploader:     cli()
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1485, in __call__
chaiml-bobo-creative-lr-65927-v2-uploader:     return self.main(*args, **kwargs)
chaiml-bobo-creative-lr-65927-v2-uploader:            ^^^^^^^^^^^^^^^^^^^^^^^^^^
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1406, in main
chaiml-bobo-creative-lr-65927-v2-uploader:     rv = self.invoke(ctx)
chaiml-bobo-creative-lr-65927-v2-uploader:          ^^^^^^^^^^^^^^^^
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1873, in invoke
chaiml-bobo-creative-lr-65927-v2-uploader:     return _process_result(sub_ctx.command.invoke(sub_ctx))
chaiml-bobo-creative-lr-65927-v2-uploader:                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1269, in invoke
chaiml-bobo-creative-lr-65927-v2-uploader:     return ctx.invoke(self.callback, **ctx.params)
chaiml-bobo-creative-lr-65927-v2-uploader:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 824, in invoke
chaiml-bobo-creative-lr-65927-v2-uploader:     return callback(*args, **kwargs)
chaiml-bobo-creative-lr-65927-v2-uploader:            ^^^^^^^^^^^^^^^^^^^^^^^^^
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/code/uploading/compress.py", line 36, in process
chaiml-bobo-creative-lr-65927-v2-uploader:     config = AutoConfig.from_pretrained(
chaiml-bobo-creative-lr-65927-v2-uploader:              ^^^^^^^^^^^^^^^^^^^^^^^^^^^
chaiml-bobo-creative-lr-65927-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/transformers/models/auto/configuration_auto.py", line 1459, in from_pretrained
chaiml-bobo-creative-lr-65927-v2-uploader:     raise ValueError(
chaiml-bobo-creative-lr-65927-v2-uploader: ValueError: The checkpoint you are trying to load has model type `gemma4` but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.
chaiml-bobo-creative-lr-65927-v2-uploader: You can update Transformers with the command `pip install --upgrade transformers`. If this does not work, and the checkpoint is very new, then there may not be a release version that supports this model yet. In this case, you can get the most up-to-date code by installing Transformers from source with the command `pip install git+https://github.com/huggingface/transformers.git`
Job chaiml-bobo-creative-lr-65927-v2-uploader completed after 12.03s with status: failed
Job failed chaiml-bobo-creative-lr-65927-v2-uploader: 
Stopping job with name chaiml-bobo-creative-lr-65927-v2-uploader
clean up pipeline due to error=VLLMUploaderError('')
run pipeline stage %s
Running pipeline stage VLLMDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage VLLMDeleter completed in 0.19s
run pipeline stage %s
Running pipeline stage VLLMModelDeleter
Cleaning model data from S3
Pipeline stage VLLMModelDeleter completed in 0.19s
Shutdown handler de-registered
chaiml-bobo-creative-lr_65927_v2 status is now failed due to DeploymentManager action
chaiml-bobo-creative-lr_65927_v2 status is now torndown due to DeploymentManager action