developer_uid: chai_backend_admin
submission_id: alexdaoud-trainer-bagir_72509_v2
model_name: alexdaoud-trainer-bagir_72509_v2
model_group: alexdaoud/trainer_bagir_
status: torndown
timestamp: 2025-01-20T21:01:20+00:00
num_battles: 14533
num_wins: 7728
celo_rating: 1292.42
family_friendly_score: 0.5720000000000001
family_friendly_standard_error: 0.00699737093485832
submission_type: basic
model_repo: alexdaoud/trainer_bagir_2024-12-11-checkpoint-81
model_architecture: LlamaForSequenceClassification
model_num_parameters: 8030261248.0
best_of: 1
max_input_tokens: 256
max_output_tokens: 1
reward_model: default
display_name: alexdaoud-trainer-bagir_72509_v2
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: alexdaoud/trainer_bagir_2024-12-11-checkpoint-81
model_size: 8B
ranking_group: single
us_pacific_date: 2025-01-20
win_ratio: 0.5317553154888873
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 256, 'best_of': 1, 'max_output_tokens': 1}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name alexdaoud-trainer-bagir-72509-v2-mkmlizer
Waiting for job on alexdaoud-trainer-bagir-72509-v2-mkmlizer to finish
alexdaoud-trainer-bagir-72509-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
alexdaoud-trainer-bagir-72509-v2-mkmlizer: ║     _____            __           __                                ║
alexdaoud-trainer-bagir-72509-v2-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
alexdaoud-trainer-bagir-72509-v2-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
alexdaoud-trainer-bagir-72509-v2-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
alexdaoud-trainer-bagir-72509-v2-mkmlizer: ║       /___/                                                         ║
alexdaoud-trainer-bagir-72509-v2-mkmlizer: ║                                                                     ║
alexdaoud-trainer-bagir-72509-v2-mkmlizer: ║  Version: 0.11.12                                                   ║
alexdaoud-trainer-bagir-72509-v2-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
alexdaoud-trainer-bagir-72509-v2-mkmlizer: ║  https://mk1.ai                                                     ║
alexdaoud-trainer-bagir-72509-v2-mkmlizer: ║                                                                     ║
alexdaoud-trainer-bagir-72509-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
alexdaoud-trainer-bagir-72509-v2-mkmlizer: ║  belonging to:                                                      ║
alexdaoud-trainer-bagir-72509-v2-mkmlizer: ║                                                                     ║
alexdaoud-trainer-bagir-72509-v2-mkmlizer: ║  Chai Research Corp.                                                ║
alexdaoud-trainer-bagir-72509-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
alexdaoud-trainer-bagir-72509-v2-mkmlizer: ║  Expiration: 2025-04-15 23:59:59                                    ║
alexdaoud-trainer-bagir-72509-v2-mkmlizer: ║                                                                     ║
alexdaoud-trainer-bagir-72509-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
alexdaoud-trainer-bagir-72509-v2-mkmlizer: Downloaded to shared memory in 30.947s
alexdaoud-trainer-bagir-72509-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:t0, folder:/tmp/tmp80w_pmcv, device:0
alexdaoud-trainer-bagir-72509-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
alexdaoud-trainer-bagir-72509-v2-mkmlizer: quantized model in 84.620s
alexdaoud-trainer-bagir-72509-v2-mkmlizer: Processed model alexdaoud/trainer_bagir_2024-12-11-checkpoint-81 in 115.567s
alexdaoud-trainer-bagir-72509-v2-mkmlizer: creating bucket guanaco-mkml-models
alexdaoud-trainer-bagir-72509-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
alexdaoud-trainer-bagir-72509-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/alexdaoud-trainer-bagir-72509-v2
alexdaoud-trainer-bagir-72509-v2-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/alexdaoud-trainer-bagir-72509-v2/config.json
alexdaoud-trainer-bagir-72509-v2-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/alexdaoud-trainer-bagir-72509-v2/special_tokens_map.json
alexdaoud-trainer-bagir-72509-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/alexdaoud-trainer-bagir-72509-v2/tokenizer_config.json
alexdaoud-trainer-bagir-72509-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/alexdaoud-trainer-bagir-72509-v2/tokenizer.json
alexdaoud-trainer-bagir-72509-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/alexdaoud-trainer-bagir-72509-v2/flywheel_model.0.safetensors
Job alexdaoud-trainer-bagir-72509-v2-mkmlizer completed after 145.81s with status: succeeded
Stopping job with name alexdaoud-trainer-bagir-72509-v2-mkmlizer
Pipeline stage MKMLizer completed in 146.30s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.16s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service alexdaoud-trainer-bagir-72509-v2
Waiting for inference service alexdaoud-trainer-bagir-72509-v2 to be ready
Inference service alexdaoud-trainer-bagir-72509-v2 ready after 120.63842964172363s
Pipeline stage MKMLDeployer completed in 121.17s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.46072793006897s
Received healthy response to inference request in 2.6572105884552s
Received healthy response to inference request in 7.0075438022613525s
Received healthy response to inference request in 3.81166934967041s
Received healthy response to inference request in 5.157561302185059s
5 requests
0 failed requests
5th percentile: 2.888102340698242
10th percentile: 3.1189940929412843
20th percentile: 3.5807775974273683
30th percentile: 3.9414810657501222
40th percentile: 4.2011044979095455
50th percentile: 4.46072793006897
60th percentile: 4.739461278915405
70th percentile: 5.018194627761841
80th percentile: 5.527557802200318
90th percentile: 6.2675508022308355
95th percentile: 6.637547302246094
99th percentile: 6.933544502258301
mean time: 4.618942594528198
%s, retrying in %s seconds...
Received healthy response to inference request in 2.23614764213562s
Received healthy response to inference request in 1.958144187927246s
Received healthy response to inference request in 3.0624754428863525s
Received healthy response to inference request in 2.5114336013793945s
Received healthy response to inference request in 5.287486553192139s
5 requests
0 failed requests
5th percentile: 2.0137448787689207
10th percentile: 2.069345569610596
20th percentile: 2.1805469512939455
30th percentile: 2.291204833984375
40th percentile: 2.401319217681885
50th percentile: 2.5114336013793945
60th percentile: 2.731850337982178
70th percentile: 2.952267074584961
80th percentile: 3.50747766494751
90th percentile: 4.397482109069824
95th percentile: 4.842484331130981
99th percentile: 5.198486108779907
mean time: 3.0111374855041504
Pipeline stage StressChecker completed in 40.66s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.70s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 0.63s
Shutdown handler de-registered
alexdaoud-trainer-bagir_72509_v2 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3459.88s
Shutdown handler de-registered
alexdaoud-trainer-bagir_72509_v2 status is now inactive due to auto deactivation removed underperforming models
alexdaoud-trainer-bagir_72509_v2 status is now torndown due to DeploymentManager action