alexdaoud-trainer-bagir_23108

developer_uid: chai_backend_admin

submission_id: alexdaoud-trainer-bagir_23108_v1

model_name: alexdaoud-trainer-bagir_23108_v1

model_group: alexdaoud/trainer_bagir_

status: torndown

timestamp: 2025-01-24T13:16:26+00:00

num_battles: 10895

num_wins: 5980

celo_rating: 1303.29

family_friendly_score: 0.5634

family_friendly_standard_error: 0.007013992301107837

submission_type: basic

model_repo: alexdaoud/trainer_bagir_2024-12-11-checkpoint-110

model_architecture: LlamaForSequenceClassification

model_num_parameters: 8030261248.0

best_of: 1

max_input_tokens: 256

max_output_tokens: 1

reward_model: default

display_name: alexdaoud-trainer-bagir_23108_v1

ineligible_reason: max_output_tokens!=64

is_internal_developer: True

language_model: alexdaoud/trainer_bagir_2024-12-11-checkpoint-110

model_size: 8B

ranking_group: single

us_pacific_date: 2025-01-24

win_ratio: 0.5488756310234052

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 256, 'best_of': 1, 'max_output_tokens': 1}

formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '', 'truncate_by_message': True}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name alexdaoud-trainer-bagir-23108-v1-mkmlizer
Waiting for job on alexdaoud-trainer-bagir-23108-v1-mkmlizer to finish
alexdaoud-trainer-bagir-23108-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
alexdaoud-trainer-bagir-23108-v1-mkmlizer: ║     _____            __           __                                ║
alexdaoud-trainer-bagir-23108-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
alexdaoud-trainer-bagir-23108-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
alexdaoud-trainer-bagir-23108-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
alexdaoud-trainer-bagir-23108-v1-mkmlizer: ║       /___/                                                         ║
alexdaoud-trainer-bagir-23108-v1-mkmlizer: ║                                                                     ║
alexdaoud-trainer-bagir-23108-v1-mkmlizer: ║  Version: 0.11.12                                                   ║
alexdaoud-trainer-bagir-23108-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
alexdaoud-trainer-bagir-23108-v1-mkmlizer: ║  https://mk1.ai                                                     ║
alexdaoud-trainer-bagir-23108-v1-mkmlizer: ║                                                                     ║
alexdaoud-trainer-bagir-23108-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
alexdaoud-trainer-bagir-23108-v1-mkmlizer: ║  belonging to:                                                      ║
alexdaoud-trainer-bagir-23108-v1-mkmlizer: ║                                                                     ║
alexdaoud-trainer-bagir-23108-v1-mkmlizer: ║  Chai Research Corp.                                                ║
alexdaoud-trainer-bagir-23108-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
alexdaoud-trainer-bagir-23108-v1-mkmlizer: ║  Expiration: 2025-04-15 23:59:59                                    ║
alexdaoud-trainer-bagir-23108-v1-mkmlizer: ║                                                                     ║
alexdaoud-trainer-bagir-23108-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
alexdaoud-trainer-bagir-23108-v1-mkmlizer: Downloaded to shared memory in 30.277s
alexdaoud-trainer-bagir-23108-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:t0, folder:/tmp/tmpkuzl02z0, device:0
alexdaoud-trainer-bagir-23108-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
alexdaoud-trainer-bagir-23108-v1-mkmlizer: quantized model in 85.441s
alexdaoud-trainer-bagir-23108-v1-mkmlizer: Processed model alexdaoud/trainer_bagir_2024-12-11-checkpoint-110 in 115.718s
alexdaoud-trainer-bagir-23108-v1-mkmlizer: creating bucket guanaco-mkml-models
alexdaoud-trainer-bagir-23108-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
alexdaoud-trainer-bagir-23108-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/alexdaoud-trainer-bagir-23108-v1
alexdaoud-trainer-bagir-23108-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/alexdaoud-trainer-bagir-23108-v1/config.json
alexdaoud-trainer-bagir-23108-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/alexdaoud-trainer-bagir-23108-v1/special_tokens_map.json
alexdaoud-trainer-bagir-23108-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/alexdaoud-trainer-bagir-23108-v1/tokenizer_config.json
alexdaoud-trainer-bagir-23108-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/alexdaoud-trainer-bagir-23108-v1/tokenizer.json
alexdaoud-trainer-bagir-23108-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/alexdaoud-trainer-bagir-23108-v1/flywheel_model.0.safetensors
Job alexdaoud-trainer-bagir-23108-v1-mkmlizer completed after 145.29s with status: succeeded
Stopping job with name alexdaoud-trainer-bagir-23108-v1-mkmlizer
Pipeline stage MKMLizer completed in 145.73s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.13s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service alexdaoud-trainer-bagir-23108-v1
Waiting for inference service alexdaoud-trainer-bagir-23108-v1 to be ready
Inference service alexdaoud-trainer-bagir-23108-v1 ready after 180.63179636001587s
Pipeline stage MKMLDeployer completed in 181.17s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.085878849029541s
Received healthy response to inference request in 3.721464157104492s
Received healthy response to inference request in 4.821776628494263s
Received healthy response to inference request in 5.604976415634155s
Received healthy response to inference request in 5.061729431152344s
5 requests
0 failed requests
5th percentile: 3.9415266513824463
10th percentile: 4.1615891456604
20th percentile: 4.601714134216309
30th percentile: 4.869767189025879
40th percentile: 4.965748310089111
50th percentile: 5.061729431152344
60th percentile: 5.071389198303223
70th percentile: 5.081048965454102
80th percentile: 5.189698362350464
90th percentile: 5.39733738899231
95th percentile: 5.501156902313232
99th percentile: 5.5842125129699705
mean time: 4.859165096282959
%s, retrying in %s seconds...
Received healthy response to inference request in 3.42228102684021s
Received healthy response to inference request in 3.902008533477783s
Received healthy response to inference request in 3.6393418312072754s
Received healthy response to inference request in 2.1626482009887695s
Received healthy response to inference request in 3.3250725269317627s
5 requests
0 failed requests
5th percentile: 2.395133066177368
10th percentile: 2.627617931365967
20th percentile: 3.0925876617431642
30th percentile: 3.3445142269134522
40th percentile: 3.383397626876831
50th percentile: 3.42228102684021
60th percentile: 3.509105348587036
70th percentile: 3.595929670333862
80th percentile: 3.691875171661377
90th percentile: 3.79694185256958
95th percentile: 3.8494751930236815
99th percentile: 3.891501865386963
mean time: 3.2902704238891602
Pipeline stage StressChecker completed in 43.04s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.15s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 0.73s
Shutdown handler de-registered
alexdaoud-trainer-bagir_23108_v1 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage MKMLProfilerDeleter completed in 0.09s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.09s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 4374.75s
Shutdown handler de-registered
alexdaoud-trainer-bagir_23108_v1 status is now inactive due to auto deactivation removed underperforming models
alexdaoud-trainer-bagir_23108_v1 status is now torndown due to DeploymentManager action