developer_uid: chai_backend_admin
submission_id: blend_tigib_2024-11-25
model_name: blend_tigib_2024-11-25
model_group:
status: inactive
timestamp: 2024-11-25T17:59:11+00:00
num_battles: 4773
num_wins: 2355
celo_rating: 1257.43
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: blend
submissions: ['chaiml-elo-alignment-run-3_v44', 'blend_sigim_2024-11-25', 'blend_sigim_2024-11-25', 'blend_sigim_2024-11-25', 'blend_nemas_2024-11-25', 'blend_nemas_2024-11-25']
display_name: blend_tigib_2024-11-25
is_internal_developer: True
language_model: chaiml-elo-alignment-run-3_v44,blend_sigim_2024-11-25,blend_sigim_2024-11-25,blend_sigim_2024-11-25,blend_nemas_2024-11-25,blend_nemas_2024-11-25
model_size: n/a
ranking_group: blended
reward_model: random
us_pacific_date: 2024-11-25
win_ratio: 0.49340037712130735
overrides: {'chaiml-elo-alignment-run-3_v44': {'generation_params': {'best_of': 16}, 'formatter': {}}}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.25s
Shutdown handler de-registered
blend_tigib_2024-11-25 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
clean up pipeline due to error=DeploymentChecksError("'blend_sigim_2024-11-25'")
Shutdown handler de-registered
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
clean up pipeline due to error=DeploymentChecksError("'blend_sigim_2024-11-25'")
Shutdown handler de-registered
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
clean up pipeline due to error=DeploymentChecksError("'blend_nemas_2024-11-25'")
Shutdown handler de-registered