function_lekar_2025-05-22

developer_uid: rirv938

submission_id: function_lekar_2025-05-22

model_name: dpo_data_collection

model_group:

status: torndown

timestamp: 2025-05-22T20:50:17+00:00

num_battles: 6406

num_wins: 3184

celo_rating: 1286.18

family_friendly_score: 0.5496

family_friendly_standard_error: 0.007036189878051899

submission_type: function

display_name: dpo_data_collection

is_internal_developer: True

ranking_group: single

us_pacific_date: 2025-05-22

win_ratio: 0.49703403059631596

generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['</s>', '\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 3.5853261947631836s
Received healthy response to inference request in 4.795811891555786s
Received healthy response to inference request in 3.2839322090148926s
Received healthy response to inference request in 4.047659397125244s
5 requests
1 failed requests
5th percentile: 3.3442110061645507
10th percentile: 3.404489803314209
20th percentile: 3.5250473976135255
30th percentile: 3.6777928352355955
40th percentile: 3.86272611618042
50th percentile: 4.047659397125244
60th percentile: 4.346920394897461
70th percentile: 4.646181392669678
80th percentile: 7.8582798957824735
90th percentile: 13.983215904235841
95th percentile: 17.04568390846252
99th percentile: 19.495658311843872
mean time: 7.164176321029663
%s, retrying in %s seconds...
Received healthy response to inference request in 3.157510280609131s
Received healthy response to inference request in 3.0604138374328613s
Received healthy response to inference request in 3.706298828125s
Received healthy response to inference request in 3.7044272422790527s
Received healthy response to inference request in 3.5037081241607666s
5 requests
0 failed requests
5th percentile: 3.0798331260681153
10th percentile: 3.0992524147033693
20th percentile: 3.138090991973877
30th percentile: 3.226749849319458
40th percentile: 3.3652289867401124
50th percentile: 3.5037081241607666
60th percentile: 3.5839957714080812
70th percentile: 3.6642834186553954
80th percentile: 3.704801559448242
90th percentile: 3.705550193786621
95th percentile: 3.7059245109558105
99th percentile: 3.706223964691162
mean time: 3.4264716625213625
Pipeline stage StressChecker completed in 55.01s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.71s
Shutdown handler de-registered
function_lekar_2025-05-22 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3449.84s
Shutdown handler de-registered
function_lekar_2025-05-22 status is now inactive due to auto deactivation removed underperforming models
function_lekar_2025-05-22 status is now torndown due to DeploymentManager action