developer_uid: chai_backend_admin
submission_id: function_pahuk_2024-12-01
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-12-01T04:20:43+00:00
num_battles: 8335
num_wins: 4056
celo_rating: 1253.66
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-11-30
win_ratio: 0.486622675464907
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 9.175460577011108s
Received healthy response to inference request in 11.1050386428833s
Received healthy response to inference request in 8.437917709350586s
Received healthy response to inference request in 11.018710851669312s
Received healthy response to inference request in 3.003425359725952s
5 requests
0 failed requests
5th percentile: 4.090323829650879
10th percentile: 5.177222299575806
20th percentile: 7.35101923942566
30th percentile: 8.58542628288269
40th percentile: 8.880443429946899
50th percentile: 9.175460577011108
60th percentile: 9.912760686874389
70th percentile: 10.650060796737671
80th percentile: 11.03597640991211
90th percentile: 11.070507526397705
95th percentile: 11.087773084640503
99th percentile: 11.101585531234742
mean time: 8.548110628128052
%s, retrying in %s seconds...
Received healthy response to inference request in 16.367839813232422s
Received healthy response to inference request in 4.46981406211853s
Received healthy response to inference request in 11.210161685943604s
Received healthy response to inference request in 5.934669733047485s
Received healthy response to inference request in 5.488181829452515s
5 requests
0 failed requests
5th percentile: 4.673487615585327
10th percentile: 4.877161169052124
20th percentile: 5.284508275985718
30th percentile: 5.577479410171509
40th percentile: 5.756074571609497
50th percentile: 5.934669733047485
60th percentile: 8.044866514205932
70th percentile: 10.155063295364378
80th percentile: 12.241697311401367
90th percentile: 14.304768562316895
95th percentile: 15.336304187774658
99th percentile: 16.16153268814087
mean time: 8.694133424758911
%s, retrying in %s seconds...
Received healthy response to inference request in 7.028410196304321s
Received healthy response to inference request in 6.651986360549927s
Received healthy response to inference request in 6.85276985168457s
Received healthy response to inference request in 7.256841421127319s
Received healthy response to inference request in 3.7569963932037354s
5 requests
0 failed requests
5th percentile: 4.335994386672974
10th percentile: 4.914992380142212
20th percentile: 6.072988367080688
30th percentile: 6.692143058776855
40th percentile: 6.772456455230713
50th percentile: 6.85276985168457
60th percentile: 6.923025989532471
70th percentile: 6.993282127380371
80th percentile: 7.074096441268921
90th percentile: 7.16546893119812
95th percentile: 7.21115517616272
99th percentile: 7.2477041721344
mean time: 6.309400844573974
Pipeline stage StressChecker completed in 124.47s
Shutdown handler de-registered
function_pahuk_2024-12-01 status is now deployed due to DeploymentManager action