developer_uid: rirv938
submission_id: function_nilun_2025-02-27
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2025-02-27T21:04:20+00:00
num_battles: 7653
num_wins: 3994
celo_rating: 1298.68
family_friendly_score: 0.5372
family_friendly_standard_error: 0.007051470201312631
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-02-27
win_ratio: 0.5218868417614008
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.8221328258514404s
Received healthy response to inference request in 3.4454715251922607s
Received healthy response to inference request in 3.1677472591400146s
Received healthy response to inference request in 4.885442495346069s
Received healthy response to inference request in 3.2753825187683105s
5 requests
0 failed requests
5th percentile: 3.189274311065674
10th percentile: 3.210801362991333
20th percentile: 3.2538554668426514
30th percentile: 3.3094003200531006
40th percentile: 3.3774359226226807
50th percentile: 3.4454715251922607
60th percentile: 3.596136045455933
70th percentile: 3.7468005657196044
80th percentile: 4.034794759750366
90th percentile: 4.460118627548217
95th percentile: 4.672780561447143
99th percentile: 4.842910108566284
mean time: 3.719235324859619
%s, retrying in %s seconds...
Received healthy response to inference request in 4.621540784835815s
Received healthy response to inference request in 3.255581855773926s
Received healthy response to inference request in 5.431898355484009s
Received healthy response to inference request in 2.7777442932128906s
Received healthy response to inference request in 3.086552381515503s
5 requests
0 failed requests
5th percentile: 2.839505910873413
10th percentile: 2.9012675285339355
20th percentile: 3.0247907638549805
30th percentile: 3.1203582763671873
40th percentile: 3.1879700660705566
50th percentile: 3.255581855773926
60th percentile: 3.8019654273986814
70th percentile: 4.348348999023437
80th percentile: 4.783612298965454
90th percentile: 5.107755327224732
95th percentile: 5.26982684135437
99th percentile: 5.399484052658081
mean time: 3.8346635341644286
%s, retrying in %s seconds...
Received healthy response to inference request in 3.4868946075439453s
Received healthy response to inference request in 3.2895359992980957s
Received healthy response to inference request in 3.376030445098877s
Received healthy response to inference request in 4.018784999847412s
Received healthy response to inference request in 2.945714235305786s
5 requests
0 failed requests
5th percentile: 3.014478588104248
10th percentile: 3.08324294090271
20th percentile: 3.220771646499634
30th percentile: 3.306834888458252
40th percentile: 3.3414326667785645
50th percentile: 3.376030445098877
60th percentile: 3.420376110076904
70th percentile: 3.4647217750549317
80th percentile: 3.5932726860046387
90th percentile: 3.8060288429260254
95th percentile: 3.9124069213867188
99th percentile: 3.9975093841552733
mean time: 3.4233920574188232
Pipeline stage StressChecker completed in 58.71s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.63s
Shutdown handler de-registered
function_nilun_2025-02-27 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3007.52s
Shutdown handler de-registered
function_nilun_2025-02-27 status is now inactive due to auto deactivation removed underperforming models
function_nilun_2025-02-27 status is now torndown due to DeploymentManager action
ChatRequest
Generation Params
Prompt Formatter
Chat History
ChatMessage 1