submission_id: function_bilet_2024-10-01
developer_uid: chai_backend_admin
celo_rating: 1262.63
display_name: retune_with_base
family_friendly_score: 0.5785902538969068
family_friendly_standard_error: 0.0025381582625689045
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 40406
num_wins: 20598
ranking_group: single
status: inactive
submission_type: function
timestamp: 2024-10-01T03:23:29+00:00
us_pacific_date: 2024-09-30
win_ratio: 0.5097757758748701
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.3762969970703125s
Received healthy response to inference request in 2.973071813583374s
Received healthy response to inference request in 3.337559223175049s
Received healthy response to inference request in 3.2705419063568115s
Received healthy response to inference request in 3.6315882205963135s
5 requests
0 failed requests
5th percentile: 3.0325658321380615
10th percentile: 3.092059850692749
20th percentile: 3.211047887802124
30th percentile: 3.283945369720459
40th percentile: 3.310752296447754
50th percentile: 3.337559223175049
60th percentile: 3.353054332733154
70th percentile: 3.36854944229126
80th percentile: 3.427355241775513
90th percentile: 3.529471731185913
95th percentile: 3.580529975891113
99th percentile: 3.6213765716552735
mean time: 3.317811632156372
Pipeline stage StressChecker completed in 18.46s
Shutdown handler de-registered
function_bilet_2024-10-01 status is now deployed due to DeploymentManager action
function_bilet_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_bilet_2024-10-01 status is now deployed due to admin request
function_bilet_2024-10-01 status is now inactive due to auto deactivation removed underperforming models