developer_uid: rirv938
submission_id: function_ritab_2025-01-30
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2025-01-30T22:46:23+00:00
num_battles: 5472
num_wins: 2895
celo_rating: 1288.58
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-01-30
win_ratio: 0.5290570175438597
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.1742687225341797s
Received healthy response to inference request in 3.125138282775879s
Received healthy response to inference request in 2.60701584815979s
Received healthy response to inference request in 2.104496479034424s
Received healthy response to inference request in 2.156825304031372s
5 requests
0 failed requests
5th percentile: 2.1149622440338134
10th percentile: 2.125428009033203
20th percentile: 2.1463595390319825
30th percentile: 2.1603139877319335
40th percentile: 2.167291355133057
50th percentile: 2.1742687225341797
60th percentile: 2.3473675727844237
70th percentile: 2.520466423034668
80th percentile: 2.7106403350830077
90th percentile: 2.9178893089294435
95th percentile: 3.021513795852661
99th percentile: 3.1044133853912355
mean time: 2.433548927307129
Pipeline stage StressChecker completed in 13.20s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.62s
Shutdown handler de-registered
function_ritab_2025-01-30 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
clean up pipeline due to error=DeploymentChecksError("[Errno 2] No such file or directory: '/tmp/prometheus/histogram_60.db'")
Shutdown handler de-registered
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
clean up pipeline due to error=DeploymentChecksError("[Errno 2] No such file or directory: '/tmp/prometheus/histogram_60.db'")
Shutdown handler de-registered
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
clean up pipeline due to error=DeploymentChecksError("[Errno 2] No such file or directory: '/tmp/prometheus/histogram_60.db'")
Shutdown handler de-registered
function_ritab_2025-01-30 status is now inactive due to auto deactivation removed underperforming models
function_ritab_2025-01-30 status is now torndown due to DeploymentManager action
ChatRequest
Generation Params
Prompt Formatter
Chat History
ChatMessage 1