Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/OpenPipe/ART
/ functions
Functions
1,502 in github.com/OpenPipe/ART
⨍
Functions
1,502
◇
Types & classes
261
↳
Endpoints
14
Function
test_get_model_config_dedicated_preserves_user_engine_args
()
tests/unit/test_dedicated_config.py:163
Function
test_get_model_config_shared_mode
()
tests/unit/test_dedicated_config.py:137
Function
test_get_renderer_name_autodetects_qwen3_5
()
tests/unit/test_tinker_renderers.py:65
Function
test_get_renderer_supports_kimi_k25_factory
()
tests/unit/test_tinker_renderers.py:191
Method
test_get_wandb_run_registers_taxonomy_sections
(self, tmp_path: Path)
tests/unit/test_metric_routing.py:43
Method
test_group_level_fields_round_trip
Group-level metadata/metrics/logs should survive round-trip.
tests/unit/test_trajectory_parquet.py:182
Method
test_group_metric_aggregation
Verify group-level metrics are aggregated once per group.
tests/unit/test_frontend_logging.py:398
Method
test_helper_metrics_accumulate_within_a_single_step
(self)
tests/unit/test_metrics_builder.py:61
Method
test_history_appends_entries
Verify multiple log calls append to history.jsonl.
tests/unit/test_frontend_logging.py:212
Method
test_history_jsonl_format
Verify history.jsonl has correct format for downstream readers.
tests/unit/test_frontend_logging.py:166
Method
test_history_readable_by_polars
Verify history.jsonl is readable by pl.read_ndjson (used by delete_checkpoints).
tests/unit/test_frontend_logging.py:191
Method
test_invalid_json
Test handling of invalid JSON.
tests/unit/test_trajectory_parquet.py:742
Method
test_invalid_size
(self)
tests/unit/test_prefix_cache.py:34
Method
test_invalid_step_suffix_fails_loudly
Non-numeric step suffix should fail with a helpful message.
tests/unit/test_multi_checkpoint_inference.py:282
Function
test_iterate_file
Test iterate_file reads trajectories correctly.
tests/unit/test_sft.py:32
Function
test_iterate_file_deterministic
Test that iterate_file is deterministic with same seed.
tests/unit/test_sft.py:73
Function
test_iterate_file_multiple_epochs
Test iterate_file with multiple epochs.
tests/unit/test_sft.py:45
Function
test_iterate_file_with_initial_skip
Test iterate_file with initial_skip for resuming.
tests/unit/test_sft.py:59
Function
test_kl_advantage_direction
Tokens with higher KL (more drift) should get reduced advantages.
src/art/test/test_kl_advantage.py:85
Function
test_kl_advantage_does_not_affect_when_no_ref
When ref_logprobs is None, kl_penalty_coef should have no effect.
src/art/test/test_kl_advantage.py:110
Function
test_kl_advantage_enabled
When kl_penalty_coef>0 and ref_logprobs provided, kl_policy_ref should be set.
src/art/test/test_kl_advantage.py:51
Function
test_kl_advantage_no_effect_when_disabled
When kl_penalty_coef=0, advantages should not be modified.
src/art/test/test_kl_advantage.py:36
Function
test_kl_advantage_zero_mean_penalty
The KL penalty should be zero-mean across assistant tokens.
src/art/test/test_kl_advantage.py:63
Method
test_leaf_parent_conflicts_raise
(self)
tests/unit/test_metrics_builder.py:113
Function
test_litellm_auto_trajectory
(test_server: None)
tests/unit/test_auto_trajectory.py:324
Method
test_litellm_completion_params_trainable_model_with_step
Trainable model with step should have hosted_vllm/ prefix and @step suffix.
tests/unit/test_multi_checkpoint_inference.py:109
Method
test_litellm_completion_params_with_step
With step, should append @step suffix to model name.
tests/unit/test_multi_checkpoint_inference.py:97
Method
test_litellm_completion_params_without_step
Without step, should use latest checkpoint name.
tests/unit/test_multi_checkpoint_inference.py:83
Function
test_load_trajectories_group_columns
(tmp_path)
tests/unit/test_benchmarking_loader.py:9
Method
test_loaded_state_is_shared_with_other_cost_contexts
(self)
tests/unit/test_metrics_builder.py:172
Function
test_local_backend
Test multi-checkpoint inference with LocalBackend (UnslothService).
tests/integration/test_multi_checkpoint_training.py:145
Method
test_local_backend_train_returns_gradient_step_count
( self, tmp_path: Path )
tests/unit/test_frontend_logging.py:1203
Function
test_local_backend_vllm_contract
()
tests/integration/test_vllm_contract.py:108
Method
test_log_metrics_defines_nested_cost_keys_with_training_step
( self, tmp_path: Path )
tests/unit/test_metric_routing.py:80
Method
test_log_metrics_routes_known_sections_without_split_prefix
( self, tmp_path: Path )
tests/unit/test_metric_routing.py:13
Method
test_log_without_new_builder_metrics_skips_extra_taxonomy_row
( self, tmp_path: Path )
tests/unit/test_frontend_logging.py:767
Method
test_long_content_compresses_well
Test that long repeated content (like system prompts) compresses well.
tests/unit/test_trajectory_parquet.py:699
Method
test_longest_prefix_match
(self)
tests/unit/test_prefix_cache.py:11
Method
test_lora_name_includes_step
LoRA module name should include @step suffix.
tests/unit/test_multi_checkpoint_inference.py:201
Method
test_lora_name_step_zero
LoRA module name should work with step 0.
tests/unit/test_multi_checkpoint_inference.py:217
Function
test_lr_schedule_decay_methods
Test that cosine and linear decay work correctly.
tests/unit/test_sft.py:125
Function
test_lr_schedule_edge_cases
Test LR schedule edge cases.
tests/unit/test_sft.py:107
Function
test_lr_schedule_no_warmup
Test schedule with warmup_steps=0.
tests/unit/test_sft.py:148
Function
test_lr_schedule_warmup_not_zero
Test that warmup doesn't start at lr=0.
tests/unit/test_sft.py:89
Method
test_lru_eviction
(self)
tests/unit/test_prefix_cache.py:22
Method
test_max_loras_can_be_overridden
max_loras should be configurable via engine_args.
tests/unit/test_multi_checkpoint_inference.py:331
Method
test_max_loras_default_is_2
UnslothService should default to max_loras=2 (one for training, one for validation).
tests/unit/test_multi_checkpoint_inference.py:309
Method
test_metric_prefixes
Verify metrics are prefixed with split name.
tests/unit/test_frontend_logging.py:312
Method
test_metrics_builder_loads_resume_state_before_builder_use
( self, tmp_path: Path )
tests/unit/test_frontend_logging.py:707
Method
test_migrate_directory
Test migrating an entire directory.
tests/unit/test_trajectory_parquet.py:526
Method
test_migrate_dry_run
Test dry run mode doesn't modify files.
tests/unit/test_trajectory_parquet.py:515
Method
test_migrate_idempotent
Test that running migration twice is safe.
tests/unit/test_trajectory_parquet.py:608
Method
test_migrate_keeps_original_when_requested
Test that delete_original=False preserves the JSONL file.
tests/unit/test_trajectory_parquet.py:505
Method
test_migrate_model_dir
Test migrating a model directory.
tests/unit/test_trajectory_parquet.py:579
Method
test_migrate_simple_jsonl
Test migrating a simple JSONL file.
tests/unit/test_trajectory_parquet.py:456
Method
test_missing_step_suffix_fails_loudly
Unsuffixed model names should fail with a helpful message.
tests/unit/test_multi_checkpoint_inference.py:274
Method
test_model_inference_name_none_step_is_same_as_no_step
Explicitly passing step=None should behave same as no step.
tests/unit/test_multi_checkpoint_inference.py:174
Method
test_model_inference_name_with_step
With step, should append :step{N} suffix.
tests/unit/test_multi_checkpoint_inference.py:154
Method
test_model_inference_name_without_step
Without step, should return base W&B artifact name.
tests/unit/test_multi_checkpoint_inference.py:136
Method
test_model_log_emits_train_and_eval_costs
(self, tmp_path: Path)
tests/unit/test_track_api_cost.py:459
Method
test_model_log_keeps_pending_train_and_eval_costs_isolated
( self, tmp_path: Path )
tests/unit/test_track_api_cost.py:519
Method
test_model_train_logs_gradient_step_count
(self, tmp_path: Path)
tests/unit/test_frontend_logging.py:1157
Function
test_multi_gpu_inference
()
tests/unit/test_dedicated_config.py:79
Method
test_multiple_groups_preserved
Test that multiple trajectory groups are preserved separately.
tests/unit/test_trajectory_parquet.py:336
Method
test_multiple_trajectories
Test multiple trajectories within a single group.
tests/unit/test_trajectory_parquet.py:302
Method
test_no_logprobs_unchanged
Test that structures without logprobs remain unchanged.
tests/unit/test_strip_logprobs.py:123
Method
test_non_jsonl_file_skipped
Test that non-JSONL files are skipped.
tests/unit/test_trajectory_parquet.py:762
Method
test_nonexistent_file
Test handling of nonexistent file.
tests/unit/test_trajectory_parquet.py:736
Function
test_notebook_execution
(notebook_config: dict)
tests/integration.py:176
Method
test_nullable_fields
Test trajectories with null/empty fields.
tests/unit/test_trajectory_parquet.py:424
Function
test_only_inference_gpu_ids
()
tests/unit/test_dedicated_config.py:53
Function
test_only_trainer_gpu_ids
()
tests/unit/test_dedicated_config.py:48
Method
test_openai_cost_extraction_accounts_for_cached_tokens
(self)
tests/unit/test_track_api_cost.py:131
Method
test_openai_cost_extraction_with_explicit_pricing
(self)
tests/unit/test_track_api_cost.py:108
Method
test_openai_gpt_4_1_cached_prompt_cost
(self, tmp_path: Path)
tests/integration/test_live_api_cost.py:92
Function
test_overlapping_gpu_ids
()
tests/unit/test_dedicated_config.py:72
Method
test_parquet_readable_by_read_trajectory_groups_parquet
Direct parquet reader compatibility.
tests/unit/test_frontend_logging.py:72
Method
test_parquet_schema_preserved
Verify parquet schema contains expected fields.
tests/unit/test_frontend_logging.py:98
Function
test_parse_args_custom_host
()
tests/unit/test_dedicated_server.py:56
Function
test_parse_args_required
()
tests/unit/test_dedicated_server.py:11
Function
test_parse_args_with_engine_args
()
tests/unit/test_dedicated_server.py:36
Function
test_parse_args_with_server_args
()
tests/unit/test_dedicated_server.py:76
Method
test_parse_step_from_model_name
Valid `model@step` names should parse correctly.
tests/unit/test_multi_checkpoint_inference.py:267
Function
test_patch_tool_parser_manager_falls_back_to_empty_delta_message
()
tests/unit/test_vllm_patches_contract.py:32
Method
test_pipeline_trainer_activates_eval_context_for_eval_fn
( self, tmp_path: Path )
tests/unit/test_track_api_cost.py:633
Method
test_pipeline_trainer_activates_train_context_for_rollouts
( self, tmp_path: Path )
tests/unit/test_track_api_cost.py:584
Function
test_pipeline_trainer_logs_explicit_stale_and_zero_variance_metrics
( tmp_path: Path, )
tests/unit/test_pipeline_trainer_metrics.py:32
Method
test_pipelined_training_pattern
Verify the API supports the pipelined training pattern from RFC #513. The pattern is: 1. Rollout uses latest checkpoint: mod
tests/unit/test_multi_checkpoint_inference.py:359
Function
test_proxy_supports_sync_async_and_attribute_access
()
tests/unit/test_mp_actors.py:61
Function
test_push_then_fork_from_s3
Train model A, push to S3, fork from S3 into model B, then train model B.
tests/integration/test_push_and_fork.py:200
Function
test_push_to_s3
Train a model, then push its checkpoints to S3.
tests/integration/test_push_and_fork.py:82
Function
test_qwen3_5_generation_prompt_matches_hf_suffixes
()
tests/unit/test_tinker_renderers.py:69
Function
test_qwen3_5_parse_response_handles_xml_tool_calls
()
tests/unit/test_tinker_renderers.py:92
Function
test_qwen3_5_to_openai_message_uses_mapping_tool_arguments
()
tests/unit/test_tinker_renderers.py:127
Method
test_real_sample_migration
Test migrating a real trajectory file.
tests/unit/test_trajectory_parquet.py:632
Method
test_report_metrics_custom
Verify report_metrics can be customized.
tests/unit/test_frontend_logging.py:1007
Method
test_report_metrics_default
Verify report_metrics defaults to None.
tests/unit/test_frontend_logging.py:1002
Method
test_rollup_correctness_across_depths
(self)
tests/unit/test_metrics_builder.py:10
Function
test_ruler_records_builder_cost_for_supported_judges
(monkeypatch)
tests/unit/test_ruler_metrics.py:65
Function
test_ruler_records_direct_cost_for_openrouter_judges
(monkeypatch)
tests/unit/test_ruler_metrics.py:145
← previous
next →
1,301–1,400 of 1,502, ranked by callers