Methodinit(self, dist_init_addr, port, nccl_port, host=None, disaggregation_bootstrap_port=None)
slime/slime/backends/sglang_utils/sglang_engine.py:133
Methodinit_weights_update_group(self, master_address, master_port, rank_offset, world_size, group_name, backend)
slime/slime/backends/sglang_utils/sglang_engine.py:374
Functioninitialize_moe_model(
pre_process=True,
post_process=True,
seed=0,
use_glu=True,
use_sp=False,
use_te=Fals
Megatron-LM/tests/unit_tests/dist_checkpointing/utils.py:57
Functioninitialize_real_model(
seed,
pre_process,
post_process,
vp_stage=None,
is_moe=False,
is_mla=False,
virt
Megatron-LM/tests/unit_tests/dist_checkpointing/test_layer_wise_optimizer.py:55
Functioninitialize_real_model(
seed,
pre_process,
post_process,
vp_stage=None,
is_moe=False,
is_mla=False,
virt
Megatron-LM/tests/unit_tests/dist_checkpointing/test_optimizer.py:269