File continuous_batching.py

examples/pytorch/continuous_batching.py:None–None · view source on GitHub ↗

Source from the content-addressed store, hash-verified

1	# Copyright 2025 The HuggingFace Inc. team
2	#
3	# Licensed under the Apache License, Version 2.0 (the "License");
4	# you may not use this file except in compliance with the License.

nothing calls this directly

GenerationConfigClass · 0.90

ContinuousBatchingConfigClass · 0.90

generate_without_cbFunction · 0.85

batch_generateFunction · 0.85

evalMethod · 0.80

setLevelMethod · 0.80

warningMethod · 0.80

from_pretrainedMethod · 0.45

cudaMethod · 0.45

apply_chat_templateMethod · 0.45

no test coverage detected