Functions — github.com/Lightning-AI/LitServe

CodeHub MCPcopy Create free account

hub / github.com/Lightning-AI/LitServe / functions

Functions984 in github.com/Lightning-AI/LitServe

⨍ Functions 984◇ Types & classes 226↳ Endpoints 30

Methodmock_manager

tests/unit/test_transport.py:98

Functionmock_shutdown

(manager, uvicorn_workers, shutdown_reason="normal")

tests/unit/test_failed_workers.py:33

Functionmock_transport

tests/unit/test_loops.py:66

Methodmock_transport

tests/unit/test_transport.py:126

src/litserve/server.py:1514

src/litserve/mcp.py:372

Functionno_auth

src/litserve/server.py:86

Functionoff_test_run_batched_streaming_loop

(openai_request_data)

tests/unit/test_loops.py:634

Methodon_after_decode_request

Called after request decoding is completed.

src/litserve/callbacks/base.py:34

Methodon_after_encode_response

Called after response encoding is completed.

src/litserve/callbacks/base.py:40

Methodon_after_predict

Called after prediction is completed.

src/litserve/callbacks/base.py:46

Methodon_after_predict

(self, lit_api: "LitAPI")

src/litserve/callbacks/defaults/metric_callback.py:14

Methodon_after_predict

(self, lit_api)

tests/unit/test_logger.py:124

Methodon_after_setup

Called after setup is completed.

src/litserve/callbacks/base.py:28

Methodon_before_decode_request

Called before request decoding is started.

src/litserve/callbacks/base.py:31

Methodon_before_encode_response

Called before response encoding is started.

src/litserve/callbacks/base.py:37

Methodon_before_predict

Called before prediction is started.

src/litserve/callbacks/base.py:43

Methodon_before_predict

(self, lit_api: "LitAPI")

src/litserve/callbacks/defaults/metric_callback.py:11

Methodon_before_setup

Called before setup is started.

src/litserve/callbacks/base.py:25

Methodon_request

Called when request enters the endpoint function.

src/litserve/callbacks/base.py:55

Methodon_request

(self, active_requests: int, **kwargs)

src/litserve/callbacks/defaults/metric_callback.py:20

Methodon_response

Called when response is generated from the worker and ready to return to the client.

src/litserve/callbacks/base.py:58

Methodon_schedule_task_error

(self, exception: Exception)

src/litserve/loops/continuous_batching_loop.py:284

Methodon_server_end

Called when server terminates.

src/litserve/callbacks/base.py:52

Methodon_server_start

Called before server starts.

src/litserve/callbacks/base.py:49

Functionopenai_embedding_request_data

tests/conftest.py:359

Functionopenai_embedding_request_data_array

tests/conftest.py:364

Functionopenai_request_data

tests/conftest.py:153

Functionopenai_request_data_with_audio_flac

(openai_request_data)

tests/conftest.py:242

Functionopenai_request_data_with_audio_wav

(openai_request_data)

tests/conftest.py:223

Functionopenai_request_data_with_image

tests/conftest.py:195

Functionopenai_request_data_with_metadata

tests/conftest.py:335

Functionopenai_request_data_with_response_format

tests/conftest.py:295

Functionopenai_request_data_with_tools

tests/conftest.py:261

Functionopenai_response_data

tests/conftest.py:170

Methodoptions_chat_completions

(self, request: Request)

src/litserve/specs/openai.py:497

Methodoptions_embeddings

(self, request: Request)

src/litserve/specs/openai_embedding.py:295

Methodpopulate_context

(self, context, request)

src/litserve/specs/openai.py:431

tests/conftest.py:399

Methodpre_setup

(self, lit_api: LitAPI, spec: Optional[LitSpec] = None)

src/litserve/loops/base.py:217

Methodpre_setup

Check if the lit_api has the necessary methods and if streaming is enabled.

src/litserve/loops/continuous_batching_loop.py:79

Methodpre_setup

(self, lit_api: "LitAPI")

src/litserve/specs/openai_embedding.py:132

Methodpre_setup

(self, lit_api: "LitAPI")

src/litserve/specs/base.py:44

Methodpre_setup

(self, lit_api: "LitAPI")

src/litserve/specs/openai.py:369

Functionpredict

(image_data: ImageData)

tests/parity_fastapi/fastapi-server.py:54

Run the model on the input and return or yield the output. When batching is enabled (max_batch_size > 1), this method receives a batc

src/litserve/api.py:270

src/litserve/test_examples/openai_embedding_spec_example.py:10

src/litserve/test_examples/openai_embedding_spec_example.py:19

src/litserve/test_examples/openai_embedding_spec_example.py:29

src/litserve/test_examples/simple_example.py:13

src/litserve/test_examples/simple_example.py:63

src/litserve/test_examples/simple_example.py:96

tests/conftest.py:50

tests/conftest.py:64

tests/conftest.py:85

tests/simple_server.py:27

tests/simple_server_diff_port.py:25

tests/integration/test_async.py:26

tests/parity_fastapi/ls-server.py:45

tests/unit/test_loops.py:248

tests/unit/test_litapi.py:34

tests/unit/test_simple.py:39

tests/unit/test_simple.py:255

tests/unit/test_simple.py:385

tests/unit/test_lit_server.py:156

(self, x, context)

tests/unit/test_lit_server.py:365

(self, x_batch, context)

tests/unit/test_lit_server.py:375

(self, x_batch, context)

tests/unit/test_lit_server.py:386

(self, x, y, context)

tests/unit/test_lit_server.py:397

tests/unit/test_lit_server.py:590

tests/unit/test_lit_server.py:612

tests/unit/test_lit_server.py:669

tests/unit/test_lit_server.py:698

tests/unit/test_lit_server.py:746

tests/unit/test_lit_server.py:808

tests/unit/test_failed_workers.py:19

tests/unit/test_form.py:29

tests/unit/test_form.py:81

tests/unit/test_compression.py:32

tests/unit/test_schema.py:34

tests/unit/test_auth.py:31

tests/unit/test_torch.py:44

tests/unit/test_specs.py:39

tests/unit/test_specs.py:46

tests/unit/test_specs.py:124

(self, request)

tests/unit/test_specs.py:267

tests/unit/test_specs.py:335

tests/unit/test_specs.py:340

(self, prompt, context)

tests/unit/test_specs.py:360

tests/unit/test_specs.py:386

tests/unit/test_specs.py:411

tests/unit/test_specs.py:424

tests/unit/test_specs.py:450

tests/unit/test_specs.py:465

tests/unit/test_logger.py:160

tests/unit/test_multiple_endpoints.py:20

tests/unit/test_callbacks.py:30

tests/unit/test_batch.py:62

tests/unit/test_batch.py:275

tests/unit/test_pydantic.py:36

← previous next →501–600 of 984, ranked by callers