MCPcopy Index your code

hub / github.com/Lightning-AI/LitServe / types & classes

Types & classes226 in github.com/Lightning-AI/LitServe

↓ 68 callersClassLitServer
Initialize a LitServer for high-performance AI model serving. LitServer transforms AI models into production-ready APIs with automatic scaling,
src/litserve/server.py:405
↓ 23 callersClassOpenAISpec
src/litserve/specs/openai.py:358
↓ 10 callersClassOpenAIEmbeddingSpec
src/litserve/specs/openai_embedding.py:127
↓ 8 callersClassChatMessage
src/litserve/specs/openai.py:148
↓ 7 callersClassSimpleBatchLitAPI
tests/unit/test_batch.py:49
↓ 7 callersClassSingleLoop
src/litserve/loops/simple_loops.py:32
↓ 7 callersClassStreamingLoop
src/litserve/loops/streaming_loops.py:32
↓ 7 callersClassTestAPI
src/litserve/test_examples/openai_spec_example.py:20
↓ 6 callersClassInferencePipeline
tests/unit/test_multiple_endpoints.py:9
↓ 6 callersClassMCP
Enable Model Context Protocol (MCP) integration for LitServe APIs. This enables LitServe APIs to be seamlessly integrated into MCP-compatible AI
src/litserve/mcp.py:265
↓ 6 callersClassTestEmbedAPI
src/litserve/test_examples/openai_embedding_spec_example.py:6
↓ 5 callersClassCallbackRunner
src/litserve/callbacks/base.py:64
↓ 5 callersClassProducer
Producer class for sending messages to consumers.
src/litserve/transport/zmq_queue.py:83
↓ 5 callersClassResponseBufferItem
src/litserve/utils.py:353
↓ 5 callersClassSimpleLitAPI
tests/unit/test_lit_server.py:147
↓ 5 callersClass_LoggerConnector
_LoggerConnector is responsible for connecting Logger instances with the LitServer and managing their lifecycle. This class handles the following
src/litserve/loggers.py:86
↓ 4 callersClassBatchedLoop
src/litserve/loops/simple_loops.py:311
↓ 4 callersClassMockMPQueueTransport
tests/unit/test_loops.py:58
↓ 4 callersClassOutput
Outputs from a single step of the loop.
src/litserve/loops/continuous_batching_loop.py:48
↓ 4 callersClassRequestTracker
src/litserve/callbacks/defaults/metric_callback.py:19
↓ 4 callersClass_Connector
src/litserve/connector.py:22
↓ 3 callersClassAsyncConsumer
Async consumer class for receiving messages using asyncio.
src/litserve/transport/zmq_queue.py:164
↓ 3 callersClassBatchedStreamingLoop
src/litserve/loops/streaming_loops.py:297
↓ 3 callersClassBroker
Message broker that routes messages between producers and consumers.
src/litserve/transport/zmq_queue.py:31
↓ 3 callersClassMCPLitAPI
tests/unit/test_mcp.py:210
↓ 3 callersClassMPQueueTransport
src/litserve/transport/process_transport.py:9
↓ 3 callersClassPredictionTimeLogger
src/litserve/callbacks/defaults/metric_callback.py:10
↓ 3 callersClassSlowBatchAPI
tests/unit/test_simple.py:263
↓ 3 callersClassSlowLitAPI
tests/unit/test_simple.py:248
↓ 3 callersClassTestLogger
tests/unit/test_logger.py:26
↓ 3 callersClassTestLoop
tests/unit/test_loops.py:672
↓ 3 callersClass_LitMCPServerConnector
Connects LitServer to MCP server. It creates HTTP streamable MCP server with Starlette and mounts to the FastAPI app.
src/litserve/mcp.py:484
↓ 2 callersClassAsyncTestStreamLitAPI
tests/unit/test_loops.py:241
↓ 2 callersClassChatCompletionChunk
src/litserve/specs/openai.py:209
↓ 2 callersClassChatCompletionStreamingChoice
src/litserve/specs/openai.py:202
↓ 2 callersClassChoiceDelta
src/litserve/specs/openai.py:162
↓ 2 callersClassFileLogger
tests/unit/test_logger.py:94
↓ 2 callersClassIncorrectAsyncAPI
tests/unit/test_specs.py:404
↓ 2 callersClassLinear
tests/unit/test_batch.py:38
↓ 2 callersClassLoggerAPI
tests/unit/test_logger.py:77
↓ 2 callersClassMetadataRequiredAPI
tests/unit/test_specs.py:260
↓ 2 callersClassMockRequest
Mock FastAPI Request object for testing.
tests/unit/test_request_handlers.py:47
↓ 2 callersClassMockServer
tests/unit/test_request_handlers.py:33
↓ 2 callersClassOpenAIBatchContext
src/litserve/test_examples/openai_spec_example.py:56
↓ 2 callersClassOpenAIBatchingWithUsage
src/litserve/test_examples/openai_spec_example.py:133
↓ 2 callersClassRegularRequestHandler
src/litserve/server.py:316
↓ 2 callersClassSimpleAuthedLitAPI
tests/unit/test_auth.py:24
↓ 2 callersClassSimpleBatchedAPI
src/litserve/test_examples/simple_example.py:22
↓ 2 callersClassSimpleFileLitAPI
tests/unit/test_form.py:22
↓ 2 callersClassSimpleLitAPI
tests/unit/test_simple.py:32
↓ 2 callersClassSimpleLitAPI
tests/unit/test_auth.py:58
↓ 2 callersClassSimpleLitAPI
tests/unit/test_torch.py:35
↓ 2 callersClassSimpleTorchAPI
tests/unit/test_batch.py:74
↓ 2 callersClassSlowSetupLitAPI
tests/unit/test_simple.py:52
↓ 2 callersClassTestAPIWithStructuredOutput
src/litserve/test_examples/openai_spec_example.py:48
↓ 2 callersClassTestDefaultBatchedAPI
tests/unit/test_litapi.py:27
↓ 2 callersClassTestLitAPI
tests/unit/test_loops.py:738
↓ 2 callersClassTestOpenAIWithBatching
tests/unit/test_openai_embedding.py:157
↓ 2 callersClassTestQueue
tests/unit/test_loops.py:82
↓ 2 callersClassTransportConfig
src/litserve/transport/factory.py:11
↓ 2 callersClassUsageInfo
src/litserve/specs/openai.py:46
↓ 2 callersClass_StopLoopError
src/litserve/loops/base.py:93
↓ 1 callersClassAsyncAPI
tests/e2e/default_async_streaming.py:17
↓ 1 callersClassAsyncHealthLitAPI
tests/unit/test_simple.py:152
↓ 1 callersClassAsyncOpenAILitAPI
tests/unit/test_specs.py:457
↓ 1 callersClassAsyncTestLitAPI
tests/unit/test_loops.py:98
↓ 1 callersClassBatchSizeMismatchAPI
tests/unit/test_batch.py:274
↓ 1 callersClassChatCompletionRequest
src/litserve/specs/openai.py:167
↓ 1 callersClassChatCompletionResponse
src/litserve/specs/openai.py:193
↓ 1 callersClassChatCompletionResponseChoice
src/litserve/specs/openai.py:187
↓ 1 callersClassContinuousBatchingAPI
tests/unit/test_loops.py:874
↓ 1 callersClassContinuousBatchingLoop
src/litserve/loops/continuous_batching_loop.py:56
↓ 1 callersClassCrashingLitAPI
API that crashes after 2 predictions to simulate worker failure.
tests/unit/test_failed_workers.py:9
↓ 1 callersClassCustomError
tests/unit/test_simple.py:379
↓ 1 callersClassCustomSpecAPI
tests/unit/test_litapi.py:185
↓ 1 callersClassDefaultLoop
src/litserve/loops/base.py:378
↓ 1 callersClassDummyMessageTransport
tests/unit/test_loops.py:123
↓ 1 callersClassEmbedding
src/litserve/specs/openai_embedding.py:60
↓ 1 callersClassEmbeddingResponse
src/litserve/specs/openai_embedding.py:71
↓ 1 callersClassEmbeddingsAPI
tests/e2e/openai_embedding_with_batching.py:6
↓ 1 callersClassExceptionAPI
tests/unit/test_simple.py:384
↓ 1 callersClassFailFastAPI
tests/unit/test_lit_server.py:562
↓ 1 callersClassFailingLitAPI
tests/unit/test_lit_server.py:738
↓ 1 callersClassFailingLitAPIStreaming
tests/unit/test_lit_server.py:800
↓ 1 callersClassFakeBatchStreamTransport
tests/unit/test_loops.py:308
↓ 1 callersClassFakeStreamSender
tests/unit/test_loops.py:186
↓ 1 callersClassFakeTransport
tests/unit/test_batch.py:197
↓ 1 callersClassForkedPdb
PDB Subclass for debugging multi-processed code Suggested in: https://stackoverflow.com/questions/4716533/how-to-attach-debugger-to-a-python-
src/litserve/utils.py:224
↓ 1 callersClassHeavyInitAPI
tests/unit/test_litapi.py:287
↓ 1 callersClassHeavyInitAPIWithSetup
tests/unit/test_litapi.py:293
↓ 1 callersClassHeavySetupAPI
tests/unit/test_litapi.py:298
↓ 1 callersClassHuggingFaceLitAPI
tests/perf_test/bert/server.py:17
↓ 1 callersClassIdentityAPI
tests/unit/test_lit_server.py:364
↓ 1 callersClassIdentityBatchedAPI
tests/unit/test_lit_server.py:374
↓ 1 callersClassIdentityBatchedStreamingAPI
tests/unit/test_lit_server.py:385
↓ 1 callersClassImageAPI
tests/unit/test_schema.py:27
↓ 1 callersClassImageClassifierAPI
tests/parity_fastapi/fastapi-server.py:22
↓ 1 callersClassImageClassifierAPI
tests/parity_fastapi/ls-server.py:25
↓ 1 callersClassImageOutput
src/litserve/schema/image.py:44
↓ 1 callersClassIncorrectAPI1
tests/unit/test_specs.py:331
next →1–100 of 226, ranked by callers