Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Index your code
hub
/
github.com/Lightning-AI/LitServe
/ types & classes
Types & classes
226 in github.com/Lightning-AI/LitServe
⨍
Functions
984
◇
Types & classes
226
↳
Endpoints
30
↓ 68 callers
Class
LitServer
Initialize a LitServer for high-performance AI model serving. LitServer transforms AI models into production-ready APIs with automatic scaling,
src/litserve/server.py:405
↓ 23 callers
Class
OpenAISpec
src/litserve/specs/openai.py:358
↓ 10 callers
Class
OpenAIEmbeddingSpec
src/litserve/specs/openai_embedding.py:127
↓ 8 callers
Class
ChatMessage
src/litserve/specs/openai.py:148
↓ 7 callers
Class
SimpleBatchLitAPI
tests/unit/test_batch.py:49
↓ 7 callers
Class
SingleLoop
src/litserve/loops/simple_loops.py:32
↓ 7 callers
Class
StreamingLoop
src/litserve/loops/streaming_loops.py:32
↓ 7 callers
Class
TestAPI
src/litserve/test_examples/openai_spec_example.py:20
↓ 6 callers
Class
InferencePipeline
tests/unit/test_multiple_endpoints.py:9
↓ 6 callers
Class
MCP
Enable Model Context Protocol (MCP) integration for LitServe APIs. This enables LitServe APIs to be seamlessly integrated into MCP-compatible AI
src/litserve/mcp.py:265
↓ 6 callers
Class
TestEmbedAPI
src/litserve/test_examples/openai_embedding_spec_example.py:6
↓ 5 callers
Class
CallbackRunner
src/litserve/callbacks/base.py:64
↓ 5 callers
Class
Producer
Producer class for sending messages to consumers.
src/litserve/transport/zmq_queue.py:83
↓ 5 callers
Class
ResponseBufferItem
src/litserve/utils.py:353
↓ 5 callers
Class
SimpleLitAPI
tests/unit/test_lit_server.py:147
↓ 5 callers
Class
_LoggerConnector
_LoggerConnector is responsible for connecting Logger instances with the LitServer and managing their lifecycle. This class handles the following
src/litserve/loggers.py:86
↓ 4 callers
Class
BatchedLoop
src/litserve/loops/simple_loops.py:311
↓ 4 callers
Class
MockMPQueueTransport
tests/unit/test_loops.py:58
↓ 4 callers
Class
Output
Outputs from a single step of the loop.
src/litserve/loops/continuous_batching_loop.py:48
↓ 4 callers
Class
RequestTracker
src/litserve/callbacks/defaults/metric_callback.py:19
↓ 4 callers
Class
_Connector
src/litserve/connector.py:22
↓ 3 callers
Class
AsyncConsumer
Async consumer class for receiving messages using asyncio.
src/litserve/transport/zmq_queue.py:164
↓ 3 callers
Class
BatchedStreamingLoop
src/litserve/loops/streaming_loops.py:297
↓ 3 callers
Class
Broker
Message broker that routes messages between producers and consumers.
src/litserve/transport/zmq_queue.py:31
↓ 3 callers
Class
MCPLitAPI
tests/unit/test_mcp.py:210
↓ 3 callers
Class
MPQueueTransport
src/litserve/transport/process_transport.py:9
↓ 3 callers
Class
PredictionTimeLogger
src/litserve/callbacks/defaults/metric_callback.py:10
↓ 3 callers
Class
SlowBatchAPI
tests/unit/test_simple.py:263
↓ 3 callers
Class
SlowLitAPI
tests/unit/test_simple.py:248
↓ 3 callers
Class
TestLogger
tests/unit/test_logger.py:26
↓ 3 callers
Class
TestLoop
tests/unit/test_loops.py:672
↓ 3 callers
Class
_LitMCPServerConnector
Connects LitServer to MCP server. It creates HTTP streamable MCP server with Starlette and mounts to the FastAPI app.
src/litserve/mcp.py:484
↓ 2 callers
Class
AsyncTestStreamLitAPI
tests/unit/test_loops.py:241
↓ 2 callers
Class
ChatCompletionChunk
src/litserve/specs/openai.py:209
↓ 2 callers
Class
ChatCompletionStreamingChoice
src/litserve/specs/openai.py:202
↓ 2 callers
Class
ChoiceDelta
src/litserve/specs/openai.py:162
↓ 2 callers
Class
FileLogger
tests/unit/test_logger.py:94
↓ 2 callers
Class
IncorrectAsyncAPI
tests/unit/test_specs.py:404
↓ 2 callers
Class
Linear
tests/unit/test_batch.py:38
↓ 2 callers
Class
LoggerAPI
tests/unit/test_logger.py:77
↓ 2 callers
Class
MetadataRequiredAPI
tests/unit/test_specs.py:260
↓ 2 callers
Class
MockRequest
Mock FastAPI Request object for testing.
tests/unit/test_request_handlers.py:47
↓ 2 callers
Class
MockServer
tests/unit/test_request_handlers.py:33
↓ 2 callers
Class
OpenAIBatchContext
src/litserve/test_examples/openai_spec_example.py:56
↓ 2 callers
Class
OpenAIBatchingWithUsage
src/litserve/test_examples/openai_spec_example.py:133
↓ 2 callers
Class
RegularRequestHandler
src/litserve/server.py:316
↓ 2 callers
Class
SimpleAuthedLitAPI
tests/unit/test_auth.py:24
↓ 2 callers
Class
SimpleBatchedAPI
src/litserve/test_examples/simple_example.py:22
↓ 2 callers
Class
SimpleFileLitAPI
tests/unit/test_form.py:22
↓ 2 callers
Class
SimpleLitAPI
tests/unit/test_simple.py:32
↓ 2 callers
Class
SimpleLitAPI
tests/unit/test_auth.py:58
↓ 2 callers
Class
SimpleLitAPI
tests/unit/test_torch.py:35
↓ 2 callers
Class
SimpleTorchAPI
tests/unit/test_batch.py:74
↓ 2 callers
Class
SlowSetupLitAPI
tests/unit/test_simple.py:52
↓ 2 callers
Class
TestAPIWithStructuredOutput
src/litserve/test_examples/openai_spec_example.py:48
↓ 2 callers
Class
TestDefaultBatchedAPI
tests/unit/test_litapi.py:27
↓ 2 callers
Class
TestLitAPI
tests/unit/test_loops.py:738
↓ 2 callers
Class
TestOpenAIWithBatching
tests/unit/test_openai_embedding.py:157
↓ 2 callers
Class
TestQueue
tests/unit/test_loops.py:82
↓ 2 callers
Class
TransportConfig
src/litserve/transport/factory.py:11
↓ 2 callers
Class
UsageInfo
src/litserve/specs/openai.py:46
↓ 2 callers
Class
_StopLoopError
src/litserve/loops/base.py:93
↓ 1 callers
Class
AsyncAPI
tests/e2e/default_async_streaming.py:17
↓ 1 callers
Class
AsyncHealthLitAPI
tests/unit/test_simple.py:152
↓ 1 callers
Class
AsyncOpenAILitAPI
tests/unit/test_specs.py:457
↓ 1 callers
Class
AsyncTestLitAPI
tests/unit/test_loops.py:98
↓ 1 callers
Class
BatchSizeMismatchAPI
tests/unit/test_batch.py:274
↓ 1 callers
Class
ChatCompletionRequest
src/litserve/specs/openai.py:167
↓ 1 callers
Class
ChatCompletionResponse
src/litserve/specs/openai.py:193
↓ 1 callers
Class
ChatCompletionResponseChoice
src/litserve/specs/openai.py:187
↓ 1 callers
Class
ContinuousBatchingAPI
tests/unit/test_loops.py:874
↓ 1 callers
Class
ContinuousBatchingLoop
src/litserve/loops/continuous_batching_loop.py:56
↓ 1 callers
Class
CrashingLitAPI
API that crashes after 2 predictions to simulate worker failure.
tests/unit/test_failed_workers.py:9
↓ 1 callers
Class
CustomError
tests/unit/test_simple.py:379
↓ 1 callers
Class
CustomSpecAPI
tests/unit/test_litapi.py:185
↓ 1 callers
Class
DefaultLoop
src/litserve/loops/base.py:378
↓ 1 callers
Class
DummyMessageTransport
tests/unit/test_loops.py:123
↓ 1 callers
Class
Embedding
src/litserve/specs/openai_embedding.py:60
↓ 1 callers
Class
EmbeddingResponse
src/litserve/specs/openai_embedding.py:71
↓ 1 callers
Class
EmbeddingsAPI
tests/e2e/openai_embedding_with_batching.py:6
↓ 1 callers
Class
ExceptionAPI
tests/unit/test_simple.py:384
↓ 1 callers
Class
FailFastAPI
tests/unit/test_lit_server.py:562
↓ 1 callers
Class
FailingLitAPI
tests/unit/test_lit_server.py:738
↓ 1 callers
Class
FailingLitAPIStreaming
tests/unit/test_lit_server.py:800
↓ 1 callers
Class
FakeBatchStreamTransport
tests/unit/test_loops.py:308
↓ 1 callers
Class
FakeStreamSender
tests/unit/test_loops.py:186
↓ 1 callers
Class
FakeTransport
tests/unit/test_batch.py:197
↓ 1 callers
Class
ForkedPdb
PDB Subclass for debugging multi-processed code Suggested in: https://stackoverflow.com/questions/4716533/how-to-attach-debugger-to-a-python-
src/litserve/utils.py:224
↓ 1 callers
Class
HeavyInitAPI
tests/unit/test_litapi.py:287
↓ 1 callers
Class
HeavyInitAPIWithSetup
tests/unit/test_litapi.py:293
↓ 1 callers
Class
HeavySetupAPI
tests/unit/test_litapi.py:298
↓ 1 callers
Class
HuggingFaceLitAPI
tests/perf_test/bert/server.py:17
↓ 1 callers
Class
IdentityAPI
tests/unit/test_lit_server.py:364
↓ 1 callers
Class
IdentityBatchedAPI
tests/unit/test_lit_server.py:374
↓ 1 callers
Class
IdentityBatchedStreamingAPI
tests/unit/test_lit_server.py:385
↓ 1 callers
Class
ImageAPI
tests/unit/test_schema.py:27
↓ 1 callers
Class
ImageClassifierAPI
tests/parity_fastapi/fastapi-server.py:22
↓ 1 callers
Class
ImageClassifierAPI
tests/parity_fastapi/ls-server.py:25
↓ 1 callers
Class
ImageOutput
src/litserve/schema/image.py:44
↓ 1 callers
Class
IncorrectAPI1
tests/unit/test_specs.py:331
next →
1–100 of 226, ranked by callers