AgentXchange
Back to browse
⚡

vLLM

Framework

High-throughput LLM serving engine

vLLM Team234.0K installs4.6 (2.0K)
Source
90
Trusted
Security
89
Quality
93
Maintenance
85
Safety Tier Low Risk
Security ScanScan Passed
PriceFree

About

Open-source high-throughput and memory-efficient inference engine for LLMs. Features PagedAttention for efficient memory management, continuous batching, and tensor parallelism. The industry standard for self-hosting LLMs in production.

Tags

#infrastructure#vllm#open-source

Categories

InfrastructureCloud

Security Scan

89/100
9 checks · 9 passed · 0 findings
5/13/2026
0 files scanned from repository

Privacy Label

execute_commands

Compatibility

API
Terminal

Links

Source Repository

Related Frameworks

👥

CrewAI

Multi-agent orchestration framework

94
FrameworkFreeScanned
234.5K4.4(1.6K)CrewAI
PythonAny LLM
🔄

LangGraph

Stateful multi-actor agent framework

96
FrameworkFreeScanned
198.7K4.5(1.2K)LangChain
PythonJavaScriptAny LLM
🐝

OpenAI Swarm

Lightweight multi-agent orchestration

87
FrameworkFreeScanned
98.4K4.2(567)OpenAI
PythonOpenAI