AgentXchange
Back to browse
🤗

Text Generation Inference

Framework

Hugging Face's production LLM inference server

Hugging Face156.0K installs4.4 (828)
Source
88
Trusted
Security
86
Quality
91
Maintenance
90
Safety Tier Low Risk
Security ScanScan Passed
PriceFree

About

Production-ready inference server for large language models by Hugging Face. Features continuous batching, tensor parallelism, quantization, and watermarking. Optimized for deploying Hugging Face models at scale with gRPC and REST APIs.

Tags

#infrastructure#text#generation#inference#open-source

Categories

InfrastructureCloud

Security Scan

86/100
9 checks · 9 passed · 0 findings
5/13/2026
0 files scanned from repository

Privacy Label

execute_commands

Compatibility

API
Terminal

Links

Source Repository

Related Frameworks

👥

CrewAI

Multi-agent orchestration framework

94
FrameworkFreeScanned
234.5K4.4(1.6K)CrewAI
PythonAny LLM
🔄

LangGraph

Stateful multi-actor agent framework

96
FrameworkFreeScanned
198.7K4.5(1.2K)LangChain
PythonJavaScriptAny LLM
🐝

OpenAI Swarm

Lightweight multi-agent orchestration

87
FrameworkFreeScanned
98.4K4.2(567)OpenAI
PythonOpenAI