Download
Lorax is a multi-LoRA (Low-Rank Adaptation) inference server that scales to thousands of fine-tuned Large Language Models (LLMs). It enables efficient deployment and management of numerous fine-tuned models, facilitating scalable AI applications. Lorax is designed to handle high concurrency and provides a robust infrastructure for serving multiple LLMs simultaneously.
Features
- Multi-LoRA inference server
- Scales to thousands of fine-tuned LLMs
- Efficient deployment of multiple models
Project Samples
Categories
LLM InferenceLicense
Apache License V2.0Follow LoRAX
Other Useful Business Software
Earn up to 15% annual interest with Nexo.
Put idle assets to work with competitive interest rates, borrow without selling, and trade with precision. All in one platform.
Geographic restrictions, eligibility, and terms apply.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of LoRAX!
