Introducing SkyServe: 50% Cheaper AI Serving on Any Cloud with High Availability
SkyServe: A simple, cost-efficient, multi-region/cloud library for serving GenAI models.
Posts
Scaling Mixtral LLM Serving with High GPU Availability and Cost Efficiency
A tutorial for serving Mixtral 8x7B model with SkyPilot and SkyServe.
Scaling AI Robotics on the Cloud
Covariant runs AI on the cloud using SkyPilot, delivering models 4x faster cost-effectively.
Finetuning Llama 2 in your own cloud environment, privately
An operational guide on finetuning Llama 2, ready for commercial use.
Serving LLM 24x Faster On the Cloud with vLLM and SkyPilot
SkyPilot makes the deployment and development of vLLM easy and fast on clouds.