BentoML Model Serving

Azure ML provides end-to-end ML capabilities. Automated ML. Model training and evaluation. Model deployment and monitoring. Enterprise governance. Azure ecosystem integration.

Run AI inference at the edge with Cloudflare's global network. Deploys AI models close to users with low latency and no cold starts.

MLflow is an open ML lifecycle platform. Track experiments, metrics, params. Model registry for versioning. Model serving with REST API. Integration with Spark. Industry standard.

AI-accelerated Docker build cloud that delivers up to 40x faster container builds than standard GitHub Actions runners through persistent remote caching and optimized build infrastructure. Zero config…

Dremio democratizes data access by running SQL directly on data lakes without expensive copies into a data warehouse. It reflects schema changes instantly and caches hot data in memory for sub-second …

Platform for deploying full-stack apps and databases close to users worldwide using lightweight VMs with fast startup times.

An open-source Python library from Hugging Face for building and sharing interactive ML model demos and applications in minutes. Gradio wraps any Python function, typically an AI model inference funct…

Gradio creates simple interfaces for ML models. Share models via public link. Input/output components. LaunchPad for easy deployment. Hugging Face integration.

H2O provides MLOps for at-scale model development. AutoML. Model governance and monitoring. Deployment framework. Enterprise support. Founded by Kaggle team.

An open-source LLM observability and caching platform that adds monitoring, cost tracking, and caching to any LLM application with a single line of code change. Helicone works as a proxy: developers r…

Hex is a notebook environment for data analytics teams that bridges Jupyter and Dashboards. Write SQL, Python, and R in reactive cells. Parameters auto-build filters without code. Share notebooks as i…

Hugging Face Hub hosts 300,000+ models. Model cards with metadata. Community discussions. Inference API. Standard for NLP model sharing. Non-profit organization.

Kubeflow runs ML workflows on Kubernetes. Pipelines for training and inference. TensorFlow, PyTorch, XGBoost support. Model serving with KServe. CNCF project. Enterprise-ready.

An open-source Python library and proxy server providing a unified API interface for calling over 100 different LLM providers through a single OpenAI-compatible format. Developers write code against t…

Docker-first self-hosted AI stack that provides OpenAI-compatible API endpoints for running LLMs, image generation, and audio models on your own infrastructure. Supports multiple backends and models s…

A cloud infrastructure platform for running Python code on serverless GPUs and CPUs, designed specifically for machine learning inference, model training, and AI data processing workloads. Developers …

Web platform for deploying and hosting frontend applications with CI/CD, edge functions, forms, and AI-powered performance insights.

Prefect is a workflow orchestration platform that replaces Airflow with a Pythonic, modular approach. Flows are Python functions with auto-retry, parameterization, and built-in parallelism. Deployment…

Ray Tune is a hyperparameter tuning library. Distributed optimization across clusters. Population based training. Algorithms: Bayesian, evolutionary. Integration with PyTorch and TensorFlow.

Amazon SageMaker provides end-to-end ML workflows. Notebooks, training, hyperparameter tuning, inference. AutoML capabilities. Experiments and model registry. Market-leading platform.

Seldon Core deploys and manages ML models in production. Multi-model serving. A/B testing and canary deployments. Kubernetes-native. Open-source with commercial support.

Starburst Enterprise is a commercial distribution of Trino, the open query engine for polyglot data lakes. Query Parquet in S3, Iceberg tables, Postgres, Snowflake, Cassandra from one SQL prompt. C3 o…

Streamlit rapidly builds ML web apps in Python. Interactive widgets with no frontend coding. Real-time reruns on code changes. Deployment to Streamlit Cloud. Developer-friendly.

Google Vertex AI offers unified ML operations. AutoML for custom models. Pre-trained model APIs. Model monitoring and retraining. GCP-native integration.