Skip to main content

Bud Stack Documentation home page

Blog
API Reference

Getting Started

Introduction to Bud Stack
Quick Start Guide
Platform Overview
Account Setup
Key Concepts

Projects

Projects Management
Creating Projects
Project Dashboard
Project Settings

Models

Models
Model Repository
Understanding Model Cards
Model Selection Guide
Model Leaderboards
Supported Model Types

Deployments

Deploy Your First Model
Deployment Configuration
Deployment Management
Multi-LoRA Support
Deployment Strategies
Troubleshooting Deployments

Clusters

Cluster Management
Cluster Overview
Cluster Types
Registering Clusters
Cluster Management
Multi-Cloud Strategy

Endpoints

Creating endpoints
Endpoint configuration
Using endpoints
Openai compatible
Endpoint monitoring

API Integration

Authentication
API Reference Overview
Chat Completions
Embeddings
Image Generation
Audio Processing
Batch Processing
Streaming Responses
Error Handling

Playground

Playground
Using the Playground
Model Comparison
Prompt Engineering
Saving Conversations

Observability

Observability
Dashboard Overview
Request Analytics
Performance Monitoring
Cost Tracking
Inference History
Custom Dashboards
Alerts & Notifications

Dashboard

Dashboard

Prompts & Agents

Agents
Prompt Management
Prompt Templates
Agent Configuration
Agent Workflows

Evaluations

Evaluations
Model Evaluation Overview
Creating Evaluation Sets
Running Evaluations
Evaluation Metrics
Comparing Models

Guardrails

Guardrails
What are Guardrails
Setting Up Guardrails
Content Filtering
Custom Rules

Performance Optimization

Simulation Overview
Hardware Recommendations
Optimization Strategies
Scaling Guide

API Keys & Security

Creating API Keys
API Key Permissions
Security Best Practices
Rotating Keys
Rate Limiting

User Management

User Management & RBAC
Authentication
Inviting Users
User Types & Permissions
User Activity
SSO Integration

Settings

Account Settings
Organization Settings
Billing Settings
Notification Preferences
API Configuration

Billing & Usage

Understanding Pricing
Monitoring Usage
Billing Cycles
Usage Optimization
Invoice Management

Dashboard
Support

Bud Stack Documentation home page

Dashboard
Support

Performance Optimization

Optimization Strategies

Reduce latency and costs

Optimization Strategies

Content to be added

Scaling GuideHandle increased load

⌘I

x github linkedin

Optimization Strategies