Overview

doteb is an API gateway for Large Language Models (LLMs). It acts as a middleware between your applications and various LLM providers, allowing you to:

• Route requests to multiple LLM providers (OpenAI, Anthropic, Google AI Studio, and others)
• Manage API keys for different providers in one place
• Track token usage and costs across all your LLM interactions
• Analyze performance metrics to optimize your LLM usage

Analyzing Your LLM Requests

doteb provides detailed insights into your LLM usage:

• Usage Metrics: Track the number of requests, tokens used, and response times
• Cost Analysis: Monitor spending across different models and providers
• Performance Tracking: Identify patterns and optimize your prompts based on actual usage data
• Breakdown by Model: Compare different models' performance and cost-effectiveness

All this data is automatically collected and presented in an intuitive dashboard, helping you make informed decisions about your LLM strategy.

Getting Started

Using doteb is simple. Just swap out your current LLM provider URL with the doteb API endpoint:

curl -X POST https://api.doteb.com/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $LLM_GATEWAY_API_KEY" \
  -d '{
  "model": "gpt-4o",
  "messages": [
    {"role": "user", "content": "Hello, how are you?"}
  ]
}'

doteb maintains compatibility with the OpenAI API format, making migration seamless.

Hosted vs. Self-Hosted

You can use doteb in two ways:

• Hosted Version: For immediate use without setup, visit doteb.com to create an account and get an API key.
• Self-Hosted: Deploy doteb on your own infrastructure for complete control over your data and configuration.

The self-hosted version offers additional customization options and ensures your LLM traffic never leaves your infrastructure if desired.