PeerLLM Developer Guide

https://api.peerllm.com

Authorization: Bearer <YOUR_API_KEY>

GET /v1/models

Returns the list of all approved models currently available on the PeerLLM network.

Request

GET /v1/models HTTP/1.1
Host: api.peerllm.com

Response 200 OK

{
  "object": "list",
  "data": [
    {
      "id": "LLooMA1.0",
      "object": "model",
      "created": 1776572039,
      "owned_by": "peerllm",
      "metadata": {
        "source": "orchestration",
        "repo": null,
        "file": null,
        "qtype": null,
        "size": null,
        "ram": null,
        "gpu": null,
        "checksum": null,
        "description": "LLooMA Orchestration Model - Centralized AI orchestration with distributed execution across PeerLLM hosts. Automatically splits complex tasks into parallel subtasks for optimal performance."
      }
    },
    {
      "id": "mistral-7b-instruct-v0.2.Q8_0",
      "object": "model",
      "created": 1776572039,
      "owned_by": "peerllm",
      "metadata": {
        "source": "huggingface",
        "repo": "TheBloke/Mistral-7B-Instruct-v0.2-GGUF",
        "file": "mistral-7b-instruct-v0.2.Q8_0.gguf",
        "qtype": "Q8_0",
        "size": 7241732096,
        "ram": "16GB+",
        "gpu": "RTX 4060 or higher",
        "checksum": "sha256:3a6fbf4a41a1d52e415a4958cde6856d34b2db93",
        "description": "Quantized Mistral 7B Instruct v0.2 model hosted by TheBloke. Improved reasoning, context depth (32K tokens), and conversational performance."
      }
    }
  ]
}

Model Metadata Fields

POST /v1/chat/completions

Send a chat completion request. Supports both streaming (stream: true, the default) and non-streaming (stream: false) modes.

Request

POST /v1/chat/completions HTTP/1.1
Host: api.peerllm.com
Authorization: Bearer <YOUR_API_KEY>
Content-Type: application/json

{
  "model": "LLooMA1.0",
  "messages": [
    { "role": "system", "content": "You are a helpful assistant." },
    { "role": "user", "content": "Explain quantum computing in simple terms." }
  ],
  "stream": true,
  "temperature": 0.7,
  "max_tokens": 1024
}

Request Body

Non-Streaming Response 200 OK

{
  "id": "chatcmpl-abc123",
  "object": "chat.completion",
  "created": 1750000000,
  "model": "LLooMA1.0",
  "choices": [
    {
      "index": 0,
      "message": {
        "role": "assistant",
        "content": "Quantum computing uses qubits..."
      },
      "finish_reason": "stop"
    }
  ],
  "usage": {
    "prompt_tokens": 25,
    "completion_tokens": 150,
    "total_tokens": 175
  }
}

Streaming Response 200 OK

The response is sent as Server-Sent Events (text/event-stream). Each event contains a JSON chunk:

data: {"id":"chatcmpl-abc123","object":"chat.completion.chunk","created":1750000000,"model":"LLooMA1.0","choices":[{"index":0,"delta":{"role":"assistant","content":"Quantum"},"finish_reason":null}]}

data: {"id":"chatcmpl-abc123","object":"chat.completion.chunk","created":1750000000,"model":"LLooMA1.0","choices":[{"index":0,"delta":{"content":" computing"},"finish_reason":null}]}

...

data: [DONE]

About LLooMA1.0

LLooMA1.0 is a network-native orchestration model. It does not run on any single host. Instead, it:

1. Analyzes your prompt and determines if it can be split into parallel subtasks.
2. If splittable, it distributes subtasks across multiple PeerLLM hosts and synthesizes the results.
3. If not splittable, it races two PeerLLM hosts and uses the fastest response. Strict latency enforcement (1 s first-token deadline, 1 s inter-token timeout, 5 s total cap) ensures quality — if hosts are slow, a centralized AI fallback kicks in automatically.

For all other model IDs, the request is sent directly to a host running that specific model.

{
  "error": "Error message string"
}

{
  "error": {
    "message": "Detailed error message",
    "type": "error_type",
    "code": "error_code"
  }
}

# List available models
curl https://api.peerllm.com/v1/models

# Chat completion (streaming)
curl https://api.peerllm.com/v1/chat/completions \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "LLooMA1.0",
    "messages": [{"role": "user", "content": "Hello!"}],
    "stream": true
  }'

from openai import OpenAI

client = OpenAI(
    api_key="YOUR_API_KEY",
    base_url="https://api.peerllm.com/v1"
)

response = client.chat.completions.create(
    model="LLooMA1.0",
    messages=[
        {"role": "user", "content": "What is PeerLLM?"}
    ],
    stream=True
)

for chunk in response:
    if chunk.choices[0].delta.content:
        print(chunk.choices[0].delta.content, end="")

import OpenAI from "openai";

const client = new OpenAI({
  apiKey: "YOUR_API_KEY",
  baseURL: "https://api.peerllm.com/v1",
});

const stream = await client.chat.completions.create({
  model: "LLooMA1.0",
  messages: [{ role: "user", content: "What is PeerLLM?" }],
  stream: true,
});

for await (const chunk of stream) {
  process.stdout.write(chunk.choices[0]?.delta?.content || "");
}

using OpenAI;
using OpenAI.Chat;

var client = new ChatClient(
    model: "LLooMA1.0",
    credential: new ApiKeyCredential("YOUR_API_KEY"),
    options: new OpenAIClientOptions
    {
        Endpoint = new Uri("https://api.peerllm.com/v1")
    });

var stream = client.CompleteChatStreamingAsync(
    new List<ChatMessage>
    {
        new UserChatMessage("What is PeerLLM?")
    });

await foreach (var update in stream)
{
    foreach (var part in update.ContentUpdate)
    {
        Console.Write(part.Text);
    }
}