Llama 3.3 70B Instruct — LLMaaS Modeli

Hızlı başlangıç

OpenAI uyumlu API. base_url’i gateway adresine çevirip model alanına Model ID’yi verin.

curl https://llm.fixcloud.ai/v1/chat/completions \
  -H "Authorization: Bearer $FXC_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "llama-3.3-70b-instruct",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from openai import OpenAI

client = OpenAI(base_url="https://llm.fixcloud.ai/v1", api_key="FXC_API_KEY")

response = client.chat.completions.create(
    model="llama-3.3-70b-instruct",
    messages=[{"role": "user", "content": "Hello!"}],
)
print(response.choices[0].message.content)

import OpenAI from 'openai';

const client = new OpenAI({ baseURL: 'https://llm.fixcloud.ai/v1', apiKey: process.env.FXC_API_KEY });

const response = await client.chat.completions.create({
  model: 'llama-3.3-70b-instruct',
  messages: [{ role: 'user', content: 'Hello!' }],
});
console.log(response.choices[0].message.content);

curl https://llm.fixcloud.ai/v1/chat/completions -N \
  -H "Authorization: Bearer $FXC_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "llama-3.3-70b-instruct",
    "messages": [{"role": "user", "content": "Hello!"}],
    "stream": true
  }'

from openai import OpenAI

client = OpenAI(base_url="https://llm.fixcloud.ai/v1", api_key="FXC_API_KEY")

stream = client.chat.completions.create(
    model="llama-3.3-70b-instruct",
    messages=[{"role": "user", "content": "Write a haiku about GPUs."}],
    stream=True,
)
for chunk in stream:
    delta = chunk.choices[0].delta.content
    if delta:
        print(delta, end="", flush=True)

import OpenAI from 'openai';

const client = new OpenAI({ baseURL: 'https://llm.fixcloud.ai/v1', apiKey: process.env.FXC_API_KEY });

const stream = await client.chat.completions.create({
  model: 'llama-3.3-70b-instruct',
  messages: [{ role: 'user', content: 'Write a haiku about GPUs.' }],
  stream: true,
});
for await (const chunk of stream) {
  process.stdout.write(chunk.choices[0]?.delta?.content ?? '');
}

curl https://llm.fixcloud.ai/v1/chat/completions \
  -H "Authorization: Bearer $FXC_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "llama-3.3-70b-instruct",
    "tools": [{
      "type": "function",
      "function": {
        "name": "get_weather",
        "description": "Get the current weather for a city",
        "parameters": {
          "type": "object",
          "properties": {"city": {"type": "string"}},
          "required": ["city"]
        }
      }
    }],
    "tool_choice": "auto",
    "messages": [{"role": "user", "content": "What is the weather in Istanbul?"}]
  }'

from openai import OpenAI

client = OpenAI(base_url="https://llm.fixcloud.ai/v1", api_key="FXC_API_KEY")

tools = [{
    "type": "function",
    "function": {
        "name": "get_weather",
        "description": "Get the current weather for a city",
        "parameters": {
            "type": "object",
            "properties": {"city": {"type": "string"}},
            "required": ["city"],
        },
    },
}]

response = client.chat.completions.create(
    model="llama-3.3-70b-instruct",
    messages=[{"role": "user", "content": "What is the weather in Istanbul?"}],
    tools=tools,
    tool_choice="auto",
)
print(response.choices[0].message.tool_calls)

import OpenAI from 'openai';

const client = new OpenAI({ baseURL: 'https://llm.fixcloud.ai/v1', apiKey: process.env.FXC_API_KEY });

const tools = [{
  type: 'function',
  function: {
    name: 'get_weather',
    description: 'Get the current weather for a city',
    parameters: {
      type: 'object',
      properties: { city: { type: 'string' } },
      required: ['city'],
    },
  },
}];

const response = await client.chat.completions.create({
  model: 'llama-3.3-70b-instruct',
  messages: [{ role: 'user', content: 'What is the weather in Istanbul?' }],
  tools,
  tool_choice: 'auto',
});
console.log(response.choices[0].message.tool_calls);

curl https://llm.fixcloud.ai/v1/chat/completions \
  -H "Authorization: Bearer $FXC_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "llama-3.3-70b-instruct",
    "response_format": {
      "type": "json_schema",
      "json_schema": {
        "name": "city_info",
        "schema": {
          "type": "object",
          "properties": {"city": {"type": "string"}, "country": {"type": "string"}},
          "required": ["city", "country"]
        }
      }
    },
    "messages": [{"role": "user", "content": "Where is the Bosphorus?"}]
  }'

from openai import OpenAI

client = OpenAI(base_url="https://llm.fixcloud.ai/v1", api_key="FXC_API_KEY")

response = client.chat.completions.create(
    model="llama-3.3-70b-instruct",
    messages=[{"role": "user", "content": "Where is the Bosphorus?"}],
    response_format={
        "type": "json_schema",
        "json_schema": {
            "name": "city_info",
            "schema": {
                "type": "object",
                "properties": {"city": {"type": "string"}, "country": {"type": "string"}},
                "required": ["city", "country"],
            },
        },
    },
)
print(response.choices[0].message.content)  # valid JSON

import OpenAI from 'openai';

const client = new OpenAI({ baseURL: 'https://llm.fixcloud.ai/v1', apiKey: process.env.FXC_API_KEY });

const response = await client.chat.completions.create({
  model: 'llama-3.3-70b-instruct',
  messages: [{ role: 'user', content: 'Where is the Bosphorus?' }],
  response_format: {
    type: 'json_schema',
    json_schema: {
      name: 'city_info',
      schema: {
        type: 'object',
        properties: { city: { type: 'string' }, country: { type: 'string' } },
        required: ['city', 'country'],
      },
    },
  },
});
console.log(JSON.parse(response.choices[0].message.content));

Yetenekler

Bu modelin API üzerinden sunduğu özellikler.

SohbetÇok turlu sohbet için /v1/chat/completions.
Araç çağırmaTanımladığınız araçları OpenAI tools formatında çağırır.
Fonksiyon çağırmaFonksiyon çağrısı şemalarını destekler.
JSON şemaresponse_format ile JSON şemasına uyan çıktı.
Yapılandırılmış çıktıYapılandırılmış, ayrıştırılabilir çıktı üretir.
Akış (streaming)Token bazında akış (stream: true).
Toplu çıkarımAsenkron toplu işler (Batch API).

Fiyatlandırma

Fiyatlar 1 milyon token başınadır. Paketinizdeki aylık token kotası dolduktan sonra kullanım bu fiyatlar üzerinden ücretlendirilir.

Girdi fiyatı

0,99 $/ 1M token

Çıktı fiyatı

1,99 $/ 1M token

Maliyet hesaplayıcı

İstek / gün

Ort. girdi token

Ort. çıktı token

İstek başına: —
Günlük: —
Aylık (30 gün): —

Tahmini kullanımınızı girin; gerçek fatura gateway’in ölçtüğü token sayısına göre kesilir.

Paketleri gör

Teknik özellikler

Modelin çalıştığı altyapıya dair şeffaflık bilgileri.

Aile: llama
Yayıncı: Meta
Lisans: llama-3.3
Model ID: llama-3.3-70b-instruct
Bağlam (token): 32.768
Kuantizasyon: Yok (native)
Replika başına GPU: 1 × GPU

32K token servis penceresi.

Hızlı başlangıç

Yetenekler

Fiyatlandırma

Teknik özellikler

Kurumsal GPU Demosu İsteyin