{"info":{"_postman_id":"d7f461b5-c031-47e3-b638-433e90524b57","name":"AI Model Endpoint","description":"

Use the following endpoints for your AI model inferencing streaming and non streaming.

\n","schema":"https://schema.getpostman.com/json/collection/v2.0.0/collection.json","toc":[],"owner":"42376329","collectionId":"d7f461b5-c031-47e3-b638-433e90524b57","publishedId":"2sAYXFgcFh","public":true,"customColor":{"top-bar":"FFFFFF","right-sidebar":"303030","highlight":"34afa9"},"publishDate":"2025-02-18T12:11:04.000Z"},"item":[{"name":"Chat Completion","id":"c46dc5c0-1569-4446-9a33-df268d3415d8","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"POST","header":[],"body":{"mode":"raw","raw":"{\n \"model\": \"thedrummer/unslopnemo-12b\",\n \"temperature\": 0.9,\n \"messages\": [\n {\n \"role\": \"user\",\n \"content\": \"How big is earth?\"\n }\n ]\n}\n","options":{"raw":{"language":"json"}}},"url":"https://api.geodd.io/gateway/v1/chat/completions","description":"

This endpoint generates chat completions

📌 Required Parameters:

model(String) → Model name
\n
messages (Array) → List of user messages
\n
role (String) → user (for input) / assistant (for model response)
\n
content (String) → User's input query
\n
Supported Parameters will differ from models login to you https://console.geodd.io to check options
\n

📌 Authentication & Rate Limits

Header Bearer Token: Send Bearer in headers
\n
Invalid API Key (401 Unauthorized): If the API key is missing or incorrect
\n
Token Limit (429 Too Many Requests): If exceeds usage quota
\n

✅ Errors & Status Codes

\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n

Status Code	Meaning	Fix
`200 OK`	Success	✅ Request processed
`401 Unauthorized`	Invalid API Key	🔑 Check `X-API-Key` in headers
`429 Too Many Requests`	Token Limit Exceeded	🆕 Upgrade to a dedicated instance

","auth":{"type":"bearer","bearer":{"basicConfig":[{"key":"token","value":""}]},"isInherited":true,"source":{"_postman_id":"d7f461b5-c031-47e3-b638-433e90524b57","id":"d7f461b5-c031-47e3-b638-433e90524b57","name":"AI Model Endpoint","type":"collection"}},"urlObject":{"protocol":"https","path":["gateway","v1","chat","completions"],"host":["api","geodd","io"],"query":[],"variable":[]}},"response":[{"id":"d92eecd0-ba8e-497c-9caa-6ceb74aa9d44","name":"Chat Completion","originalRequest":{"method":"POST","header":[],"body":{"mode":"raw","raw":"{\n \"model\": \"meta-llama/Llama-3.1-405B-instruct\",\n \"messages\": [\n { \"role\": \"user\", \"content\": \"How big is Earth?\" }\n ]\n}","options":{"raw":{"language":"json"}}},"url":"https://api.geodd.io/gateway/v1/chat/completions"},"status":"OK","code":200,"_postman_previewlanguage":"json","header":[{"key":"X-RateLimit-Limit","value":"2"},{"key":"X-RateLimit-Remaining","value":"1"},{"key":"Date","value":"Tue, 18 Feb 2025 04:46:40 GMT"},{"key":"X-RateLimit-Reset","value":"1739854002"},{"key":"Access-Control-Allow-Origin","value":"*"},{"key":"Content-Type","value":"application/json; charset=utf-8"},{"key":"Content-Length","value":"1762"},{"key":"ETag","value":"W/\"6e2-TmCWpWzdiAatU23Kluj50yS9Hn0\""},{"key":"Connection","value":"keep-alive"},{"key":"Keep-Alive","value":"timeout=5"}],"cookie":[],"responseTime":null,"body":"{\n \"id\": \"chatcmpl-tv18ctsqfip\",\n \"object\": \"chat.completion\",\n \"created\": 1739854005,\n \"model\": \"meta-llama/Llama-3.1-405B-Instruct\",\n \"choices\": [\n {\n \"message\": {\n \"role\": \"assistant\",\n \"content\": \"Earth is the fifth-largest planet in our solar system, and it's truly massive. Here are some key facts about its size:\\n\\n1. **Diameter:** The diameter of Earth is approximately 12,742 kilometers (7,918 miles). This is the distance from one side of the Earth to the other, passing through its center.\\n2. **Circumference:** The circumference of Earth at the equator is about 40,075 kilometers (24,901 miles). This is the distance around the Earth, measured at the equator.\\n3. **Radius:** The radius of Earth is approximately 6,371 kilometers (3,959 miles). This is the distance from the center of the Earth to its surface.\\n4. **Surface area:** The surface area of Earth is about 510 million square kilometers (197 million square miles). This includes the area of the oceans, continents, and islands.\\n5. **Volume:** The volume of Earth is approximately 1.083 billion cubic kilometers (260 billion cubic miles).\\n\\nTo put these numbers into perspective, consider this: if you were to drive a car around the Earth's equator at a steady 100 kilometers per hour (62 miles per hour), it would take you about 400 hours or around 16.7 days to complete the journey, assuming you don't stop for rest or refueling!\\n\\nRemember, these measurements are approximate, as the Earth is not a perfect sphere and its shape can vary slightly due to its rotation and other factors. Nonetheless, these numbers give you a sense of the awe-inspiring scale of our home planet.\"\n },\n \"finish_reason\": \"stop\",\n \"index\": 0\n }\n ],\n \"usage\": {\n \"prompt_tokens\": 41,\n \"completion_tokens\": 324,\n \"total_tokens\": 365,\n \"tokens_per_second\": 69\n }\n}"}],"_postman_id":"c46dc5c0-1569-4446-9a33-df268d3415d8"},{"name":"Completion","id":"39cdfaa4-da1b-4cc6-a2eb-56157cd4d6f2","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"POST","header":[],"body":{"mode":"raw","raw":"{\n \"model\": \"meta-llama/Llama-3.1-405B-instruct\",\n \"prompt\": \"How big is earth?\",\n \"max_tokens\": 200\n}\n","options":{"raw":{"language":"json"}}},"url":"https://api.geodd.io/gateway/v1/completions","description":"

This endpoint generates chat completions

📌 Required Parameters:

model(String) → Model name
\n
prompt (String) → User's input query
\n
Supported Parameters will differ from models login to you https://console.geodd.io to check options
\n

📌 Authentication & Rate Limits

Header Bearer Token: Send Bearer in headers
\n
Invalid API Key (401 Unauthorized): If the API key is missing or incorrect
\n
Token Limit (429 Too Many Requests): If exceeds usage quota
\n

✅ Errors & Status Codes

\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n

Status Code	Meaning	Fix
`200 OK`	Success	✅ Request processed
`401 Unauthorized`	Invalid API Key	🔑 Check `X-API-Key` in headers
`429 Too Many Requests`	Token Limit Exceeded	🆕 Upgrade to a dedicated instance

","auth":{"type":"bearer","bearer":{"basicConfig":[{"key":"token","value":""}]},"isInherited":true,"source":{"_postman_id":"d7f461b5-c031-47e3-b638-433e90524b57","id":"d7f461b5-c031-47e3-b638-433e90524b57","name":"AI Model Endpoint","type":"collection"}},"urlObject":{"protocol":"https","path":["gateway","v1","completions"],"host":["api","geodd","io"],"query":[],"variable":[]}},"response":[{"id":"cd766d60-12d5-43db-bdb9-6f22bfa12303","name":"Chat Completion","originalRequest":{"method":"POST","header":[],"body":{"mode":"raw","raw":"{\n \"model\": \"meta-llama/Llama-3.1-405B-instruct\",\n \"prompt\": \"How big is earth?\",\n \"max_tokens\": 200\n}","options":{"raw":{"language":"json"}}},"url":"https://api.geodd.io/gateway/v1/chat/completions"},"status":"OK","code":200,"_postman_previewlanguage":"json","header":[{"key":"X-RateLimit-Limit","value":"2"},{"key":"X-RateLimit-Remaining","value":"1"},{"key":"Date","value":"Tue, 18 Feb 2025 04:46:40 GMT"},{"key":"X-RateLimit-Reset","value":"1739854002"},{"key":"Access-Control-Allow-Origin","value":"*"},{"key":"Content-Type","value":"application/json; charset=utf-8"},{"key":"Content-Length","value":"1762"},{"key":"ETag","value":"W/\"6e2-TmCWpWzdiAatU23Kluj50yS9Hn0\""},{"key":"Connection","value":"keep-alive"},{"key":"Keep-Alive","value":"timeout=5"}],"cookie":[],"responseTime":null,"body":"{\n \"id\": \"chatcmpl-tv18ctsqfip\",\n \"object\": \"chat.completion\",\n \"created\": 1739854005,\n \"model\": \"meta-llama/Llama-3.1-405B-Instruct\",\n \"choices\": [\n {\n \"message\": {\n \"role\": \"assistant\",\n \"content\": \"Earth is the fifth-largest planet in our solar system, and it's truly massive. Here are some key facts about its size:\\n\\n1. **Diameter:** The diameter of Earth is approximately 12,742 kilometers (7,918 miles). This is the distance from one side of the Earth to the other, passing through its center.\\n2. **Circumference:** The circumference of Earth at the equator is about 40,075 kilometers (24,901 miles). This is the distance around the Earth, measured at the equator.\\n3. **Radius:** The radius of Earth is approximately 6,371 kilometers (3,959 miles). This is the distance from the center of the Earth to its surface.\\n4. **Surface area:** The surface area of Earth is about 510 million square kilometers (197 million square miles). This includes the area of the oceans, continents, and islands.\\n5. **Volume:** The volume of Earth is approximately 1.083 billion cubic kilometers (260 billion cubic miles).\\n\\nTo put these numbers into perspective, consider this: if you were to drive a car around the Earth's equator at a steady 100 kilometers per hour (62 miles per hour), it would take you about 400 hours or around 16.7 days to complete the journey, assuming you don't stop for rest or refueling!\\n\\nRemember, these measurements are approximate, as the Earth is not a perfect sphere and its shape can vary slightly due to its rotation and other factors. Nonetheless, these numbers give you a sense of the awe-inspiring scale of our home planet.\"\n },\n \"finish_reason\": \"stop\",\n \"index\": 0\n }\n ],\n \"usage\": {\n \"prompt_tokens\": 41,\n \"completion_tokens\": 324,\n \"total_tokens\": 365,\n \"tokens_per_second\": 69\n }\n}"}],"_postman_id":"39cdfaa4-da1b-4cc6-a2eb-56157cd4d6f2"},{"name":"List Models","id":"90eae7f3-41c7-465c-a9a3-c89e0b921a9f","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"GET","header":[],"url":"https://api.geodd.io/dedicated/models/6866add088ee35e70515332b","description":"

Get Model Details

This endpoint retrieves detailed information about a specific model identified by customer ID. It provides insights into the model's architecture, pricing, and supported parameters.

Request

Method: GET
\n
URL: https://api.geodd.io/dedicated/models/{customer_id}
\n

Path Parameter:

customer_id (string): Login to https://console.geodd.io to view customer ID

Response

The response is a JSON object containing a data array, which includes detailed information about the model. Each model object in the array contains the following fields:

_id (string): The unique identifier for the model.
\n
id (string): An additional identifier for the model.
\n
canonical_slug (string): A URL-friendly version of the model name.
\n
hugging_face_id (string): The identifier used on the Hugging Face platform.
\n
name (string): The name of the model.
\n
description (string): A brief description of the model's capabilities.
\n
context_length (integer): The maximum context length the model can handle.
\n
architecture (object): Contains details about the model's architecture, including:
\n
- modality (string): The type of data the model processes.
  \n
- input_modalities (array of strings): The modalities that the model accepts as input.
  \n
- output_modalities (array of strings): The modalities that the model produces as output.
  \n
- tokenizer (string): The tokenizer used by the model.
  \n
- instruct_type (string): The type of instructions the model can follow.
  \n
\n
pricing (object): Contains pricing information for using the model, including:
\n
- prompt (string): Cost associated with prompt usage.
  \n
- completion (string): Cost associated with completion requests.
  \n
- request (string): Cost for making requests to the model.
  \n
- image (string): Cost for image-related processing.
  \n
- web_search (string): Cost for web search functionalities.
  \n
- internal_reasoning (string): Cost for internal reasoning tasks.
  \n
\n
supported_parameters (array of strings): A list of parameters that the model supports.
\n

This endpoint is useful for developers and users who want to understand the capabilities and pricing of specific models available through the API.

\n","auth":{"type":"bearer","bearer":{"basicConfig":[{"key":"token","value":""}]},"isInherited":true,"source":{"_postman_id":"d7f461b5-c031-47e3-b638-433e90524b57","id":"d7f461b5-c031-47e3-b638-433e90524b57","name":"AI Model Endpoint","type":"collection"}},"urlObject":{"protocol":"https","path":["dedicated","models","6866add088ee35e70515332b"],"host":["api","geodd","io"],"query":[],"variable":[]}},"response":[{"id":"fc7a19c6-70a7-4fa3-ad67-93c8a8d4d2e2","name":"List Models","originalRequest":{"method":"GET","header":[],"url":"https://api.geodd.io/dedicated/models/6866add088ee35e70515332b"},"status":"OK","code":200,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Thu, 03 Jul 2025 17:00:26 GMT"},{"key":"Content-Type","value":"application/json; charset=utf-8"},{"key":"Transfer-Encoding","value":"chunked"},{"key":"Connection","value":"keep-alive"},{"key":"Access-Control-Allow-Origin","value":"*"},{"key":"Nel","value":"{\"report_to\":\"cf-nel\",\"success_fraction\":0.0,\"max_age\":604800}"},{"key":"Etag","value":"W/\"36d-pcW9EoHpIO/lmnS46Ng4OIvvK3Q\""},{"key":"Report-To","value":"{\"group\":\"cf-nel\",\"max_age\":604800,\"endpoints\":[{\"url\":\"https://a.nel.cloudflare.com/report/v4?s=giGwwwneZxzPKaKUhNJVQ38N%2BWfXq5OF3nTTnXMWdEdww90N3T4IEhcfH3aWsvZ6G1%2B920DDz69pDc82p8QzMN5GYmQf%2Bywh%2FAkq5Q%3D%3D\"}]}"},{"key":"Cf-Cache-Status","value":"DYNAMIC"},{"key":"Content-Encoding","value":"br"},{"key":"Server","value":"cloudflare"},{"key":"CF-RAY","value":"9597f0680bbafda3-SIN"},{"key":"alt-svc","value":"h3=\":443\"; ma=86400"}],"cookie":[],"responseTime":null,"body":"{\n \"data\": [\n {\n \"_id\": \"6866872688ee35e7051532fa\",\n \"id\": \"thedrummer/unslopnemo-12b\",\n \"canonical_slug\": \"thedrummer/unslopnemo-12b\",\n \"hugging_face_id\": \"thedrummer/unslopnemo-12b\",\n \"name\": \"TheDrummer: UnslopNemo 12B\",\n \"description\": \"UnslopNemo v4.1 is the latest addition from the creator of Rocinante, designed for adventure writing and role-play scenarios.\",\n \"context_length\": 32768,\n \"architecture\": {\n \"modality\": \"text->text\",\n \"input_modalities\": [\n \"text\"\n ],\n \"output_modalities\": [\n \"text\"\n ],\n \"tokenizer\": \"Mistral\",\n \"instruct_type\": \"mistral\"\n },\n \"pricing\": {\n \"prompt\": \"0.0000004\",\n \"completion\": \"0.0000004\",\n \"request\": \"0\",\n \"image\": \"0\",\n \"web_search\": \"0\",\n \"internal_reasoning\": \"0\"\n },\n \"supported_parameters\": [\n \"max_tokens\",\n \"temperature\",\n \"top_p\",\n \"stop\",\n \"frequency_penalty\",\n \"presence_penalty\",\n \"response_format\",\n \"structured_outputs\",\n \"repetition_penalty\",\n \"logit_bias\",\n \"top_k\",\n \"min_p\",\n \"seed\",\n \"tools\",\n \"tool_choice\",\n \"logprobs\"\n ]\n }\n ]\n}"}],"_postman_id":"90eae7f3-41c7-465c-a9a3-c89e0b921a9f"}],"auth":{"type":"bearer","bearer":{"basicConfig":[{"key":"token","value":""}]}},"event":[{"listen":"prerequest","script":{"id":"422ba24b-c605-4a1c-b827-434ecae4e68c","type":"text/javascript","exec":[""]}},{"listen":"test","script":{"id":"042a5038-75df-44c4-a9ab-63dc0fb32c2f","type":"text/javascript","exec":[""]}}]}