LLM AI tools with API

Agent Arena is an AI agent competition platform fo...

Agent Arena is an AI agent competition platform for developers and researchers hosting live head-to-head and time-limited campaigns where agents are submitted, tested and benchmarked with public leaderboards, integrated LLM/framework support, varied game formats and reproducible match logs.

Wafer AI is a serverless inference platform that l...

Wafer AI is a serverless inference platform that lets you run open-source LLMs in production with OpenAI-compatible APIs. It offers dedicated endpoints with optimized performance, long-context support, and caching to reduce costs for coding, reasoning, and agent workloads.

Pioneer automates retraining and deployment of ope...

Pioneer automates retraining and deployment of open-source models, using live inference data for fine-tuning and one-shot adaptation. It manages adaptive inference, routing, RAG pipelines, agent workflows, synthetic data generation, monitoring, and automated checkpoint promotion.

Opper is a unified AI gateway and agent control pl...

Opper is a unified AI gateway and agent control plane that routes requests across 200+ models and modalities, offering centralized model routing, automated fallbacks, budget caps, LLM observability, a multi-provider testing playground, OpenAI-compatible SDK, and enterprise privacy/compliance controls.

Portkey is an LLMOps platform offering a unified A...

Portkey is an LLMOps platform offering a unified API and model catalog with observability, guardrails, RBAC, audit logs, prompt management, caching, routing and PII redaction to simplify multi-model integration, governance, monitoring, and cost optimization.

ODS is an on-premises AI server for PC, Mac, and L...

ODS is an on-premises AI server for PC, Mac, and Linux offering local LLM inference, model management, agents, chat/voice UI, RAG with local document search, image pipelines, integrations (Ollama, ComfyUI, n8n), and operational tooling for private deployments.

Otari is an open-source AI gateway and control pla...

Otari is an open-source AI gateway and control plane that unifies access to 40+ LLM providers via a single endpoint, offering per-workspace routing, automatic failover, budget and token enforcement, centralized API key management, audit trails, and SDKs.

Tokenomy is an AI token intelligence platform that...

Tokenomy is an AI token intelligence platform that offers a token calculator, real-time usage monitoring, and analytical tools. It helps manage token costs, assess GPU memory needs, and evaluate energy consumption for efficient AI model performance.

Rival is an AI model comparison platform that allo...

Rival is an AI model comparison platform that allows users to analyze and compare various AI models based on performance metrics and capabilities, facilitating informed decisions for developers and businesses in selecting tailored AI solutions.

Tila is a multi-agent AI platform with a visual in...

Tila is a multi-agent AI platform with a visual infinite canvas to connect LLMs and creative tools for multimodal workflow automation. Convert and generate text, images, audio, and video, automate sequences, integrate APIs, and build reusable templates.

Omnichat is a multimodal LLM API that enables auto...

Omnichat is a multimodal LLM API that enables autonomous applications by integrating various AI capabilities. It enhances automation, customer service, and workflow management with human-like reasoning for better context comprehension and decision-making.

Mistral.rs is an efficient, versatile tool for hig...

Mistral.rs is an efficient, versatile tool for high-speed large language model (LLM) inference, offering multi-device support and extensive quantization options for seamless deployment on diverse hardware setups.

Anomalo automates data quality across structured, ...

Anomalo automates data quality across structured, semi‑structured, and unstructured data in cloud lakes and warehouses. Using unsupervised ML, it detects anomalies, validates completeness, enforces governance without code, and offers lineage mapping and KPI tracking.

Plat.AI is a real‑time decision‑making engine that...

Plat.AI is a real‑time decision‑making engine that auto‑builds, deploys, and updates ML models without code. It offers automated preprocessing, one‑click deployment, API integration, and dashboards for performance monitoring and regulatory compliance across finance, insurance, marketing and more.

Scoopika is an open‑source toolkit that speeds mul...

Scoopika is an open‑source toolkit that speeds multimodal LLM web app development by handling text, image, audio, and URL inputs. It streams real‑time responses, validates JSON, provides encrypted conversation memory, and enables serverless deployment across 26 edge regions.

Awan LLM offers unlimited token generation with Me...

Awan LLM offers unlimited token generation with Meta Llama 3.1 8B and 70B models, no censorship or caps, supporting persistent AI assistance, autonomous agents, roleplay, data processing, and code completion, hosted on owned GPUs for continuous use.

HoneyHive delivers AI observability and evaluation...

HoneyHive delivers AI observability and evaluation for production agents, offering OpenTelemetry tracing across 100+ LLMs, live metrics on quality, safety, latency, cost, drift alerts, offline experimentation, expert annotation, CI/CD integration, and enterprise security.

NailedIt.ai lets users compare up to 15 AI models—...

NailedIt.ai lets users compare up to 15 AI models—text, image, and video—by sending a single prompt and displaying side‑by‑side results. Users can use personal API keys, cutting costs and streamlining evaluation for developers, writers, marketers, and researchers.

Langtrace is an open‑source observability platform...

Langtrace is an open‑source observability platform that traces AI agent interactions, collects metrics such as token usage, cost, latency, and accuracy, and supports OTEL, major frameworks, and LLM providers. It offers on‑prem deployment, SOC 2 Type II compliance, and fine‑grained access control.

The text-generation-webui is a Gradio-based web UI...

The text-generation-webui is a Gradio-based web UI for Large Language Models, supporting various backends and multiple interface modes. It allows quick model switching, extension integration, and dynamic LoRA loading for custom training.

Page Assist is a Chrome extension that connects to...

Page Assist is a Chrome extension that connects to locally running AI models via a sidebar, enabling vision, document chat, and internet search. It supports PDFs, CSVs, markdown, Word, memory context, 14 languages, and keeps all data local.

LLM-answer-engine is an advanced answer engine lev...

LLM-answer-engine is an advanced answer engine leveraging Groq, Mixtral, Langchain.JS, Brave Search, Serper API, and OpenAI to provide sources, answers, images, videos, and follow-up questions efficiently. It offers an opensource Perplexity alternative.

Alli is an enterprise AI platform that automates w...

Alli is an enterprise AI platform that automates workflows by converting proprietary data into actionable insights. It uses Retrieval Augmented Generation, natural‑language queries, real‑time feedback, and a no‑code agent builder for secure, customizable AI solutions across finance, manufacturing, and healthcare.

EvalsOne is an evaluation platform for developers ...

EvalsOne is an evaluation platform for developers and researchers to assess LLM prompts, RAG, and agents using rule‑based or LLM‑based methods, human judgment, and customizable evaluators. It supports multiple APIs and integrates with major AI frameworks.

Mistral AI offers developers a platform for buildi...

Mistral AI offers developers a platform for building cutting-edge generative AI models with a focus on performance and customization. Their models excel in reasoning tasks and benchmarks, providing flexible deployment options across infrastructures.

LangWatch enables real‑time testing of LLM agents,...

LangWatch enables real‑time testing of LLM agents, offering simulation, prompt management, audit trails, and batch testing across models. It integrates with OpenTelemetry, LangChain, LangGraph, and supports self‑hosted, cloud, and role‑based access.

Athina lets teams build, test, and monitor AI feat...

Athina lets teams build, test, and monitor AI features via a prompt editor and flow builder for any model. It offers dataset comparison, SQL queries, evaluation suites, human QA, code execution, observability, self‑hosted deployment, SOC‑2 compliance, and cloud integrations.