--- title: "AI for Devs platform directory" type: "directory" url: "https://aifordevs.org/platforms" markdown: "https://aifordevs.org/platforms.md" publisher: "AI for Devs" license: "https://aifordevs.org/reuse" attribution: "Credit AI for Devs and link to https://aifordevs.org/platforms" platforms: 47 --- # AI for Devs platform directory What each platform is and where it fits, from model APIs to vector databases. The directory lists facts that stay true for months. Prices and benchmarks live in dated news briefs. ## Model APIs ### Amazon Bedrock Page: https://aifordevs.org/platforms#amazon-bedrock | Markdown: https://aifordevs.org/platforms/amazon-bedrock.md Managed access to models from several labs inside your AWS account, with IAM, VPC, and guardrails. - Maker: AWS - Category: Model APIs - Website: https://aws.amazon.com/bedrock/ - Tags: cloud, enterprise ### Claude API Page: https://aifordevs.org/platforms#anthropic-api | Markdown: https://aifordevs.org/platforms/anthropic-api.md Claude models through the Messages API, with tool use, prompt caching, and batch processing. - Maker: Anthropic - Category: Model APIs - Website: https://docs.anthropic.com - Tags: frontier, prompt caching, tool use ### DeepSeek API Page: https://aifordevs.org/platforms#deepseek-api | Markdown: https://aifordevs.org/platforms/deepseek-api.md OpenAI-compatible API for DeepSeek's chat and reasoning models, which are also published as open weights. - Maker: DeepSeek - Category: Model APIs - Website: https://api-docs.deepseek.com - Tags: open weights, openai compatible ### Gemini API Page: https://aifordevs.org/platforms#gemini-api | Markdown: https://aifordevs.org/platforms/gemini-api.md Gemini models for text, image, audio, and video input, available through Google AI Studio and Vertex AI. - Maker: Google - Category: Model APIs - Website: https://ai.google.dev - Tags: frontier, multimodal, long context ### Mistral AI Page: https://aifordevs.org/platforms#mistral | Markdown: https://aifordevs.org/platforms/mistral.md Hosted API for Mistral's models, several of which are also released as open weights. - Maker: Mistral AI - Category: Model APIs - Website: https://docs.mistral.ai - Tags: open weights, europe ### OpenAI API Page: https://aifordevs.org/platforms#openai-api | Markdown: https://aifordevs.org/platforms/openai-api.md GPT and reasoning models with the Responses API, tool calling, structured outputs, and realtime audio. - Maker: OpenAI - Category: Model APIs - Website: https://platform.openai.com/docs - Tags: frontier, tool calling, structured outputs ### Vertex AI Page: https://aifordevs.org/platforms#vertex-ai | Markdown: https://aifordevs.org/platforms/vertex-ai.md Google Cloud's platform for Gemini and third-party models, with tuning, evaluation, and agent tooling. - Maker: Google Cloud - Category: Model APIs - Website: https://cloud.google.com/vertex-ai - Tags: cloud, enterprise ### xAI API Page: https://aifordevs.org/platforms#xai-api | Markdown: https://aifordevs.org/platforms/xai-api.md Grok models through an API that is compatible with the OpenAI and Anthropic SDKs. - Maker: xAI - Category: Model APIs - Website: https://docs.x.ai - Tags: frontier ## Inference platforms ### Baseten Page: https://aifordevs.org/platforms#baseten | Markdown: https://aifordevs.org/platforms/baseten.md Dedicated and shared inference for open-weight and custom models, plus training and the Truss packaging tool. - Maker: Baseten - Category: Inference platforms - Website: https://www.baseten.co - Tags: dedicated inference, training ### Fireworks AI Page: https://aifordevs.org/platforms#fireworks-ai | Markdown: https://aifordevs.org/platforms/fireworks-ai.md Fast inference for open-weight models, with fine-tuning and on-demand deployments. - Maker: Fireworks AI - Category: Inference platforms - Website: https://fireworks.ai - Tags: open weights, fine-tuning ### Groq Page: https://aifordevs.org/platforms#groq | Markdown: https://aifordevs.org/platforms/groq.md Inference API running open-weight models on Groq's own LPU chips, built for low latency. - Maker: Groq - Category: Inference platforms - Website: https://groq.com - Tags: custom silicon, low latency ### Hugging Face Page: https://aifordevs.org/platforms#hugging-face | Markdown: https://aifordevs.org/platforms/hugging-face.md The main hub for open-weight models and datasets, plus Inference Providers and dedicated Inference Endpoints. - Maker: Hugging Face - Category: Inference platforms - Website: https://huggingface.co - Tags: open weights, model hub ### Modal Page: https://aifordevs.org/platforms#modal | Markdown: https://aifordevs.org/platforms/modal.md Serverless GPUs driven from Python code, used for inference, batch jobs, and fine-tuning. - Maker: Modal Labs - Category: Inference platforms - Website: https://modal.com - Tags: serverless, python ### OpenRouter Page: https://aifordevs.org/platforms#openrouter | Markdown: https://aifordevs.org/platforms/openrouter.md One OpenAI-compatible API and one bill for hundreds of models across many providers. - Maker: OpenRouter - Category: Inference platforms - Website: https://openrouter.ai - Tags: router, openai compatible ### Replicate Page: https://aifordevs.org/platforms#replicate | Markdown: https://aifordevs.org/platforms/replicate.md Run community and official models through an API, and package your own with the open-source Cog tool. - Maker: Replicate - Category: Inference platforms - Website: https://replicate.com - Tags: image, video, api ### Together AI Page: https://aifordevs.org/platforms#together-ai | Markdown: https://aifordevs.org/platforms/together-ai.md Serverless and dedicated inference for open-weight models, with fine-tuning and GPU clusters. - Maker: Together AI - Category: Inference platforms - Website: https://www.together.ai - Tags: open weights, fine-tuning ## Inference engines ### llama.cpp Page: https://aifordevs.org/platforms#llama-cpp | Markdown: https://aifordevs.org/platforms/llama-cpp.md C/C++ inference for GGUF models on CPUs, Apple silicon, and consumer GPUs, with heavy quantization support. - Maker: ggml-org - Category: Inference engines - Website: https://github.com/ggml-org/llama.cpp - Open source: yes - Tags: local, gguf, quantization ### Ollama Page: https://aifordevs.org/platforms#ollama | Markdown: https://aifordevs.org/platforms/ollama.md Pull and run open-weight models locally with one command, behind a local REST API. - Maker: Ollama - Category: Inference engines - Website: https://ollama.com - Open source: yes - Tags: local, developer tool ### SGLang Page: https://aifordevs.org/platforms#sglang | Markdown: https://aifordevs.org/platforms/sglang.md Serving engine with RadixAttention prefix caching and a fast runtime for structured and multi-call workloads. - Maker: SGLang project - Category: Inference engines - Website: https://github.com/sgl-project/sglang - Open source: yes - Tags: prefix caching, gpu serving ### TensorRT-LLM Page: https://aifordevs.org/platforms#tensorrt-llm | Markdown: https://aifordevs.org/platforms/tensorrt-llm.md NVIDIA's library for optimized LLM inference on NVIDIA GPUs, with in-flight batching and quantization. - Maker: NVIDIA - Category: Inference engines - Website: https://github.com/NVIDIA/TensorRT-LLM - Open source: yes - Tags: nvidia, gpu serving ### vLLM Page: https://aifordevs.org/platforms#vllm | Markdown: https://aifordevs.org/platforms/vllm.md High-throughput serving engine built around PagedAttention, continuous batching, and an OpenAI-compatible server. - Maker: vLLM project - Category: Inference engines - Website: https://github.com/vllm-project/vllm - Open source: yes - Tags: paged attention, gpu serving ## Coding agents ### Aider Page: https://aifordevs.org/platforms#aider | Markdown: https://aifordevs.org/platforms/aider.md Open-source pair programming in the terminal that edits files and commits changes to git. - Maker: Aider - Category: Coding agents - Website: https://aider.chat - Open source: yes - Tags: terminal, git ### Claude Code Page: https://aifordevs.org/platforms#claude-code | Markdown: https://aifordevs.org/platforms/claude-code.md Agentic coding tool that works in your terminal, IDE, desktop app, and browser, and can run commands and edit files. - Maker: Anthropic - Category: Coding agents - Website: https://docs.anthropic.com/en/docs/claude-code/overview - Tags: terminal, agent ### Cline Page: https://aifordevs.org/platforms#cline | Markdown: https://aifordevs.org/platforms/cline.md Open-source coding agent for VS Code that asks for approval before it edits files or runs commands. - Maker: Cline - Category: Coding agents - Website: https://cline.bot - Open source: yes - Tags: editor, mcp ### Codex Page: https://aifordevs.org/platforms#codex | Markdown: https://aifordevs.org/platforms/codex.md OpenAI's coding agent, available as an open-source CLI, IDE extension, and cloud agent. - Maker: OpenAI - Category: Coding agents - Website: https://developers.openai.com/codex - Tags: terminal, cloud agent ### Cursor Page: https://aifordevs.org/platforms#cursor | Markdown: https://aifordevs.org/platforms/cursor.md AI code editor built on VS Code, with tab completion, an agent mode, and background agents. - Maker: Anysphere - Category: Coding agents - Website: https://cursor.com - Tags: editor, agent ### Gemini CLI Page: https://aifordevs.org/platforms#gemini-cli | Markdown: https://aifordevs.org/platforms/gemini-cli.md Open-source terminal agent that runs on Gemini models and supports MCP servers. - Maker: Google - Category: Coding agents - Website: https://github.com/google-gemini/gemini-cli - Open source: yes - Tags: terminal, mcp ### GitHub Copilot Page: https://aifordevs.org/platforms#github-copilot | Markdown: https://aifordevs.org/platforms/github-copilot.md Completions, chat, and a coding agent that works from GitHub issues and opens pull requests. - Maker: GitHub - Category: Coding agents - Website: https://github.com/features/copilot - Tags: editor, github ## Agent frameworks ### AI SDK Page: https://aifordevs.org/platforms#vercel-ai-sdk | Markdown: https://aifordevs.org/platforms/vercel-ai-sdk.md TypeScript toolkit for streaming text, structured output, and tool calls across many providers. - Maker: Vercel - Category: Agent frameworks - Website: https://github.com/vercel/ai - Open source: yes - Tags: typescript, streaming ### CrewAI Page: https://aifordevs.org/platforms#crewai | Markdown: https://aifordevs.org/platforms/crewai.md Python framework for teams of role-based agents and event-driven flows. - Maker: CrewAI - Category: Agent frameworks - Website: https://github.com/crewAIInc/crewAI - Open source: yes - Tags: python, multi-agent ### LangChain Page: https://aifordevs.org/platforms#langchain | Markdown: https://aifordevs.org/platforms/langchain.md Integrations and building blocks for LLM apps: models, retrievers, tools, and agent loops. - Maker: LangChain - Category: Agent frameworks - Website: https://github.com/langchain-ai/langchain - Open source: yes - Tags: python, typescript ### LangGraph Page: https://aifordevs.org/platforms#langgraph | Markdown: https://aifordevs.org/platforms/langgraph.md Build agents as stateful graphs with checkpoints, human-in-the-loop steps, and streaming. - Maker: LangChain - Category: Agent frameworks - Website: https://github.com/langchain-ai/langgraph - Open source: yes - Tags: python, typescript, stateful ### LlamaIndex Page: https://aifordevs.org/platforms#llamaindex | Markdown: https://aifordevs.org/platforms/llamaindex.md Framework for agents over your data, with document parsing, indexing, and retrieval built in. - Maker: LlamaIndex - Category: Agent frameworks - Website: https://github.com/run-llama/llama_index - Open source: yes - Tags: rag, python ### OpenAI Agents SDK Page: https://aifordevs.org/platforms#openai-agents-sdk | Markdown: https://aifordevs.org/platforms/openai-agents-sdk.md Lightweight SDK for agents with handoffs, guardrails, sessions, and built-in tracing. - Maker: OpenAI - Category: Agent frameworks - Website: https://github.com/openai/openai-agents-python - Open source: yes - Tags: python, typescript ### Pydantic AI Page: https://aifordevs.org/platforms#pydantic-ai | Markdown: https://aifordevs.org/platforms/pydantic-ai.md Type-safe Python agent framework from the Pydantic team, with validated structured outputs. - Maker: Pydantic - Category: Agent frameworks - Website: https://github.com/pydantic/pydantic-ai - Open source: yes - Tags: python, typed ## Gateways ### Bifrost Page: https://aifordevs.org/platforms#bifrost | Markdown: https://aifordevs.org/platforms/bifrost.md Open-source AI gateway written in Go, with one API for many providers plus failover, caching, and governance. - Maker: Maxim AI - Category: Gateways - Website: https://github.com/maximhq/bifrost - Open source: yes - Tags: go, mcp gateway ### Cloudflare AI Gateway Page: https://aifordevs.org/platforms#cloudflare-ai-gateway | Markdown: https://aifordevs.org/platforms/cloudflare-ai-gateway.md Managed gateway on Cloudflare's network with caching, rate limiting, retries, and analytics. - Maker: Cloudflare - Category: Gateways - Website: https://developers.cloudflare.com/ai-gateway/ - Tags: managed, edge ### LiteLLM Page: https://aifordevs.org/platforms#litellm | Markdown: https://aifordevs.org/platforms/litellm.md Python SDK and proxy server that call many providers through the OpenAI format. - Maker: BerriAI - Category: Gateways - Website: https://github.com/BerriAI/litellm - Open source: yes - Tags: python, proxy ## Observability and evals ### Langfuse Page: https://aifordevs.org/platforms#langfuse | Markdown: https://aifordevs.org/platforms/langfuse.md Open-source LLM engineering platform for tracing, prompt management, and evaluations. - Maker: Langfuse - Category: Observability and evals - Website: https://github.com/langfuse/langfuse - Open source: yes - Tags: tracing, self-hostable ### Maxim AI Page: https://aifordevs.org/platforms#maxim-ai | Markdown: https://aifordevs.org/platforms/maxim-ai.md Platform for simulating, evaluating, and observing AI agents before and after release. - Maker: Maxim AI - Category: Observability and evals - Website: https://www.getmaxim.ai - Tags: evals, simulation ### Phoenix Page: https://aifordevs.org/platforms#arize-phoenix | Markdown: https://aifordevs.org/platforms/arize-phoenix.md Source-available tracing and evaluation tool built on OpenTelemetry, which you can run locally. - Maker: Arize AI - Category: Observability and evals - Website: https://github.com/Arize-ai/phoenix - Tags: opentelemetry, tracing ## Vector databases ### Chroma Page: https://aifordevs.org/platforms#chroma | Markdown: https://aifordevs.org/platforms/chroma.md Embedding database that runs in-process for prototypes and as a server or cloud service in production. - Maker: Chroma - Category: Vector databases - Website: https://github.com/chroma-core/chroma - Open source: yes - Tags: python, embedded ### Milvus Page: https://aifordevs.org/platforms#milvus | Markdown: https://aifordevs.org/platforms/milvus.md Distributed vector database built for billions of vectors, with GPU-accelerated indexes. - Maker: Zilliz - Category: Vector databases - Website: https://github.com/milvus-io/milvus - Open source: yes - Tags: distributed, scale ### pgvector Page: https://aifordevs.org/platforms#pgvector | Markdown: https://aifordevs.org/platforms/pgvector.md Postgres extension for vector similarity search, so embeddings live next to your relational data. - Maker: pgvector - Category: Vector databases - Website: https://github.com/pgvector/pgvector - Open source: yes - Tags: postgres ### Pinecone Page: https://aifordevs.org/platforms#pinecone | Markdown: https://aifordevs.org/platforms/pinecone.md Managed serverless vector database with namespaces, metadata filtering, and hybrid search. - Maker: Pinecone - Category: Vector databases - Website: https://www.pinecone.io - Tags: managed, serverless ### Qdrant Page: https://aifordevs.org/platforms#qdrant | Markdown: https://aifordevs.org/platforms/qdrant.md Vector database written in Rust, with payload filtering and a managed cloud option. - Maker: Qdrant - Category: Vector databases - Website: https://github.com/qdrant/qdrant - Open source: yes - Tags: rust, filtering ### Weaviate Page: https://aifordevs.org/platforms#weaviate | Markdown: https://aifordevs.org/platforms/weaviate.md Vector database with built-in hybrid search and modules for generating embeddings. - Maker: Weaviate - Category: Vector databases - Website: https://github.com/weaviate/weaviate - Open source: yes - Tags: hybrid search ## Cite the directory AI for Devs. "AI for Devs platform directory." https://aifordevs.org/platforms - Page: https://aifordevs.org/platforms - Markdown: https://aifordevs.org/platforms.md - Reuse: Quote or summarize with a link to this page. Terms: https://aifordevs.org/reuse - Publisher: AI for Devs