University of Kwazulu-Natal

Llm Leaderboard Compare Check Latest Api Prices For Llms

Bonisiwe Shabane
-
llm leaderboard compare check latest api prices for llms

Sponsor Price Per Token— Reach 5000+ developers comparing LLM APIs 115 out of our 301 tracked models have had a price change in January. Make informed model choices with updates on pricing, new releases, and tools with our weekly newsletter. * Some models use tiered pricing based on prompt length. Displayed prices are for prompts under 200k tokens. Pricing from OpenRouter.

Benchmarks from Artificial Analysis and HuggingFace Open LLM Leaderboard. Compare and check the latest prices for LLM (Large Language Model) APIs from leading providers such as OpenAI, Mistral, Anthropic, Google, Meta, Perplexity, and more. Evaluate and rank the performance of over 50+ AI models (LLMs) across key metrics, including quality, context window, price, knowledge cutoff, and others. This in-depth comparison allows users to easily identify the best-suited LLM for their specific needs and budget. Quality: The highest quality models are GPT-4o and Llama 3.1 405B. These are followed by Claude 3.5 Sonnet and Llama 3.1 70B.

Context Window: The models with the largest context windows are Gemini 1.5 Pro (2 Million) and Gemini 1.5 Flash (1 Million). These are followed by Codestral-Mamba and Jamba Instruct. Price ($ per M tokens): OpenChat 3.5 ($0.14) and Phi-3 Medium 14B ($0.14) are the cheapest models, followed by Gemma 7B and Llama 3.1 8B. The LLM Leaderboard is a comprehensive tool designed to compare various Large Language Models (LLMs) based on multiple key metrics such as performance on benchmarks, specific capabilities, price, and other relevant factors. Compare cost per token across all major LLM providers interactively. Use this live comparison table to explore and compare pricing details for popular LLM APIs like OpenAI, Claude, Gemini, and Mistral.

Easily sort and filter by provider, context window, and token pricing — all prices shown per 500, 1000, or 1M tokens. 🔎 Want to check our data sources? View all provider documentation. We’re just getting started. This project is evolving — soon you’ll find: All prices are displayed in USD ($).

Chinese model prices (RMB) have been converted at an approximate rate of $1 ≈ ¥7.2 for easier comparison. Click on the Input or Output column headers to sort models by price. This helps find the most cost-effective solution for your specific workload. Providers like Anthropic and DeepSeek offer Context Caching. If you reuse large prompts often, input costs can be reduced by up to 90%. This LLM leaderboard displays the latest public benchmark performance for SOTA model versions released after April 2024.

The data comes from model providers as well as independently run evaluations by Vellum or the open-source community. We feature results from non-saturated benchmarks, excluding outdated benchmarks (e.g. MMLU). If you want to use these models in your agents, try Vellum. Compare leading LLMs across all evaluation categories — or focus on a single dimension like safety, jailbreak resistance, performance, or cost. See how they perform across every evaluation category, including safety, jailbreak resistance, performance, coding, mathematical reasoning, and cost.

Choose a single evaluation category — for example, safety, jailbreak resistance, or cost and compare up to seven models to see which performs best in that specific area. Choose up to 7 models from the dropdown above to see their benchmark comparison Compare and calculate the latest prices for LLM (Large Language Models) APIs from leading providers such as OpenAI GPT-4, Anthropic Claude, Google Gemini, Mate Llama 3, and more. Use our streamlined LLM Price Check tool to start optimizing your AI budget efficiently today!

People Also Search

Sponsor Price Per Token— Reach 5000+ Developers Comparing LLM APIs

Sponsor Price Per Token— Reach 5000+ developers comparing LLM APIs 115 out of our 301 tracked models have had a price change in January. Make informed model choices with updates on pricing, new releases, and tools with our weekly newsletter. * Some models use tiered pricing based on prompt length. Displayed prices are for prompts under 200k tokens. Pricing from OpenRouter.

Benchmarks From Artificial Analysis And HuggingFace Open LLM Leaderboard. Compare

Benchmarks from Artificial Analysis and HuggingFace Open LLM Leaderboard. Compare and check the latest prices for LLM (Large Language Model) APIs from leading providers such as OpenAI, Mistral, Anthropic, Google, Meta, Perplexity, and more. Evaluate and rank the performance of over 50+ AI models (LLMs) across key metrics, including quality, context window, price, knowledge cutoff, and others. This...

Context Window: The Models With The Largest Context Windows Are

Context Window: The models with the largest context windows are Gemini 1.5 Pro (2 Million) and Gemini 1.5 Flash (1 Million). These are followed by Codestral-Mamba and Jamba Instruct. Price ($ per M tokens): OpenChat 3.5 ($0.14) and Phi-3 Medium 14B ($0.14) are the cheapest models, followed by Gemma 7B and Llama 3.1 8B. The LLM Leaderboard is a comprehensive tool designed to compare various Large L...

Easily Sort And Filter By Provider, Context Window, And Token

Easily sort and filter by provider, context window, and token pricing — all prices shown per 500, 1000, or 1M tokens. 🔎 Want to check our data sources? View all provider documentation. We’re just getting started. This project is evolving — soon you’ll find: All prices are displayed in USD ($).

Chinese Model Prices (RMB) Have Been Converted At An Approximate

Chinese model prices (RMB) have been converted at an approximate rate of $1 ≈ ¥7.2 for easier comparison. Click on the Input or Output column headers to sort models by price. This helps find the most cost-effective solution for your specific workload. Providers like Anthropic and DeepSeek offer Context Caching. If you reuse large prompts often, input costs can be reduced by up to 90%. This LLM lea...