BenchGecko

Reviewed 1d ago.

• tools: 9 tools scanned
• metadata: scanned

No findings.

Tools (9)

• search_models

  Find AI models in the BenchGecko catalog by name, slug or lab. Returns slugs to use with get_model, cheapest_provider and compare_models, with BenchGecko score and list price.

• get_model

  Core facts for one AI model: BenchGecko score and rank, list price, price at every provider, benchmark scores with their original sources, Gecko Tests grades and as-of dates.

• cheapest_provider

  Every provider serving a model, sorted by input price per 1M tokens (refreshed daily from provider endpoints), with output price, quantization and 1 day uptime.

• compare_models

  Side by side: BenchGecko score, list price, cheapest provider, context window, shared benchmark scores and Gecko Tests grades for two models.

• get_gecko_test

  Results of one of BenchGecko's own tests (own measurements, CC BY 4.0): who-are-you (Does the model know which lab made it?) world-map (How well does the model draw the world map from memory?) censorship-index (How often does the model refuse legitimate questions?) knowledge-horizon (Where does the model's knowledge of world events actually stop?) tokenizer-tax (How many more tokens does the same text cost outside English?) same-model-different-host (Do providers serving the same open model give the same quality?) model-drift-index (Do models quietly change behind the same name?)

• get_scorecard

  BenchGecko Gecko Scorecard: every model across BenchGecko's own profile tests with a letter grade per test and an overall Gecko Score (behavior, not intelligence).

• latest_findings

  Latest notable results detected in the Gecko Tests and price data (fixed rules, numbers and quotes from stored results).

• search

  Search BenchGecko models and Gecko Tests. Returns ids for fetch.

• fetch

  Fetch the full record for an id returned by search (model:<slug>, gecko-test:<slug> or scorecard).