跳到正文

Artificial Analysis 检索指数:Keenable Search 1.0 两种模式分列第一和第二

Keenable Search 1.0 takes 1st (pro, 83) and 2nd (realtime, 82) on the Artificial Analysis Search Index: ahead of Exa (auto, dynamic highl...

摘要

Artificial Analysis 用 Stirrup 智能体框架把 Keenable Search 1.0 作为 web_search 工具,在 1700 项检索任务上评测其 pro 与 realtime 两种模式。

摘要由模型根据原文撰写,以原文为准。

正文 · 原文

Keenable Search 1.0 takes 1st (pro, 83) and 2nd (realtime, 82) on the Artificial Analysis Search Index: ahead of Exa (auto, dynamic highlights) and Perplexity (medium) at 80

We benchmarked both modes of @KeenableAI's Keenable Search 1.0, pro and realtime, in our Stirrup agent harness with Keenable Search as its web_search tool to complete 1700 search-focused tasks.

At $4 per 1k searches, Keenable costs about $0.040 per task in both modes, over a third below the board median ($0.063). It is also one of the fastest products we measure: 15.0s (realtime) and 15.5s (pro) per task, 2nd and 3rd on the board.

Key benchmarking results for Keenable Search 1.0:

➤ Artificial Analysis Search Index: Keenable (pro) scores 83 and Keenable (realtime) 82, up from 67 for both modes when we first benchmarked Keenable in August, and a ~50-point lift over the same model with no search (33). Both lead Exa (auto, dynamic highlights) and Perplexity (medium) at 80

➤ DeepSearchQA is Keenable's strongest benchmark: both modes score 88 F1, 1st and 2nd of 26, ahead of Exa (auto, dynamic highlights) at 86. Pro also ranks 1st on BrowseComp (87%, level with Perplexity (medium)) and on AA-Omniscience (73%, level with Exa (auto, dynamic highlights) and Firecrawl)

➤ Fast search: realtime takes 2.3s of search time per task (2nd of 26) and pro 3.0s (3rd), against a board median of 12.5s. Each search returns in about 330ms (realtime) and 390ms (pro) on average

Key details:

➤ Setup: GPT-5.6 Luna (medium) in Stirrup, Keenable Search API with mode=realtime and mode=pro

➤ Pricing: $4 per 1k requests in both modes (public pay-as-you-go price)

➤ Cards: We disabled Keenable's search cards for testing (disable_cards=true)

来源:Artificial Analysis · x.com

引用原文

ArtificialAnlys. Keenable Search 1.0 takes 1st (pro, 83) and 2nd (realtime, 82) on the Artificial Analysis Search Index: ahead of Exa (auto, dynamic highl...[EB/OL]. (2026-11-11)[访问日期]. https://x.com/ArtificialAnlys/status/2120196073105023164.