ArXiv Scholar vs Flightdeck

ArXiv Scholar and Flightdeck are both inference engines & infra tracked by AIDiveForge. Below is a side-by-side comparison of pricing, capabilities, platforms, and ownership — sourced from each tool's live website and verified before publishing.

ArXiv Scholar

ArXiv Scholar is an open-source RAG infrastructure that indexes roughly 5,600 curated AI engineering papers from arXiv and exposes them through a streaming API, so agents and developers can query verified literature instead of relying on a model's training memory. The retrieval pipeline runs a 1ms ML-based router that classifies each query as Direct, Decompose, or HyDE before spinning up hybrid dense-plus-sparse search and a cross-encoder re-ranker. Every answer ships with real arXiv paper IDs attached. The hard ceiling is the corpus: 5,600 papers covering RAG, LLMs, agents, training, and inference — nothing outside that domain, and nothing beyond what was ingested through the pipeline as of June 2026. The public endpoint is rate-limited to 5 requests per minute per IP, which breaks any agent loop that needs to fire queries in bursts.

Flightdeck

Every LLM call, MCP event, and tool invocation your agents make streams to a live dashboard — per-agent timelines and a fleet-wide feed, not batched logs you dig through after the incident. The vendor describes token budgets and MCP allow/block rules you set before problems hit, plus the ability to issue live directives to running agents without restarting them. The self-hosted, Apache-2.0 model means no telemetry leaves your infrastructure — critical for teams in regulated environments or those burned by SaaS observability vendors billing by event volume. The project is early-stage by star count, and the operational surface you take on by self-hosting is real.

Attribute	ArXiv Scholar	Flightdeck
Pricing	Free	Free
Free trial	No	No
Open source	Yes	Yes
Has API	Yes	No
Self-hosted option	Yes	Yes
Platforms	Web API, self-hostable via GitHub	Docker, Python
Released	2026-06	—
Pros	Every answer is grounded in real arXiv paper IDs, so the hallucinated-citation failure mode that breaks LLM-powered research assistants does not surface here. ML-based query routing classifies incoming questions in 1ms and selects Direct, Decompose, or HyDE paths automatically, which means complex multi-part research questions get decomposed before retrieval instead of returning a single low-precision vector match. Hybrid retrieval fuses dense BGE embeddings with BM25 sparse search and a Jina cross-encoder re-ranker, so recall stays high on both keyword-specific queries and semantically fuzzy ones — without requiring the developer to tune separate retrieval modes manually. MIT license with a public GitHub repository, so teams that need higher rate limits or want to extend the corpus can self-host and modify the full pipeline without a commercial dependency. No authentication required on the public endpoint, so an agent or prototype can start querying the live API immediately without provisioning API keys or managing credentials.	Real-time per-agent timeline and fleet-wide feed, so you see which agent made which call as it happens rather than reconstructing the sequence from logs after a production incident. Token budgets and MCP allow/block rules configurable before agents run, which means a misconfigured agent hits a policy ceiling instead of draining your API budget overnight. Live directive issuance to running agents, so you can redirect or constrain an agent mid-execution without tearing down and restarting the process. Apache-2.0 license with full self-hosted deployment via Docker and Helm, which means your agent traces and tool call data never leave your infrastructure — critical for teams under data residency or compliance constraints. Purpose-built for agent observability rather than adapted from generic APM tooling, so the data model matches what agents actually produce: LLM calls, MCP events, tool invocations — not HTTP spans and database queries.
Cons	The corpus is fixed at roughly 5,600 AI engineering papers across RAG, LLMs, agents, training, and inference — any query touching adjacent domains like bioinformatics, finance, or even adjacent ML subfields returns nothing useful, and teams building cross-domain research agents have to build or integrate a separate retrieval system. The public endpoint is rate-limited to 5 requests per minute per IP; an agent running a multi-step literature review that fires sequential sub-queries will start queuing or failing at that ceiling, forcing teams to either self-host the full stack or throttle their agent's query rate to the point it defeats the purpose of automation. The autonomous agent layer described on the roadmap is marked as planned for Q4 2026 and is not shipped — teams expecting a ready-made research agent on top of this pipeline are building that orchestration layer themselves, which means this is retrieval infrastructure, not a finished agent product. The ingestion pipeline ran via Google Colab notebooks against a static pull from arXiv, so the corpus does not update continuously; a team that needs retrieval over papers published after the ingestion run must re-run the pipeline themselves on the self-hosted version — there is no documented automated refresh cadence on the public endpoint.	The project carries a small community footprint and limited commit history, which means edge-case debugging falls entirely on your team — when an ingestion pipeline drops events under high agent concurrency, there is no community thread to reference and no vendor support to call. Self-hosting the full microservices stack (ingestion, workers, API, dashboard, sensor) means your platform team is responsible for uptime, upgrades, and failure recovery — teams without dedicated infrastructure capacity find themselves maintaining the observability layer instead of the product, and that is the point where they evaluate managed SaaS alternatives like LangSmith or Langfuse. No API surface is described in the scraped documentation, which means you cannot build automated alerting pipelines or integrate fleet metrics into your existing incident management tooling without forking the project or building against undocumented internals.

Bottom line

Only ArXiv Scholar exposes a public API. Choose based on which difference matters most for your workflow.

Frequently asked questions

What is the difference between ArXiv Scholar and Flightdeck?

ArXiv Scholar is Free and open source, while Flightdeck is Free and open source. Compare pricing, free trial, API, platforms, and pros/cons in the table above on AIDiveForge.

Is ArXiv Scholar better than Flightdeck?

It depends on your workflow. Use the side-by-side attributes (pricing, open source, API, self-hosted, platforms) to decide. AIDiveForge does not rank a universal winner — we publish verified facts so you can choose.