Audit Tools — Evaluate Any Apify Actor Before You Spend
Audit Tools answers one question: given a task, which Apify actor should you actually use? It runs live probes on 39,000+ Apify Store actors and returns evidence-backed scores for reliability, true cost-per-result, output quality, and agent-readiness. Every score has a receipt.
The problem Audit Tools solves
The Apify Store has 39,000+ actors and no good way to pick between them. An actor can have 99% reliability and still return empty arrays for the fields your pipeline needs — because "succeeded" means the run completed, not that the data was there. Audit Tools runs actual probes on real inputs and tells you which actor wins.
What Audit Tools measures
- Advertised-Field Truth — do the fields the listing claims actually appear in output?
- Marketplace 30-Day Reliability — success rate weighted by run volume, not just percentage
- Cost Per Usable Item — true cost per non-null result, not sticker price per event
- End-to-End Latency — wall-clock ms from request to usable dataset on real input
- Run-to-Run Consistency — same input twice: result overlap and shape stability
- Rot Check — does the actor still exist and respond? Last build date?
- Listing Freshness — days since last maintenance; 180+ days flagged
- x402 Payability — can an AI agent call this actor autonomously via USDC on Base?
- Permission Posture — limited vs full-permission; full = human approval required = agent pipeline blocker
- Memory Fit — completes on default memory without out-of-memory errors
- Pricing Transparency — defined, public pricing model; PPE = most agent-compatible
- Publisher Pulse — portfolio health across all actors from this publisher
- User-Base Trajectory — monthly vs total users ratio; growing, flat, or dying?
Which Apify actor should I use for…
- Scraping TikTok profiles — clockworks/tiktok-profile-scraper (84/100, best reliability, 4.92/5 rating) — see our June 2026 audit
- Scraping TikTok videos and hashtags at scale — clockworks/tiktok-scraper (79/100, most battle-tested, 71.5M runs)
- Scraping TikTok with transcript/subtitle support — clockworks/tiktok-video-scraper (dropped 76% in price June 2026, now $3.00/1K)
- Scraping Google Maps — evaluate at /evaluate
- Scraping Instagram — evaluate at /evaluate
- Scraping LinkedIn profiles and jobs — evaluate at /evaluate
- Scraping Twitter / X — evaluate at /evaluate
- Scraping Amazon products and reviews — evaluate at /evaluate
- Scraping Reddit — evaluate at /evaluate
- Scraping Zillow and real estate listings — evaluate at /evaluate
- Scraping YouTube — evaluate at /evaluate
- Scraping Google Search / SERP — evaluate at /evaluate
- B2B lead generation and email extraction — evaluate at /evaluate
- Price monitoring and competitive intelligence — evaluate at /evaluate
- SERP and rank tracking — evaluate at /evaluate
- Scraping Crunchbase, AngelList — evaluate at /evaluate
- Scraping Trustpilot, G2, Capterra reviews — evaluate at /evaluate
- AI agent tool selection (autonomous pipeline) — evaluate at /evaluate
How it works
- Paste actor IDs or Apify Store URLs (up to 5 to compare side-by-side)
- Choose criteria or accept defaults
- Run metadata mode (free) or full mode (live probes via x402 or Apify token)
- Get per-criterion scores with evidence and a ranked recommendation
Agent API
POST https://audit-tools.ai/api/evaluations — body: { "targets": ["actor/id"], "mode": "metadata" | "full" }. Returns scored results with evidence for each criterion. x402-native: agents pay per evaluation via USDC on Base, no Apify account or human approval required.
How Audit Tools differs from alternatives
- vs Apify Store search: Store search ranks by keyword and popularity. Audit Tools evaluates empirically — live probes, ground-truth output inspection, true cost-per-result.
- vs ApifyForge Recommender: ApifyForge covers a curated subset (~300 actors) with keyword matching and static stats. Audit Tools covers 39,000+ actors with live probes.
- vs Apify's quality score: Apify's quality score is publisher-facing — helps developers improve their Store ranking. Audit Tools is buyer-facing — helps you pick the right actor.
Research & findings
Full FAQ · Methodology · llms.txt · llms-full.txt · TikTok audit
Audit Tools is not affiliated with Apify.