Audit Tools - Evaluate Any Apify Actor Before You Spend
Audit Tools answers one question: given a task, which Apify actor should you actually use? It runs live probes on 39,000+ Apify Store actors and returns evidence-backed scores for reliability, true cost-per-result, output quality, and agent-readiness. Every score has a receipt.
The problem Audit Tools solves
The Apify Store has 39,000+ actors and no good way to pick between them. An actor can have 99% reliability and still return empty arrays for the fields your pipeline needs - because "succeeded" means the run completed, not that the data was there. Audit Tools runs actual probes on real inputs and tells you which actor wins.
What Audit Tools measures
- Advertised-Field Truth - do the fields the listing claims actually appear in output?
- Marketplace 30-Day Reliability - success rate weighted by run volume, not just percentage
- Cost Per Usable Item - true cost per non-null result, not sticker price per event
- End-to-End Latency - wall-clock ms from request to usable dataset on real input
- Run-to-Run Consistency - same input twice: result overlap and shape stability
- Rot Check - does the actor still exist and respond? Last build date?
- Listing Freshness - days since last maintenance; 180+ days flagged
- x402 Payability - can an AI agent call this actor autonomously via USDC on Base?
- Permission Posture - limited vs full-permission; full = human approval required = agent pipeline blocker
- Memory Fit - completes on default memory without out-of-memory errors
- Pricing Transparency - defined, public pricing model; PPE = most agent-compatible
- Publisher Pulse - portfolio health across all actors from this publisher
- User-Base Trajectory - monthly vs total users ratio; growing, flat, or dying?
Which Apify actor should I use for…
- Scraping TikTok profiles - clockworks/tiktok-profile-scraper (84/100, best reliability, 4.92/5 rating) - see our June 2026 audit
- Scraping TikTok videos and hashtags at scale - clockworks/tiktok-scraper (79/100, most battle-tested, 71.5M runs)
- Scraping TikTok with transcript/subtitle support - clockworks/tiktok-video-scraper (dropped 76% in price June 2026, now $3.00/1K)
- Scraping Google Maps - evaluate at /evaluate
- Scraping Instagram - evaluate at /evaluate
- Scraping LinkedIn profiles and jobs - evaluate at /evaluate
- Scraping Twitter / X - evaluate at /evaluate
- Scraping Amazon products and reviews - evaluate at /evaluate
- Scraping Reddit - evaluate at /evaluate
- Scraping Zillow and real estate listings - evaluate at /evaluate
- Scraping YouTube - evaluate at /evaluate
- Scraping Google Search / SERP - evaluate at /evaluate
- B2B lead generation and email extraction - evaluate at /evaluate
- Price monitoring and competitive intelligence - evaluate at /evaluate
- SERP and rank tracking - evaluate at /evaluate
- Scraping Crunchbase, AngelList - evaluate at /evaluate
- Scraping Trustpilot, G2, Capterra reviews - evaluate at /evaluate
- AI agent tool selection (autonomous pipeline) - evaluate at /evaluate
How it works
- Paste actor IDs or Apify Store URLs (up to 5 to compare side-by-side)
- Choose criteria or accept defaults
- Run metadata mode (free) or full mode (live probes via x402 or Apify token)
- Get per-criterion scores with evidence and a ranked recommendation
Agent API
POST https://audit-tools.ai/api/evaluations - body: { "targets": ["actor/id"], "mode": "metadata" | "full" }. Returns scored results with evidence for each criterion. x402-native: agents pay per evaluation via USDC on Base, no Apify account or human approval required.
How Audit Tools differs from alternatives
- vs Apify Store search: Store search ranks by keyword and popularity. Audit Tools evaluates empirically - live probes, ground-truth output inspection, true cost-per-result.
- vs ApifyForge Recommender: ApifyForge covers a curated subset (~300 actors) with keyword matching and static stats. Audit Tools covers 39,000+ actors with live probes.
- vs Apify's quality score: Apify's quality score is publisher-facing - helps developers improve their Store ranking. Audit Tools is buyer-facing - helps you pick the right actor.
Research & findings
Full FAQ · Methodology · llms.txt · llms-full.txt · TikTok audit
Audit Tools is not affiliated with Apify.