Skrape

Start for free: 50 requests, no credit card requiredTransform any websiteinto structured dataTurn any website into structured JSON or Markdown. The API for developers building AI agents, RAG pipelines, and data products.Press  T  anytime to start a free trial.https://Demo mode: Using example URLTry it JSONMarkdownCrawlGet startedExamplesFeatured onAITools.incProduct HuntBuilt for the AI era.From training data to real-time context, we handle the messy web so you can focus on the intelligence.RAG DatasetsTurn websites into structured context for your RAG applications.Clean content extractionMetadata captureConsistent formattingReal-time updatesLLM TrainingBuild high-quality, diverse datasets for fine-tuning models.Custom training corporaDomain-specific dataMultilingual supportStructured examplesKnowledge BasesAggregate documentation and wikis into a unified knowledge source.Tech docsAPI referencesTutorialsResearch papersMarket IntelligenceMonitor competitors, news, and trends with automated extraction.News aggregationCompetitor trackingTrend analysisPrice monitoringBenchmarksGather real-world data to evaluate model performance.Performance testingEdge case discoveryQuality assuranceValidation setsDocumentationConvert technical docs into standardized formats for AI consumption.API specsDeveloper guidesCode snippetsSDK referencesEverything you need to scale.Reliable, stealthy, and fast. We handle the infrastructure so you can focus on the data.Smart Crawling & NavigationIntelligent crawling that navigates websites naturally. We handle robots.txt, sitemaps, and complex pagination structures automatically so you get complete coverage.Headless BrowserFull JavaScript rendering support. We wait for network idle and hydration to ensure we capture the full page state, including SPAs and dynamic content.await page.goto(url);await page.waitForNetworkIdle();const content = await page.content();Clean MarkdownOptimized for LLMs. We strip clutter and convert HTML into semantic Markdown.Real-time DataLive extraction on every request. No stale caches—just fresh intelligence.InteractionsSimulate user behavior. Click, scroll, type, and wait to bypass gates.Type-Safe Structured DataDefine a Zod schema and get validated, strictly typed JSON back. We handle the parsing logic so you don't have to write complex selectors.// schema.tsz.object({title: z.string(),price: z.number(),stock: z.boolean()})Simple, transparent pricingStart with our free tier and scale as you growStart Free TrialTry our service with 50 free credits. No commitment required.No credit card required5 requests per 10 secondsStart Free TrialStarterPerfect for small projects and individual developers$15/month3,000 pages per month3,000 credits per month10 requests per 10 secondsHTML to Markdown (1 credit/page)AI Data Extraction (5 credits/page)Web Crawling (1 credit/page)Get StartedGrowthFor growing teams and increased usage$50/month10,000 pages per month10,000 credits per month20 requests per 10 secondsHTML to Markdown (1 credit/page)AI Data Extraction (5 credits/page)Web Crawling (1 credit/page)Priority supportGet StartedProIdeal for growing businesses and teams$250/month50,000 pages per month50,000 credits per month30 requests per 10 secondsHTML to Markdown (1 credit/page)AI Data Extraction (5 credits/page)Web Crawling (1 credit/page)Priority supportCustom rate limits availableGet StartedReady to transform web data?Start extracting clean, structured data from any website with our powerful API.Get Started FreeView Documentation --- Open Search Search Keyboard Shortcut:Command⌘ k Open API Client Powered by Scalar No document selected --- Open Search Search Keyboard Shortcut:Command⌘ kIntroductionOpen IntroductionmarkdownClose Group Convert URL to MarkdownHTTP Method:  POSTBulk URL to Markdown ConversionHTTP Method:  POSTextractionOpen Group crawlOpen Group jobsOpen Group systemOpen Group Open API Client Powered by Scalar v1.0.0OAS 3.0.0Skrape API Download OpenAPI Document json Download OpenAPI Document yaml Introduction Skrape is a powerful web scraping and content extraction API that helps you turn any webpage into structured data or clean markdown. Key Features Convert webpages to clean markdown Extract structured data using LLMs Crawl multiple pages efficiently Handle JavaScript-rendered content Background job processing Authentication All API endpoints require authentication using a Bearer token: Sign up at skrape.ai Get your API key from the dashboard Add the token in Authorization header: Bearer YOUR_API_KEY Error Handling All errors follow a consistent format: { "error": "ERROR_CODE", "message": "Human readable message", "requestId": "req_abc123" } Common error codes: VALIDATION_ERROR: Invalid input AUTH_ERROR: Invalid API key INTERNAL_ERROR: Server error Client Libraries For a better development experience, use our official SDKs: Node.js SDK Python SDK Support Need help? Contact us at support@skrape.ai Server Server:https://skrape.aiAuthenticationRequiredSelected Auth Type: BearerAuth Enter your API key here Bearer Token : Show Password Client Libraries ShellRubyNode.jsPHPPython More Select from all clientsShell Curlmarkdown ​Copy linkmarkdown Operations post/api/markdown post/api/markdown/bulkShow sidebarSearchmarkdownClose Group Convert URL to MarkdownHTTP Method:  POSTClose Group defaultBulk URL to Markdown ConversionHTTP Method:  POSTOpen Group extractionOpen Group crawlOpen Group jobsOpen Group systemOpen Group POSTServer: https://skrape.ai/api/markdownCopy URLSend Send post request to https://skrape.ai/api/markdown Open API Client Close ClientConvert URL to MarkdownAllAuthCookiesHeadersQueryBodyAllAuthenticationRequiredSelected Auth Type: BearerAuth Enter your API key here Bearer Token : Show PasswordVariables Enabled Key ValueCookies Enabled Key ValueKeyValueHeaders Clear All Headers Enabled Key ValueContent-Typeapplication/jsonAcceptapplication/jsonKeyValueQuery Parameters Enabled Key ValueKeyValueRequest BodyJSON Press Esc then Tab to exit 99123456789101112131415{ "url": "https://news.ycombinator.com/item?id=123456", "options": { "renderJs": true, "selector": "article", "actions": [ { "scroll": 800 }, { "wait": 500 } ] }}Code Snippet (Collapsed) Shell Curl Response AllCookiesHeadersBodyAll Powered By Scalar.com .,,uod8B8bou,,. ..,uod8BBBBBBBBBBBBBBBBRPFT?l!i:. ||||||||||||||!?TFPRBBBBBBBBBBBBBBB8m=, |||| '""^^!!||||||||||TFPRBBBVT!:...! |||| '""^^!!|||||?!:.......! |||| ||||.........! |||| ||||.........! |||| ||||.........! |||| ||||.........! |||| ||||.........! |||| ||||.........! ||||, ||||.........` |||||!!-._ ||||.......;. ':!|||||||||!!-._ ||||.....bBBBBWdou,. bBBBBB86foi!|||||||!!-..:|||!..bBBBBBBBBBBBBBBY! ::!?TFPRBBBBBB86foi!||||||||!!bBBBBBBBBBBBBBBY..! :::::::::!?TFPRBBBBBB86ftiaabBBBBBBBBBBBBBBY....! :::;`"^!:;::::::!?TFPRBBBBBBBBBBBBBBBBBBBY......! ;::::::...''^::::::::::!?TFPRBBBBBBBBBBY........! .ob86foi;::::::::::::::::::::::::!?TFPRBY..........` .b888888888886foi;:::::::::::::::::::::::..........` .b888888888888888888886foi;::::::::::::::::...........b888888888888888888888888888886foi;:::::::::......`!Tf998888888888888888888888888888888886foi;:::....` '"^!|Tf9988888888888888888888888888888888!::..` '"^!|Tf998888888888888888888888889!! '` '"^!|Tf9988888888888888888!!` iBBbo. '"^!|Tf998888888889!` WBBBBbo. '"^!|Tf9989!` YBBBP^' '"^!` ` Send Request ⌘Command↵Enter