Website to markdown to Notion with n8n
A page is filed again only when its URL is new or the length of its markdown changes, so a daily crawl adds new and edited pages without refiling the rest.
Put the site you want in startUrls in the request body and raise maxCrawlPages and maxCrawlDepth once a first small run looks right. The crawl respects the site's robots rules and keeps to the start domain, which suits documentation, help centres and blogs you want in a retrieval corpus.
Built-in nodes only Imports on n8n Cloud and self-hosted n8n 1.80 or later, no community nodes. 11 of 11 checks pass; validated, not executed.
- Source
- Any public website
- Destination
- Notion
- Store price
- $0.99 per 1,000 results (pay per event)
- Cost on the Free plan
- about $0.42 a run (start $0.40 + about 25 results; the input sets no limit, so more results cost more), about $12.74 a month daily, plus platform usage
- Data checked
- 2026-11-12
Method
-
Get an Apify token
Sign in to Apify and copy a personal API token from Console: Settings, API and integrations. The workflow keeps it in an n8n credential, never in the file.
-
Import the workflow
In n8n choose Workflows, Import from file, or paste the JSON onto an empty canvas.
- Run by hand
- Every day
- Run Apify Actor
- Only records not sent before
- Keep main fields
- Send to Notion
n8n workflowwebsite-to-markdown-to-notion.n8n.json
Show the file (239 lines)
{ "name": "Website to markdown to Notion", "nodes": [ { "id": "7ae13a1e-9c39-494d-aa13-a06c30f44d23", "name": "Run by hand", "type": "n8n-nodes-base.manualTrigger", "typeVersion": 1, "position": [ 0, 0 ], "parameters": {} }, { "id": "db9f5cce-ebde-42a7-a959-ea7ee228937b", "name": "Every day", "type": "n8n-nodes-base.scheduleTrigger", "typeVersion": 1.2, "position": [ 0, 200 ], "parameters": { "rule": { "interval": [ { "triggerAtHour": 8 } ] } }, "notes": "Activate the workflow to run on this schedule." }, { "id": "69301f72-d9d9-4438-a594-a2bd108f0457", "name": "Run Apify Actor", "type": "n8n-nodes-base.httpRequest", "typeVersion": 4.2, "position": [ 260, 100 ], "parameters": { "method": "POST", "url": "https://api.apify.com/v2/actors/vexaloom-labs~domain-scoped-site-crawler-for-markdown-datasets/run-sync-get-dataset-items", "authentication": "genericCredentialType", "genericAuthType": "httpHeaderAuth", "sendBody": true, "specifyBody": "json", "jsonBody": "{\n \"startUrls\": [\n {\n \"url\": \"https://docs.apify.com\"\n }\n ],\n \"maxCrawlDepth\": 1,\n \"maxCrawlPages\": 3,\n \"useSitemaps\": false,\n \"useLlmsTxt\": false,\n \"respectRobotsTxtFile\": true,\n \"keepUrlFragments\": false,\n \"ignoreCanonicalUrl\": false,\n \"outputFormat\": \"markdown\",\n \"htmlTransformer\": \"auto\",\n \"includeImages\": false,\n \"chunkMarkdown\": false,\n \"chunkMaxChars\": 2000,\n \"chunkOverlapChars\": 200,\n \"parsePdfText\": true,\n \"takeScreenshots\": false,\n \"storeSkippedUrls\": false\n}", "options": { "timeout": 310000 } }, "notes": "Actor: vexaloom-labs/domain-scoped-site-crawler-for-markdown-datasets. Select a Header Auth credential: name Authorization, value Bearer + your Apify token. Edit the JSON body to change the input.", "notesInFlow": false }, { "id": "e0c2145e-33df-4515-af0d-8a64f9b4f913", "name": "Only records not sent before", "type": "n8n-nodes-base.removeDuplicates", "typeVersion": 2, "position": [ 500, 100 ], "parameters": { "operation": "removeItemsSeenInPreviousExecutions", "logic": "removeItemsWithAlreadySeenKeyValues", "dedupeValue": "={{ $json.url }}#{{ String($json.markdown || '').length }}", "options": { "scope": "node", "historySize": 10000 } }, "notes": "Remembers each record it has passed on (up to 10,000) across runs, so a record is sent once. Needs n8n 1.64 or later." }, { "id": "fe097a76-92a9-487f-a7be-de9ec397d62b", "name": "Keep main fields", "type": "n8n-nodes-base.code", "typeVersion": 2, "position": [ 740, 100 ], "parameters": { "jsCode": "// Keeps the Actor's main fields as flat, spreadsheet-safe values.\nconst columns = [\"title\",\"url\",\"depth\",\"wordCount\",\"httpStatusCode\",\"markdown\"];\n// A dotted name such as author.name reads the nested value.\nconst read = (obj, key) => (key in obj ? obj[key] : key.split('.').reduce((v, part) => (v && typeof v === 'object' ? v[part] : undefined), obj));\nreturn $input.all().map((item) => {\n const row = {};\n const present = columns.filter((key) => read(item.json, key) !== undefined);\n // A record shaped differently from the published schema keeps its own fields rather than arriving blank.\n for (const key of present.length >= 2 ? present : Object.keys(item.json)) {\n const value = read(item.json, key);\n row[key] = value === null || value === undefined ? '' : typeof value === 'object' ? JSON.stringify(value) : value;\n }\n return { json: row };\n});" } }, { "id": "25dce6a6-883a-4faf-aef8-79fa0e375ab3", "name": "Send to Notion", "type": "n8n-nodes-base.notion", "typeVersion": 2.2, "position": [ 980, 100 ], "parameters": { "resource": "databasePage", "databaseId": { "__rl": true, "value": "", "mode": "list" }, "title": "={{ [$json.title].filter((v) => v !== undefined && v !== null && v !== '').join(': ') || 'Untitled' }}", "propertiesUi": { "propertyValues": [] }, "blockUi": { "blockValues": [ { "type": "paragraph", "textContent": "={{ [[\"url\", $json.url], [\"depth\", $json.depth], [\"wordCount\", $json.wordCount], [\"httpStatusCode\", $json.httpStatusCode]].filter(([, v]) => v !== undefined && v !== null && v !== '').map(([k, v]) => k + ': ' + (typeof v === 'object' ? JSON.stringify(v) : v)).join(' | ').slice(0, 1900) || ' ' }}" }, { "type": "paragraph", "textContent": "={{ String($json.markdown ?? '').slice(0, 1900) || ' ' }}" }, { "type": "paragraph", "textContent": "={{ String($json.markdown ?? '').slice(1900, 3800) || ' ' }}" }, { "type": "paragraph", "textContent": "={{ String($json.markdown ?? '').slice(3800, 5700) || ' ' }}" }, { "type": "paragraph", "textContent": "={{ String($json.markdown ?? '').slice(5700, 7600) || ' ' }}" }, { "type": "paragraph", "textContent": "={{ String($json.markdown ?? '').slice(7600, 9500) || ' ' }}" }, { "type": "paragraph", "textContent": "={{ String($json.markdown ?? '').slice(9500, 11400) || ' ' }}" }, { "type": "paragraph", "textContent": "={{ String($json.markdown ?? '').slice(11400, 13300) || ' ' }}" }, { "type": "paragraph", "textContent": "={{ String($json.markdown ?? '').slice(13300, 15200) || ' ' }}" } ] }, "options": {} }, "notes": "Pick your Notion database. Each page gets the record's main fields and the first 15200 characters of markdown as its content; map extra database properties if you want to filter on them." }, { "id": "b679bc4e-e393-4e2b-a94d-347e12fc4383", "name": "Setup", "type": "n8n-nodes-base.stickyNote", "typeVersion": 1, "position": [ 0, -370 ], "parameters": { "content": "## Domain-Scoped Site Crawler for Markdown Datasets\n\nSource: [vexaloom-labs/domain-scoped-site-crawler-for-markdown-datasets](https://apify.com/vexaloom-labs/domain-scoped-site-crawler-for-markdown-datasets) on Apify.\n\n1. In **Run Apify Actor**, create a Header Auth credential: name `Authorization`, value `Bearer YOUR_APIFY_TOKEN` with your token.\n2. Open **Send to Notion** and connect your Notion account.\n3. Edit the JSON body of **Run Apify Actor** to change the input.\n\nGenerated by recipeforagents.com. Validated, not executed: runs are billed to your Apify account.", "height": 340, "width": 460, "color": 6 } } ], "connections": { "Run by hand": { "main": [ [ { "node": "Run Apify Actor", "type": "main", "index": 0 } ] ] }, "Every day": { "main": [ [ { "node": "Run Apify Actor", "type": "main", "index": 0 } ] ] }, "Run Apify Actor": { "main": [ [ { "node": "Only records not sent before", "type": "main", "index": 0 } ] ] }, "Only records not sent before": { "main": [ [ { "node": "Keep main fields", "type": "main", "index": 0 } ] ] }, "Keep main fields": { "main": [ [ { "node": "Send to Notion", "type": "main", "index": 0 } ] ] } }, "pinData": {}, "active": false, "settings": { "executionOrder": "v1" }, "meta": { "templateCredsSetupCompleted": false }, "tags": [] }Validated, not executed: 11 of 11 checks pass
- It has a nodes array and a connections object
- Every node has a name, type, typeVersion, position and parameters
- Node names are unique
- Every node type is a known n8n core node (or the Apify node)
- Every node uses a typeVersion that n8n ships
- Every connection points at an existing node
- At least one trigger starts the workflow
- Every working node is reachable from a trigger
- Apify calls use POST and a credential for the token
- Actor input matches the Actor's published input schema
- No token or credential value is embedded
-
Add the Apify credential
Open Run Apify Actor. Under Credential, create a Header Auth credential with the name
Authorizationand the valueBearer, a space and your token. -
Set the input
The request body holds the Actor input. It starts from the Actor's Store prefill; change startUrls, maxCrawlDepth, maxCrawlPages to match your search.
{ "startUrls": [ { "url": "https://docs.apify.com" } ], "maxCrawlDepth": 1, "maxCrawlPages": 3, "useSitemaps": false, "useLlmsTxt": false, "respectRobotsTxtFile": true, "keepUrlFragments": false, "ignoreCanonicalUrl": false, "outputFormat": "markdown", "htmlTransformer": "auto", "includeImages": false, "chunkMarkdown": false, "chunkMaxChars": 2000, "chunkOverlapChars": 200, "parsePdfText": true, "takeScreenshots": false, "storeSkippedUrls": false }Every input field is documented on the Domain-Scoped Site Crawler for Markdown Datasets page.
-
Only new records go through
The Only records not sent before node (n8n's Remove Duplicates, set to remove items processed in previous executions) remembers each
url }}#{{ String(markdown || '').lengthit has passed on, so a record reaches Notion once even when the next run returns it again. It needs n8n 1.64 or later; clear its history from the node to resend everything. -
Connect Notion
Open Send to Notion, select your Notion credential and pick the database. The page title comes from title and the page body holds the other fields and the long text; map database properties if you want to filter on them.
-
Run once, then turn it on
Click Execute workflow and check the first records in Notion. When they look right, activate the workflow so the daily trigger runs it at 08:00 in your instance's timezone.
What lands in Notion
The fields this workflow sends, filled from the example record in the Actor's own README (published by the Actor, not a run of ours).
| Field | Example value |
|---|---|
title | Release notes — Example |
url | https://example.com/blog/release-notes |
depth | 1 |
wordCount | 412 |
httpStatusCode | 200 |
markdown | ## What changed - Faster startup |
Where it breaks
- Notion pages hold a limited amount of text per block, so very long pages are cut after the first part of their markdown.
- An edit that keeps the page the same length is not noticed; the change signal is the markdown length, not a full comparison.
- Pages that need a login or are blocked by robots rules are skipped.
- The workflow uses Apify's synchronous endpoint, which waits up to 300 seconds. Bigger runs answer HTTP 408: lower the limit or switch to an asynchronous run.
- Each run is billed to your Apify account at the Store price ($0.99 per 1,000 results (pay per event)).
Bigger runs: the long-run workflow starts the run, waits for it and reads the dataset, so it never hits the 300-second limit.
If the workflow fails
Why does the workflow or script stop with HTTP 408?
The synchronous endpoint waits at most 300 seconds. After that it answers 408 while the run keeps going in Apify. Lower the result limit, or start the run asynchronously, wait for it to finish and then read its dataset.
Source: Apify API: run Actor synchronously and get dataset items
What do 400, 401, 402 and 403 from the Apify API mean?
Read error.type in the response body. 400 is invalid Actor input. 401 (user-or-token-not-found) means a token reached Apify but it is wrong or revoked. 402 with x402-payment-required means no token reached Apify at all: the n8n credential or the Authorization: Bearer header is missing, and Apify is offering its pay-per-run x402 route for agents instead; any other 402 is an exhausted usage limit on the account that pays for the run. 403 is a token without permission for that Actor or storage.
Source: Apify API: authentication; Apify documentation: agentic payments with x402; Apify API: run Actor synchronously and get dataset items
n8n says Install this node to use it after import. Why?
The workflow names a node or node version your instance does not have, usually a community node. The workflows here use only built-in nodes at versions n8n has shipped since 1.80, so they import on n8n Cloud and older self-hosted instances without community nodes.
Why does the HTTP Request node time out before Apify answers?
Set the node's Timeout option to at least 300000 ms so n8n waits as long as Apify's synchronous endpoint. The workflows here already set 310000. A failure at exactly 30 seconds points to a proxy in front of n8n.
Same data in an agent
Want Claude, Cursor or ChatGPT to call the Actor directly instead of on a schedule? The Domain-Scoped Site Crawler for Markdown Datasets page has MCP configs for eight clients and a SKILL.md.
Questions
Is Notion a good store for a RAG corpus?
It works as a readable library that your team can browse and that tools can export. For large corpora, point the same crawl at a vector database through an n8n node instead of Notion.
Why did an edited page not come back?
The workflow files a page again when its markdown length changes. Small edits that keep the length the same do not count as a change.
More recipes
Google Trends to Google Sheets
Save Google Trends interest over time and related queries for your terms in a Google Sheet to spot rising…
Google TrendsGoogle SheetsBluesky posts to Slack
Forward new Bluesky posts from a profile or search to Slack for brand and topic monitoring.
BlueskySlackEventbrite events to Google Sheets
List upcoming Eventbrite events for a city or category in a Google Sheet with date, venue, coordinates and…
EventbriteGoogle SheetsGoogle Scholar papers to Notion
File Google Scholar search results in a Notion database with authors, year, citations and link, as a reading…
Google ScholarNotionCrunchbase funding news to Slack
Post new Crunchbase News funding stories to Slack as a daily deal-flow feed.
Crunchbase NewsSlackGreenhouse jobs to Slack
Post new openings from any company's Greenhouse job board to Slack, as a hiring signal or a job alert.
Greenhouse job boardsSlack