Website to markdown to Notion with n8n

A page is filed again only when its URL is new or the length of its markdown changes, so a daily crawl adds new and edited pages without refiling the rest.

Put the site you want in startUrls in the request body and raise maxCrawlPages and maxCrawlDepth once a first small run looks right. The crawl respects the site's robots rules and keeps to the start domain, which suits documentation, help centres and blogs you want in a retrieval corpus.

Run on Apify

Built-in nodes only Imports on n8n Cloud and self-hosted n8n 1.80 or later, no community nodes. 11 of 11 checks pass; validated, not executed.

Source
Any public website
Actor
Domain-Scoped Site Crawler for Markdown Datasets
Destination
Notion
Store price
$0.99 per 1,000 results (pay per event)
Cost on the Free plan
about $0.42 a run (start $0.40 + about 25 results; the input sets no limit, so more results cost more), about $12.74 a month daily, plus platform usage
Data checked
2026-11-12

Method

  1. Get an Apify token

    Sign in to Apify and copy a personal API token from Console: Settings, API and integrations. The workflow keeps it in an n8n credential, never in the file.

  2. Import the workflow

    In n8n choose Workflows, Import from file, or paste the JSON onto an empty canvas.

    • Run by hand
    • Every day
    • Run Apify Actor
    • Only records not sent before
    • Keep main fields
    • Send to Notion

    n8n workflowwebsite-to-markdown-to-notion.n8n.json

    Actor on Apify
    Show the file (239 lines)
    {
      "name": "Website to markdown to Notion",
      "nodes": [
        {
          "id": "7ae13a1e-9c39-494d-aa13-a06c30f44d23",
          "name": "Run by hand",
          "type": "n8n-nodes-base.manualTrigger",
          "typeVersion": 1,
          "position": [
            0,
            0
          ],
          "parameters": {}
        },
        {
          "id": "db9f5cce-ebde-42a7-a959-ea7ee228937b",
          "name": "Every day",
          "type": "n8n-nodes-base.scheduleTrigger",
          "typeVersion": 1.2,
          "position": [
            0,
            200
          ],
          "parameters": {
            "rule": {
              "interval": [
                {
                  "triggerAtHour": 8
                }
              ]
            }
          },
          "notes": "Activate the workflow to run on this schedule."
        },
        {
          "id": "69301f72-d9d9-4438-a594-a2bd108f0457",
          "name": "Run Apify Actor",
          "type": "n8n-nodes-base.httpRequest",
          "typeVersion": 4.2,
          "position": [
            260,
            100
          ],
          "parameters": {
            "method": "POST",
            "url": "https://api.apify.com/v2/actors/vexaloom-labs~domain-scoped-site-crawler-for-markdown-datasets/run-sync-get-dataset-items",
            "authentication": "genericCredentialType",
            "genericAuthType": "httpHeaderAuth",
            "sendBody": true,
            "specifyBody": "json",
            "jsonBody": "{\n  \"startUrls\": [\n    {\n      \"url\": \"https://docs.apify.com\"\n    }\n  ],\n  \"maxCrawlDepth\": 1,\n  \"maxCrawlPages\": 3,\n  \"useSitemaps\": false,\n  \"useLlmsTxt\": false,\n  \"respectRobotsTxtFile\": true,\n  \"keepUrlFragments\": false,\n  \"ignoreCanonicalUrl\": false,\n  \"outputFormat\": \"markdown\",\n  \"htmlTransformer\": \"auto\",\n  \"includeImages\": false,\n  \"chunkMarkdown\": false,\n  \"chunkMaxChars\": 2000,\n  \"chunkOverlapChars\": 200,\n  \"parsePdfText\": true,\n  \"takeScreenshots\": false,\n  \"storeSkippedUrls\": false\n}",
            "options": {
              "timeout": 310000
            }
          },
          "notes": "Actor: vexaloom-labs/domain-scoped-site-crawler-for-markdown-datasets. Select a Header Auth credential: name Authorization, value Bearer + your Apify token. Edit the JSON body to change the input.",
          "notesInFlow": false
        },
        {
          "id": "e0c2145e-33df-4515-af0d-8a64f9b4f913",
          "name": "Only records not sent before",
          "type": "n8n-nodes-base.removeDuplicates",
          "typeVersion": 2,
          "position": [
            500,
            100
          ],
          "parameters": {
            "operation": "removeItemsSeenInPreviousExecutions",
            "logic": "removeItemsWithAlreadySeenKeyValues",
            "dedupeValue": "={{ $json.url }}#{{ String($json.markdown || '').length }}",
            "options": {
              "scope": "node",
              "historySize": 10000
            }
          },
          "notes": "Remembers each record it has passed on (up to 10,000) across runs, so a record is sent once. Needs n8n 1.64 or later."
        },
        {
          "id": "fe097a76-92a9-487f-a7be-de9ec397d62b",
          "name": "Keep main fields",
          "type": "n8n-nodes-base.code",
          "typeVersion": 2,
          "position": [
            740,
            100
          ],
          "parameters": {
            "jsCode": "// Keeps the Actor's main fields as flat, spreadsheet-safe values.\nconst columns = [\"title\",\"url\",\"depth\",\"wordCount\",\"httpStatusCode\",\"markdown\"];\n// A dotted name such as author.name reads the nested value.\nconst read = (obj, key) => (key in obj ? obj[key] : key.split('.').reduce((v, part) => (v && typeof v === 'object' ? v[part] : undefined), obj));\nreturn $input.all().map((item) => {\n  const row = {};\n  const present = columns.filter((key) => read(item.json, key) !== undefined);\n  // A record shaped differently from the published schema keeps its own fields rather than arriving blank.\n  for (const key of present.length >= 2 ? present : Object.keys(item.json)) {\n    const value = read(item.json, key);\n    row[key] = value === null || value === undefined ? '' : typeof value === 'object' ? JSON.stringify(value) : value;\n  }\n  return { json: row };\n});"
          }
        },
        {
          "id": "25dce6a6-883a-4faf-aef8-79fa0e375ab3",
          "name": "Send to Notion",
          "type": "n8n-nodes-base.notion",
          "typeVersion": 2.2,
          "position": [
            980,
            100
          ],
          "parameters": {
            "resource": "databasePage",
            "databaseId": {
              "__rl": true,
              "value": "",
              "mode": "list"
            },
            "title": "={{ [$json.title].filter((v) => v !== undefined && v !== null && v !== '').join(': ') || 'Untitled' }}",
            "propertiesUi": {
              "propertyValues": []
            },
            "blockUi": {
              "blockValues": [
                {
                  "type": "paragraph",
                  "textContent": "={{ [[\"url\", $json.url], [\"depth\", $json.depth], [\"wordCount\", $json.wordCount], [\"httpStatusCode\", $json.httpStatusCode]].filter(([, v]) => v !== undefined && v !== null && v !== '').map(([k, v]) => k + ': ' + (typeof v === 'object' ? JSON.stringify(v) : v)).join(' | ').slice(0, 1900) || ' ' }}"
                },
                {
                  "type": "paragraph",
                  "textContent": "={{ String($json.markdown ?? '').slice(0, 1900) || ' ' }}"
                },
                {
                  "type": "paragraph",
                  "textContent": "={{ String($json.markdown ?? '').slice(1900, 3800) || ' ' }}"
                },
                {
                  "type": "paragraph",
                  "textContent": "={{ String($json.markdown ?? '').slice(3800, 5700) || ' ' }}"
                },
                {
                  "type": "paragraph",
                  "textContent": "={{ String($json.markdown ?? '').slice(5700, 7600) || ' ' }}"
                },
                {
                  "type": "paragraph",
                  "textContent": "={{ String($json.markdown ?? '').slice(7600, 9500) || ' ' }}"
                },
                {
                  "type": "paragraph",
                  "textContent": "={{ String($json.markdown ?? '').slice(9500, 11400) || ' ' }}"
                },
                {
                  "type": "paragraph",
                  "textContent": "={{ String($json.markdown ?? '').slice(11400, 13300) || ' ' }}"
                },
                {
                  "type": "paragraph",
                  "textContent": "={{ String($json.markdown ?? '').slice(13300, 15200) || ' ' }}"
                }
              ]
            },
            "options": {}
          },
          "notes": "Pick your Notion database. Each page gets the record's main fields and the first 15200 characters of markdown as its content; map extra database properties if you want to filter on them."
        },
        {
          "id": "b679bc4e-e393-4e2b-a94d-347e12fc4383",
          "name": "Setup",
          "type": "n8n-nodes-base.stickyNote",
          "typeVersion": 1,
          "position": [
            0,
            -370
          ],
          "parameters": {
            "content": "## Domain-Scoped Site Crawler for Markdown Datasets\n\nSource: [vexaloom-labs/domain-scoped-site-crawler-for-markdown-datasets](https://apify.com/vexaloom-labs/domain-scoped-site-crawler-for-markdown-datasets) on Apify.\n\n1. In **Run Apify Actor**, create a Header Auth credential: name `Authorization`, value `Bearer YOUR_APIFY_TOKEN` with your token.\n2. Open **Send to Notion** and connect your Notion account.\n3. Edit the JSON body of **Run Apify Actor** to change the input.\n\nGenerated by recipeforagents.com. Validated, not executed: runs are billed to your Apify account.",
            "height": 340,
            "width": 460,
            "color": 6
          }
        }
      ],
      "connections": {
        "Run by hand": {
          "main": [
            [
              {
                "node": "Run Apify Actor",
                "type": "main",
                "index": 0
              }
            ]
          ]
        },
        "Every day": {
          "main": [
            [
              {
                "node": "Run Apify Actor",
                "type": "main",
                "index": 0
              }
            ]
          ]
        },
        "Run Apify Actor": {
          "main": [
            [
              {
                "node": "Only records not sent before",
                "type": "main",
                "index": 0
              }
            ]
          ]
        },
        "Only records not sent before": {
          "main": [
            [
              {
                "node": "Keep main fields",
                "type": "main",
                "index": 0
              }
            ]
          ]
        },
        "Keep main fields": {
          "main": [
            [
              {
                "node": "Send to Notion",
                "type": "main",
                "index": 0
              }
            ]
          ]
        }
      },
      "pinData": {},
      "active": false,
      "settings": {
        "executionOrder": "v1"
      },
      "meta": {
        "templateCredsSetupCompleted": false
      },
      "tags": []
    }
    Validated, not executed: 11 of 11 checks pass
    • It has a nodes array and a connections object
    • Every node has a name, type, typeVersion, position and parameters
    • Node names are unique
    • Every node type is a known n8n core node (or the Apify node)
    • Every node uses a typeVersion that n8n ships
    • Every connection points at an existing node
    • At least one trigger starts the workflow
    • Every working node is reachable from a trigger
    • Apify calls use POST and a credential for the token
    • Actor input matches the Actor's published input schema
    • No token or credential value is embedded

  3. Add the Apify credential

    Open Run Apify Actor. Under Credential, create a Header Auth credential with the name Authorization and the value Bearer, a space and your token.

  4. Set the input

    The request body holds the Actor input. It starts from the Actor's Store prefill; change startUrls, maxCrawlDepth, maxCrawlPages to match your search.

    {
      "startUrls": [
        {
          "url": "https://docs.apify.com"
        }
      ],
      "maxCrawlDepth": 1,
      "maxCrawlPages": 3,
      "useSitemaps": false,
      "useLlmsTxt": false,
      "respectRobotsTxtFile": true,
      "keepUrlFragments": false,
      "ignoreCanonicalUrl": false,
      "outputFormat": "markdown",
      "htmlTransformer": "auto",
      "includeImages": false,
      "chunkMarkdown": false,
      "chunkMaxChars": 2000,
      "chunkOverlapChars": 200,
      "parsePdfText": true,
      "takeScreenshots": false,
      "storeSkippedUrls": false
    }

    Every input field is documented on the Domain-Scoped Site Crawler for Markdown Datasets page.

  5. Only new records go through

    The Only records not sent before node (n8n's Remove Duplicates, set to remove items processed in previous executions) remembers each url }}#{{ String(markdown || '').length it has passed on, so a record reaches Notion once even when the next run returns it again. It needs n8n 1.64 or later; clear its history from the node to resend everything.

  6. Connect Notion

    Open Send to Notion, select your Notion credential and pick the database. The page title comes from title and the page body holds the other fields and the long text; map database properties if you want to filter on them.

  7. Run once, then turn it on

    Click Execute workflow and check the first records in Notion. When they look right, activate the workflow so the daily trigger runs it at 08:00 in your instance's timezone.

What lands in Notion

The fields this workflow sends, filled from the example record in the Actor's own README (published by the Actor, not a run of ours).

FieldExample value
titleRelease notes — Example
urlhttps://example.com/blog/release-notes
depth1
wordCount412
httpStatusCode200
markdown## What changed - Faster startup

Where it breaks

  • Notion pages hold a limited amount of text per block, so very long pages are cut after the first part of their markdown.
  • An edit that keeps the page the same length is not noticed; the change signal is the markdown length, not a full comparison.
  • Pages that need a login or are blocked by robots rules are skipped.
  • The workflow uses Apify's synchronous endpoint, which waits up to 300 seconds. Bigger runs answer HTTP 408: lower the limit or switch to an asynchronous run.
  • Each run is billed to your Apify account at the Store price ($0.99 per 1,000 results (pay per event)).

Bigger runs: the long-run workflow starts the run, waits for it and reads the dataset, so it never hits the 300-second limit.

If the workflow fails

Why does the workflow or script stop with HTTP 408?

The synchronous endpoint waits at most 300 seconds. After that it answers 408 while the run keeps going in Apify. Lower the result limit, or start the run asynchronously, wait for it to finish and then read its dataset.

Source: Apify API: run Actor synchronously and get dataset items

What do 400, 401, 402 and 403 from the Apify API mean?

Read error.type in the response body. 400 is invalid Actor input. 401 (user-or-token-not-found) means a token reached Apify but it is wrong or revoked. 402 with x402-payment-required means no token reached Apify at all: the n8n credential or the Authorization: Bearer header is missing, and Apify is offering its pay-per-run x402 route for agents instead; any other 402 is an exhausted usage limit on the account that pays for the run. 403 is a token without permission for that Actor or storage.

Source: Apify API: authentication; Apify documentation: agentic payments with x402; Apify API: run Actor synchronously and get dataset items

n8n says Install this node to use it after import. Why?

The workflow names a node or node version your instance does not have, usually a community node. The workflows here use only built-in nodes at versions n8n has shipped since 1.80, so they import on n8n Cloud and older self-hosted instances without community nodes.

Source: n8n issue: unrecognized node type after import

Why does the HTTP Request node time out before Apify answers?

Set the node's Timeout option to at least 300000 ms so n8n waits as long as Apify's synchronous endpoint. The workflows here already set 310000. A failure at exactly 30 seconds points to a proxy in front of n8n.

Source: n8n HTTP Request node documentation

Same data in an agent

Want Claude, Cursor or ChatGPT to call the Actor directly instead of on a schedule? The Domain-Scoped Site Crawler for Markdown Datasets page has MCP configs for eight clients and a SKILL.md.

Questions

Is Notion a good store for a RAG corpus?

It works as a readable library that your team can browse and that tools can export. For large corpora, point the same crawl at a vector database through an n8n node instead of Notion.

Why did an edited page not come back?

The workflow files a page again when its markdown length changes. Small edits that keep the length the same do not count as a change.

More recipes

  • Google Trends to Google Sheets

    Save Google Trends interest over time and related queries for your terms in a Google Sheet to spot rising…

    Google TrendsGoogle Sheets
  • Bluesky posts to Slack

    Forward new Bluesky posts from a profile or search to Slack for brand and topic monitoring.

    BlueskySlack
  • Eventbrite events to Google Sheets

    List upcoming Eventbrite events for a city or category in a Google Sheet with date, venue, coordinates and…

    EventbriteGoogle Sheets
  • Google Scholar papers to Notion

    File Google Scholar search results in a Notion database with authors, year, citations and link, as a reading…

    Google ScholarNotion
  • Crunchbase funding news to Slack

    Post new Crunchbase News funding stories to Slack as a daily deal-flow feed.

    Crunchbase NewsSlack
  • Greenhouse jobs to Slack

    Post new openings from any company's Greenhouse job board to Slack, as a hiring signal or a job alert.

    Greenhouse job boardsSlack