Scrape

codemode-gatewaysourcetypescript
Path: codemode-gateway/src/providers/scrape.tsRelative: src/providers/scrape.tsSubproject: codemode-gatewayCategory: codemode-gateway
Lines: 178Bytes: 5,517Imports: 1Exports: 3
codemode-gatewaysourcetypescriptsrcproviders

Content Preview

  1. import type { Env } from "../types";
  3. /**
  4. * `scrape` namespace tools — convenience persistence over the bound D1
  5. * database `env.DB` (table `scrape_pages`), composed with the existing
  6. * `browser` and `ai` namespaces. One sandbox code block can render a page
  7. * (`browser.markdown`), organize it (`ai.generate`), and persist it here
  8. * (`scrape.save`) — see the `scrape-and-store` snippet.
  9. *
  10. * Schema (`migrations/0001_scrape_store.sql`):
  11. * scrape_pages(id TEXT PK, url, title, markdown, summa