cyberneticlibrary

Convert webpages to markdown

baoyu-url-to-markdownskillsetup L220,870
JimLiu/baoyu-skills
What it does

Fetch URLs and convert to markdown with site-specific adapters and login/CAPTCHA handling

Best for

Saving web articles, tweets, YouTube transcripts, or HN threads as markdown when you need structured content extraction with login support.

Inputs
  • · URL to fetch
  • · optional login credentials
  • · markdown format options
Outputs
  • · Markdown file with extracted content
  • · image and link references
Requires
  • · Chrome CDP
  • · Bun runtime
  • · Defuddle (for generic pages)
Preconditions
  • · URL accessible
  • · Chrome installed
Failure modes
  • · CAPTCHA not solved
  • · login fails
  • · client-side rendering incomplete
  • · image extraction times out
Trust signals
  • · Site-specific adapters (Twitter, YouTube, HN)
  • · CAPTCHA/login interaction wait modes
  • · Defuddle generic fallback
  • · markdown preservation