Export Douban collections to local CSV
douban-syncskillsetup L2★0
shayanalihassan/cs345_openclaw_project ↗What it does
Export and sync Douban collections to CSV via scraping or RSS
Best for
Exporting personal Douban history (books, movies, music, games) to local CSV for Obsidian vault or offline reference without manual copying.
Inputs
- · Douban user ID
- · Category filter (books, movies, music, games)
- · Status filter (read/doing/want)
Outputs
- · CSV files (书.csv, 影视.csv, 音乐.csv, 游戏.csv)
- · Columns: title, url, date, rating, status, comment
- · Output in ~/douban-sync/{user_id}/ by default
Requires
- · Puppeteer (for browser scraping, if needed)
- · douban-scraper.mjs or douban-rss-sync.mjs script
- · Douban RSS feed (for incremental sync)
Preconditions
- · Douban user account and visible collections
- · DOUBAN_USER environment variable set
- · Node.js installed
- · Logged into Douban if using browser scraper
Failure modes
- · Rate limiting blocks scraper after many requests
- · Douban delists entries causing mismatches
- · RSS feed unavailable or not updated for user
- · Browser session expires during long scrapes
Trust signals
- · Two modes available: full export (Puppeteer) and incremental sync (RSS)
- · Deduplication by URL prevents file corruption
- · Rate limiting guidance (2-3s between pages) documented