cyberneticlibrary

Export Douban collections to local CSV

douban-syncskillsetup L20
shayanalihassan/cs345_openclaw_project
What it does

Export and sync Douban collections to CSV via scraping or RSS

Best for

Exporting personal Douban history (books, movies, music, games) to local CSV for Obsidian vault or offline reference without manual copying.

Inputs
  • · Douban user ID
  • · Category filter (books, movies, music, games)
  • · Status filter (read/doing/want)
Outputs
  • · CSV files (书.csv, 影视.csv, 音乐.csv, 游戏.csv)
  • · Columns: title, url, date, rating, status, comment
  • · Output in ~/douban-sync/{user_id}/ by default
Requires
  • · Puppeteer (for browser scraping, if needed)
  • · douban-scraper.mjs or douban-rss-sync.mjs script
  • · Douban RSS feed (for incremental sync)
Preconditions
  • · Douban user account and visible collections
  • · DOUBAN_USER environment variable set
  • · Node.js installed
  • · Logged into Douban if using browser scraper
Failure modes
  • · Rate limiting blocks scraper after many requests
  • · Douban delists entries causing mismatches
  • · RSS feed unavailable or not updated for user
  • · Browser session expires during long scrapes
Trust signals
  • · Two modes available: full export (Puppeteer) and incremental sync (RSS)
  • · Deduplication by URL prevents file corruption
  • · Rate limiting guidance (2-3s between pages) documented