Analyze massive datasets beyond RAM
vaexskillsetup L2★27,559
K-Dense-AI/scientific-agent-skills ↗What it does
Use this skill for processing and analyzing large tabular datasets (billions of rows) that exceed av
Best for
Processing billion-row tabular datasets exceeding available RAM with fast aggregations and interactive exploration.
Inputs
- · file path or URL
Outputs
- · CSV/Excel file
Requires
- · Apache Arrow
- · Python environment
- · openpyxl / LibreOffice
- · Vaex library
Preconditions
Environment setup and dependencies installed
Failure modes
- · Missing or incompatible dependencies
- · Invalid input format
- · Insufficient permissions or credentials
Trust signals
- · Repository: K-Dense-AI/scientific-agent-skills
- · Includes explicit license declaration
- · Includes usage examples and patterns