cyberneticlibrary

Convert files to semantic embeddings

cradle-ecosystem-data-ingestionskillsetup L20
Aloysius8895/MyHackathon
What it does

Transforms raw unstructured files into structured JSON tokens and generates 768-dimension mathematical coordinate arrays using text-embedding-004

Best for

When this is the appropriate approach for the task.

Outputs
  • · JSON structure
Requires
  • · database
  • · LLM
Preconditions

None specified

Failure modes

Unknown