cyberneticlibrary

Verify framework detection accuracy

hallucination-checkcommandsetup L218
EffortlessMetrics/perl-lsp
What it does

Verify AI-generated Perl framework names exist on MetaCPAN

Best for

When LLM-generated PRs add new framework names and you need to catch AI hallucinations before merge

Inputs
  • · module_name
  • · PR_touching_framework_table
Outputs
  • · CPAN_hit_count
  • · hallucination_verdict (REAL|HALLUCINATED|UNCLEAR)
  • · closure_comment_if_hallucinated
Requires
  • · curl
  • · MetaCPAN_REST_API
Preconditions

PR has framework/module additions; MetaCPAN API accessible

Failure modes
  • · 0 CPAN hits on plausible-but-obscure name
  • · MetaCPAN API timeout
Trust signals
  • · Checks both Name and Name::Role variants
  • · Compares against known AI product list
  • · Template closure comment