▣ Skill Poison — Knowledge ExplorerONLINE / EDITION 10
AGENT SKILLS / SECURITY
Independent. Open. Curious.
← THE GUIDE LIBRARY
EvaluationTechnical

A clean result with missing coverage

Learn to read skipped files, parser failures, truncated content, and mismatched package inventories.

THE THREE THINGS TO KEEP
  • Keep coverage separate from findings.
  • Skipped, truncated, and failed are visible outcomes.
  • Do not promote incomplete analysis into whole-package assurance.

Start with what was actually inspected

A detector reports on the input it processed. If a package contains a file it did not see, could not parse, or chose to skip, the verdict cannot silently cover that file. The useful first question is not only “what did the scanner find?” but “what did this run analyze?”

The omnicogg case file connects this question to a published package investigation. Historical findings belong to the reported tools and configuration; this guide does not claim that their current releases behave identically.

Make a coverage manifest

FieldWhat it tells a reviewer
Expected path and content identityWhich artifact belongs to the package under review.
Seen by the toolWhether the artifact entered the analysis at all.
StatusComplete, partial, skipped, unsupported, or error.
Reason and limitsSize, encoding, extraction, timeout, parser, or configuration.
Next actionManual review, alternate inspection, containment, or hold.

Synthetic comparison: zero findings is not zero uncertainty

Run A processes every supported file and reports no findings. Run B processes the entry file, skips the helper directory, and reports no findings. Both can display a zero. Their coverage records should lead to different review conclusions.

Compare the package inventory with the analysis input. Count errors and skipped files without pretending they are malicious by default. The point is to preserve uncertainty, not turn every processing problem into an attack verdict.

Decide how incomplete analysis affects use

For an unreviewed executable or influential resource, hold the workflow or remove the unsupported capability from scope. A manually reviewed exception needs an owner and evidence. If a large file is split for inspection, preserve its original identity and ordering; a convenient excerpt is not the whole artifact.

Keep the coverage record with the detector configuration, revision, and outcome. Later comparisons can then distinguish a change in detection from a change in what the tool managed to read.

Read the evidence in context

These case files distinguish reported observations from editorial interpretation.

C03 · Published packageomnicogg: the file a convenient viewer did not show

Sources & scope

This guide combines editorial explanation and practical review suggestions. Linked sources support the underlying concepts; this site has not independently replicated their experiments.

S27
Anatomy of a Deception: Uncovering the omnicogg Dropper in ClawHubIndustry research · David Cohen · JFrog Security Research
↗
S19
Cisco Skill Scanner — scope, engines, and limitationsDocumentation · Cisco AI Defense maintainers
↗
S16
MaliciousSkillBench: A Comprehensive Benchmark for Malicious Agent Skill DetectionPreprint · Yue Wang et al.
↗
Compare sources in the catalog ↗
NEXT IN THE READING PATHPoisoned advice and output integrity
Search guides, research, and glossary termsESC TO CLOSE

Start typing to explore the knowledge base.