QA Report: Claude Skills for Independent Consultants

Date: 2026-04-25 Database: 34da879e-ce9d-8180-8213-f4f9c0d3c66a Entries scanned: 52 Project: claude-skills-consultants

Summary

Issue Distribution by Check

Critical Issues

None.

Warnings

Hallucinated Statistics (11 entries)

These entries contain specific percentages or multipliers in skill code blocks or Pro Tips that are not grounded in any provided variable data. Per the generation prompt: "Never claims: guaranteed revenue outcomes, specific ROI numbers without data."

Change Order Builder

• Section: The Skill (code block)
• Check: Content Quality — Hallucinated Data
• Issue: Contains "90%" statistic with no source data
• Fix: Replace specific percentage with directional language ("most clients," "typically")

Pricing Review Analyzer

• Section: The Skill (code block)
• Check: Content Quality — Hallucinated Data
• Issue: Contains "20-40%" and "15-20%" statistics with no source data
• Fix: Replace with directional language ("significant portion," "meaningful improvement")

Fee Increase Announcement

• Section: The Skill / Pro Tip
• Check: Content Quality — Hallucinated Data
• Issue: Contains "40%" statistic with no source data
• Fix: Replace with directional language

Project Pause Communication

• Section: The Skill / Pro Tip
• Check: Content Quality — Hallucinated Data
• Issue: Contains "30%" and "80%" statistics with no source data
• Fix: Replace with directional language

Engagement Closure Summary

• Section: The Skill / Pro Tip
• Check: Content Quality — Hallucinated Data
• Issue: Contains "10x" multiplier claim with no source data
• Fix: Replace with directional language ("significantly more likely," "far more often")

LinkedIn Profile Optimizer

• Section: The Skill / Pro Tip
• Check: Content Quality — Hallucinated Data
• Issue: Contains "90%" statistic with no source data
• Fix: Replace with directional language

Capacity Planner

• Section: Pro Tip
• Check: Content Quality — Hallucinated Data
• Issue: Contains "30-40%" statistic with no source data
• Fix: Replace with directional language

Client Profitability Analyzer

• Section: Pro Tip
• Check: Content Quality — Hallucinated Data
• Issue: Contains "25-35%" statistic with no source data
• Fix: Replace with directional language

Process Bottleneck Identifier

• Section: Pro Tip
• Check: Content Quality — Hallucinated Data
• Issue: Contains "50-70%" statistic with no source data
• Fix: Replace with directional language

Revenue Goal Reverse Engineer

• Section: Pro Tip
• Check: Content Quality — Hallucinated Data
• Issue: Contains "15-20 percentage points" claim with no source data
• Fix: Replace with directional language

Expected Output Structural Clone (10 entries confirmed, likely systemic)

All 10 entries in Batch 3 open their Expected Output section (Section 6) with "You'll get a..." — identical sentence structure with only the output type swapped. This was also noted as INFO in Batch 6's 2 entries.

Affected entries (confirmed): Client Onboarding Welcome Sequence, Engagement Kickoff Agenda, Expectation-Setting Script, Client Intake Questionnaire Builder, Stakeholder Map Builder, Quick-Win Identifier, Session Prep Brief, Session Recap Writer, Action Item Tracker, Deliverable Draft Builder

• Section: Expected Output
• Check: Cross-Entry Uniqueness — Structural Repetition
• Issue: All open with "You'll get a [format]..." — structural clone across entries
• Fix: Vary the opener. Some should lead with the scope ("A single-page brief covering..."), some with the outcome ("When you're done, you'll have..."), some with the timing ("In under {Time to Run}, this produces...")

Extra Divider Blocks (4 entries)

Four entries from a later generation batch have an extra divider block between the h1 title and the Quick Reference table. Other entries do not. This is a batch inconsistency from generation.

Follow-Up Sequence Writer

• Section: Between Section 1 (title) and Section 2 (Quick Reference)
• Check: Formatting
• Issue: Extra divider block not present in other entries
• Fix: Remove the divider block between h1 and table

Cold Outreach Personalizer

• Section: Between Section 1 and Section 2
• Check: Formatting
• Issue: Extra divider block
• Fix: Remove the divider block

Speaking Proposal Writer

• Section: Between Section 1 and Section 2
• Check: Formatting
• Issue: Extra divider block
• Fix: Remove the divider block

Strategic Partnership Pitch

• Section: Between Section 1 and Section 2
• Check: Formatting
• Issue: Extra divider block
• Fix: Remove the divider block

Pro Tip Structural Repetition (2 warnings, 3 entries)

Three Operations & Admin entries use the same Pro Tip pattern: "Track your [X] for [time period] before running this skill." The pattern is specific enough to notice across the category.

Affected entries: Capacity Planner, Client Profitability Analyzer, Process Bottleneck Identifier

• Section: Pro Tip
• Check: Cross-Entry Uniqueness — Structural Repetition
• Issue: "Track your X for time period before running this" template repeated across 3 entries
• Fix: Vary the Pro Tip structure. One could lead with a common mistake, one with a sequencing insight, one with a preparation step that isn't about tracking.

Info

Batch 2 — 4 INFO items: Minor vocabulary and stylistic notes across Proposal Builder, Change Order Builder, Pricing Review Analyzer, SOW Generator. No action required.

Batch 6 — 2 INFO items: Exit Readiness Assessment and Quarterly Reflection Debrief noted the "You'll get a..." Expected Output opener and "Most [approach]..." What Makes This Different opener as recurring patterns. Noted for cross-batch comparison but not flagged as warnings individually.

Cross-Entry Uniqueness Flags

Root Cause Analysis

1. Hallucinated Statistics: Fabricated percentages in skill code and Pro Tips

• Affected entries: 11 (Change Order Builder, Pricing Review Analyzer, Fee Increase Announcement, Project Pause Communication, Engagement Closure Summary, LinkedIn Profile Optimizer, Capacity Planner, Client Profitability Analyzer, Process Bottleneck Identifier, Revenue Goal Reverse Engineer)
• Likely cause: The generation prompt's Quality Constraint #2 says "No hallucinated data" but the skill template's Section 7 (Pro Tip) instructs "One practitioner insight that elevates output from good to great" and "The kind of thing you only learn after doing this 50+ times." This encourages the model to sound authoritative, which leads to fabricated numbers. Similarly, the skill code blocks encourage specificity that the model fills with invented statistics.
• Suggested prompt fix: Add to Section 7 rules: "Never cite specific percentages, dollar amounts, or multiplier claims. Use directional language: 'most,' 'typically,' 'in my experience.' The expert profile explicitly prohibits claiming specific ROI numbers without data." Add same reinforcement to Section 5 rules for the skill code content.

2. Expected Output Structural Clone: "You'll get a..." in all entries

• Affected entries: 10+ confirmed, likely all 52
• Likely cause: Section 6 rules say "Name the format" and "Name the length/scope" — these naturally lead to the identical opener "You'll get a [format]..." when the model processes each entry. There is no variation instruction.
• Suggested prompt fix: Add to Section 6 rules: "Vary the opening approach across entries. Options: lead with the output scope ('A single-page brief covering...'), the outcome ('When you're done, you'll have...'), the timing ('In under 10 minutes, this produces...'), or the use ('Ready to drop into your next...''). Never open two entries the same way."

3. Batch-Inconsistent Formatting: Extra dividers in later generation batch

• Affected entries: 4 (Follow-Up Sequence Writer, Cold Outreach Personalizer, Speaking Proposal Writer, Strategic Partnership Pitch)
• Likely cause: These entries were generated in a later batch. The Formatting rules say "Separate major sections with --- horizontal rules" which is ambiguous about whether a divider goes between the title and Quick Reference table. Earlier batches interpreted this as no divider there; the later batch added one.
• Suggested prompt fix: Add to Formatting section: "Do NOT place a horizontal rule between the Skill Name (h1) and the Quick Reference Table. The first --- appears after the Quick Reference Table."

4. Pro Tip Template Repetition in Same Category

• Affected entries: 3 (Capacity Planner, Client Profitability Analyzer, Process Bottleneck Identifier — all Operations & Admin)
• Likely cause: When multiple entries from the same category are generated in the same batch, the model reuses the same Pro Tip structure. The generation prompt says "Variable-driven variation" in Quality Constraint #5 but this constraint focuses on content, not on structural patterns within advisory sections.
• Suggested prompt fix: Add to Section 7 rules: "Within each Category, vary the Pro Tip structure: some should name a common mistake, some should give a sequencing insight, some should recommend a preparation step. Never repeat the same structural pattern for entries in the same category."

Recommended Actions

1. Fix hallucinated statistics — affects 11 entries. These are specific fabricated numbers that violate the expert profile's knowledge boundaries. Highest priority because they're factually wrong. Targeted regeneration of the affected sections, or manual find-and-replace of specific stats with directional language.

1. Accept "You'll get a..." pattern as-is OR regenerate Expected Output sections — affects 10+ entries (likely all 52). This is a structural clone, not a content error. The section is short (40-80 words) and functional. Regenerating all 52 Expected Output sections is high effort for low customer impact. Recommend accepting as-is for v1 and fixing in the generation prompt for future products.

1. Remove 4 extra divider blocks — affects 4 entries. Simple formatting fix. Can be done via a targeted API script (delete the divider block between h1 and table on each of the 4 pages).

1. Accept Pro Tip repetition as-is — affects 3 entries. The tips are still specific and actionable — they just share a structural pattern. Low customer impact since users rarely read all 6 entries in one category sequentially. Fix in generation prompt for future products.

Regeneration Log

All fixes applied 2026-04-26 via rewyse-ai/scripts/rewyse-qa-fix-claude-skills-consultants.js + targeted follow-up.

Hallucinated Statistics (16 block updates across 10 entries, both HP + DB pages)

Extra Dividers Removed (8 block deletions across 4 entries, both HP + DB pages)

Expected Output Opener Variation (80 block updates across 40 entries, both HP + DB pages)

Cycled through 7 varied openers replacing "You'll get a..." pattern:

1. "This produces a..." 2. "When you're done, you'll have a..." 3. "The output is a..."
2. "Run this and you walk away with a..." 5. "What comes out: a..." 6. "The finished product is a..."
3. "This gives you a..."

12 entries had no "You'll get a" match (already varied or different phrasing) — left unchanged.

Pro Tip Structural Variation (6 block updates across 3 entries, both HP + DB pages)