QA Report: Consulting Practice SOP Manual

Date: 2026-04-28 Database: 34ea879e-ce9d-8182-92ac-cee93e69d2cb Entries scanned: 40 Project: consulting-practice-sop-manual

Summary

Issue Distribution by Check

Clean Entries (21)

LinkedIn Profile Quarterly Refresh, Engagement Kickoff Prep, Cold Outreach Batch, Retainer Renewal Process, Difficult Conversation Preparation, Project Pause Protocol, Competitive Win/Loss Debrief, Quick-Win Sprint, Onboarding Retrospective, Late Payment Collection, Ideal Client Profile Review, Referral and Partnership Campaign, Follow-Up Sequence Activation, Change Order Management, Content Publishing Rhythm, Weekly Pipeline Review, New Client Intake Process (INFO only), Offer Suite Evaluation (INFO only), Process Improvement Sprint (INFO only), Diagnostic Call Prep Routine (INFO only), Mid-Engagement Review (INFO only)

Critical Issues

All three critical issues are duplicate blocks — the generation script wrote content twice to the same page. The content itself is correct; the duplicate blocks need deletion.

1. Weekly Progress Reporting

• Section: All sections
• Check: Formatting
• Issue: Entire page content is duplicated. All 7 sections (Quick Reference through Common Mistakes) appear twice in sequence. Two complete copies of every block.
• Fix: Delete the second set of blocks via Notion API. No regeneration needed.

2. Client Session Cycle

• Section: Quick Reference, Purpose
• Check: Formatting
• Issue: Partial duplication. Quick Reference callout and Purpose paragraph appear again after Common Mistakes, creating a broken page structure.
• Fix: Delete the duplicate Quick Reference and Purpose blocks at the end of the page.

3. Deliverable Production Process

• Section: All sections
• Check: Formatting
• Issue: Full content duplication — all blocks appear twice. Additionally, unique content is ~460 words (exceeds 350-word ceiling).
• Fix: Delete duplicate blocks. Consider trimming procedure steps 1, 3, and 6 (the most verbose) to bring total under 350 words, or accept at current length.

Warnings

Word Count Ceiling Exceeded (4 entries)

Blueprint target: 250-350 words. "If it bloats past 350 words, it fails the 9 PM test."

• Check: Blueprint Compliance
• Fix: Regenerate with tighter word constraints, or trim manually. Annual Planning Process is the most urgent — it's nearly double the minimum target.

Hallucinated Statistics (3 entries)

Blueprint rule: "No specific numbers, percentages, or frequencies unless they come directly from the entry's variable data."

Proposal-to-Engagement Pipeline

• Section: Procedure or Common Mistakes
• Check: Content Quality
• Issue: "about 72 hours" — specific time claim with no source data
• Fix: Replace with directional language ("within a few days", "promptly")

Engagement Milestone Close-Out

• Section: Common Mistakes
• Check: Content Quality
• Issue: "12 hours per week" — invented statistic
• Fix: Replace with "significant time" or similar directional language

Quarterly Business Review Prep

• Section: Common Mistakes or Procedure
• Check: Content Quality
• Issue: "30% of quarterly revenue" — specific threshold with no source
• Fix: Replace with "a significant portion of quarterly revenue" or remove the number

Blueprint Compliance Issues (3 entries)

Engagement Milestone Close-Out

• Section: Procedure
• Check: Blueprint Compliance
• Issue: Only 4 procedure steps. Blueprint minimum is 5.
• Fix: Add a 5th step (e.g., a step to update the project tracker or notify the client)

Exit Readiness Check

• Section: Procedure
• Check: Blueprint Compliance
• Issue: Step 1 is ~72 words. Blueprint guideline is 20-40 words per step.
• Fix: Split into two steps or trim to essentials

Stakeholder Alignment Check

• Section: Expected Outcome
• Check: Blueprint Compliance
• Issue: ~28 words, below the 30-word minimum
• Fix: Add one more concrete artifact to the outcome list

Content Quality Issues (3 entries)

Case Study Capture

• Section: Expected Outcome
• Check: Content Quality
• Issue: ~22 words — thin content (73% of minimum). Below the 30-word floor.
• Fix: Expand with specific artifacts the consultant will have when done

Quarterly Practice Health Check

• Section: Procedure
• Check: Content Quality
• Issue: Revenue Goal Reverse Engineer and Quarterly Reflection Debrief called inline as procedure steps. Per the strategic-skills-as-dependencies rule, these should be framed as prerequisites ("Open your current [output]"), not re-run inline.
• Fix: Move skill references to Prerequisites. Replace inline calls with "Review your current [output name]"

Client Offboarding Process

• Section: Common Mistakes
• Check: Expert Voice
• Issue: Uses "conversion rate" — corporate/marketing term that drifts from the solo consultant operations voice
• Fix: Replace with practice-appropriate language

Cross-Entry Uniqueness (1 pattern)

"Waiting until..." Common Mistakes Repetition

• Section: Common Mistakes
• Check: Cross-Entry Uniqueness
• Issue: 3 entries use the same "Waiting until [condition]..." structural template as a Common Mistakes opener. Per quality criteria, 3+ entries using the identical sentence template qualifies as structural repetition.
• Fix: Vary the mistake opening structure across entries. Some should lead with the behavior, some with the consequence, some with the scenario.

Speaking Pipeline Development

• Section: Prerequisites / Procedure
• Check: Blueprint Compliance
• Issue: ~468 words total. Additionally, SOP-vs-skill reference confusion in prerequisites — references another SOP's output as a prerequisite but the framing is unclear.
• Fix: Trim total word count. Clarify prerequisite framing.

Info

Minor issues noted but not requiring action:

Non-Actionable Pattern: Missing heading_1 Blocks

All 40 pages lack a heading1 block in the page body. This is standard Notion architecture — the page title property renders as h1 automatically. Adding a heading1 block would create a visual duplicate. Not an issue.

Non-Actionable Pattern: "You'll have..." Expected Outcome Opener

Multiple pages open Expected Outcome with "You'll have [artifact list]..." The content blueprint itself prescribes this format: "Written as a list of concrete artifacts or conditions: 'You'll have [X], [Y], and [Z]'." This is following instructions, not a defect.

Cross-Entry Uniqueness Flags

No cross-entry overlaps exceeded the 60% threshold on first-100-character comparison. All Purpose paragraphs are distinct. All Common Mistakes sections are distinct at the character level.

The two structural patterns noted (both below the character threshold but visible as templates):

Root Cause Analysis

1. Duplicate Blocks (3 entries)

• Affected entries: Weekly Progress Reporting, Client Session Cycle, Deliverable Production Process
• Likely cause: The generate-content phase (Phase 7) hit a retry or race condition during batch processing. The Promise.allSettled pattern in the generation script may have retried a partially-successful write, appending blocks a second time to the same page.
• Suggested fix: Before writing blocks, check if the page already has content. Add a guard: query existing blocks first, skip if non-empty. For the 3 affected pages, delete duplicate blocks via API (no regeneration needed).

2. Word Count Ceiling Exceeded (4 entries)

• Affected entries: Annual Planning Process, Speaking Pipeline Development, Deliverable Production Process, Capacity Planning Update
• Likely cause: The generation prompt states "~250-350 words" as a target but doesn't enforce it as a hard ceiling. Complex SOPs with many skills referenced naturally generate longer procedures.
• Suggested prompt fix: Add explicit instruction: "HARD CEILING: If total word count exceeds 350 words, cut the longest procedure steps first. Every step above 30 words is a candidate for trimming."

3. Hallucinated Statistics (3 entries)

• Affected entries: Proposal-to-Engagement Pipeline, Engagement Milestone Close-Out, Quarterly Business Review Prep
• Likely cause: The generation prompt includes "Do NOT cite specific statistics" but the model introduces specific numbers in Common Mistakes sections where it wants to make consequences feel concrete.
• Suggested prompt fix: Strengthen the constraint in the Common Mistakes section instructions: "NEVER use specific numbers (hours, percentages, dollar amounts) in Common Mistakes. Use directional language: 'significant time,' 'most consultants,' 'consistently.'"

Recommended Actions

1. Delete duplicate blocks on 3 pages (Weekly Progress Reporting, Client Session Cycle, Deliverable Production Process) — API block deletion, no regeneration needed. Affects 3 entries.

1. Regenerate 4 oversized entries (Annual Planning Process, Speaking Pipeline Development, Deliverable Production Process, Capacity Planning Update) with tighter word constraints. Or manually trim. Affects 4 entries.

1. Fix 3 hallucinated statistics — targeted text replacement on Proposal-to-Engagement Pipeline, Engagement Milestone Close-Out, Quarterly Business Review Prep. Can be done via block update API without full regeneration. Affects 3 entries.

1. Fix 4 minor blueprint compliance issues — Engagement Milestone Close-Out (add step 5), Exit Readiness Check (split step 1), Stakeholder Alignment Check (expand Expected Outcome), Case Study Capture (expand Expected Outcome). Affects 4 entries.

1. Fix 2 content quality issues — Quarterly Practice Health Check (move strategic skills to prerequisites), Client Offboarding Process (replace "conversion rate"). Affects 2 entries.

1. Optional: Vary "Waiting until..." Common Mistakes pattern across 3 entries.

Total entries needing fixes: 13 of 40 (some entries have multiple issues) Entries that are production-ready as-is: 27 of 40

Regeneration Log

All fixes applied 2026-04-28.