# Data Confidence Labels

**Purpose:** Indicate reliability of each data product so counsel knows what to rely on vs. verify.

---

## Label Definitions

| Label | Meaning |
|-------|---------|
| **Verified** | Cross-checked against source; high confidence |
| **Automated** | Script-generated; source traceable; recommend spot-check |
| **Needs review** | Manual verification recommended before reliance |
| **API failed** | Automated fetch failed; use manual lookup |

---

## Evidence & Outputs by Confidence

### Verified

| Item | Source | Notes |
|------|--------|-------|
| 12 Exhibit patents (SOL list) | USPTO public records, patent_app_mapping | Patent numbers, issue dates, applications verified |
| IFEE OCR — Goldberg 18/18 | Automated OCR on USPTO PDFs | Goldberg name in all 18 IFEE forms; spot-check recommended |
| POA PDFs | USPTO API download | Official documents |
| IFEE PDFs | USPTO API download | Official documents |
| Website screenshots | Wayback Machine capture | Archived; dates in filename |
| Patent front pages | Public USPTO records | Line 74 attorney block |
| Assignment screenshots | USPTO Assignment Center capture | 15 full-page PNGs; 13 with assignment data, 2 not found |

### Automated

| Item | Source | Notes |
|------|--------|-------|
| IFW document metadata | USPTO API (documents endpoint) | NOA, IFEE dates; working endpoint |
| Patent lists (905, clusters) | PatentsView / bulk data | Refresh date in file; assignee may need verification |
| Exhibit docket numbers | API fetch | If 0/12: use MANUAL_LOOKUP_INSTRUCTIONS.md |
| Application data (docket, CN) | API fetch | If 0/16: use MANUAL_LOOKUP_INSTRUCTIONS.md |

### Needs review

| Item | Notes |
|------|-------|
| Assignee for exhibits 9, 10, 12 | Marked "(look up)" or "(verify KSU)" in SOL list |
| KNPC patents | Verify via USPTO if needed |
| KFU/KSU accounting split | Per client trackers; confirm with records |

### API failed (when applicable)

| Item | Fallback |
|------|----------|
| Docket numbers | output/MANUAL_LOOKUP_INSTRUCTIONS.md |
| Application data (CN, attorney) | Patent Center or Public Pair manual lookup |

---

## Key Files with Confidence

| File | Label |
|------|-------|
| IFEE_SUBMITTER_RESULTS.md | Automated (OCR); Goldberg 18/18 |
| BEST_EVIDENCE_MEMO.md | Verified + Automated mix |
| SOL_EXHIBIT_LIST_POST_7_21_2024.csv | Verified |
| EXHIBIT_DOCKET_NUMBERS.csv | Automated or API failed |
| APPLICATION_DATA_RESULTS.csv | Automated or API failed |
| CUSTOMER_NUMBER_AND_EVIDENCE_CHAIN_MEMO.md | Verified (CN-37833 from IFW) |
| ASSIGNEE_VERIFICATION_RESULTS.md | Automated (USPTO ODP); verify against patent records |