Safe thresholds for duplicate order candidates
Last updated: 2026-07-31
Written and reviewed by Seller Profit Guard Editorial Team.
Exact fingerprint groups and probable business-key groups need different authority. Default unexpected-group tolerance to zero, keep timestamp and amount windows narrow and versioned, and force probable groups to Review. No threshold may waive malformed rows, mixed grains, private content, weak evidence, open conflicts, missing backup, or untested restoration.
Exact rule
Fingerprint equality creates a candidate group. The duplicate-threshold register records source version, canonical grain, invented row position, synthetic key, event timestamp, amount unit, item count, source label, fingerprint version, row role, expected group, threshold version, owner, reviewer, exception, and prior accepted value needed for bounded reviewer escalation.
Still review provenance. At checkpoint 1, reperform the duplicate-import and split-shipment fixtures plus one counterexample, report only counts and categories, and state which identity, reconciliation, privacy, accounting, fraud, platform, or deletion conclusion remains outside this checker.
Probable rule
Same order role, key, count, amount, and time window creates Review. The duplicate-threshold register records source version, canonical grain, invented row position, synthetic key, event timestamp, amount unit, item count, source label, fingerprint version, row role, expected group, threshold version, owner, reviewer, exception, and prior accepted value needed for bounded reviewer escalation.
No auto-delete. At checkpoint 2, reperform the duplicate-import and split-shipment fixtures plus one counterexample, report only counts and categories, and state which identity, reconciliation, privacy, accounting, fraud, platform, or deletion conclusion remains outside this checker.
Timestamp window
Use zero or narrow minutes at one event timezone. The duplicate-threshold register records source version, canonical grain, invented row position, synthetic key, event timestamp, amount unit, item count, source label, fingerprint version, row role, expected group, threshold version, owner, reviewer, exception, and prior accepted value needed for bounded reviewer escalation.
Version it. At checkpoint 3, reperform the duplicate-import and split-shipment fixtures plus one counterexample, report only counts and categories, and state which identity, reconciliation, privacy, accounting, fraud, platform, or deletion conclusion remains outside this checker.
Amount tolerance
Use explicit absolute units and rounding convention. The duplicate-threshold register records source version, canonical grain, invented row position, synthetic key, event timestamp, amount unit, item count, source label, fingerprint version, row role, expected group, threshold version, owner, reviewer, exception, and prior accepted value needed for bounded reviewer escalation.
No hidden currency conversion. At checkpoint 4, reperform the duplicate-import and split-shipment fixtures plus one counterexample, report only counts and categories, and state which identity, reconciliation, privacy, accounting, fraud, platform, or deletion conclusion remains outside this checker.
Expected groups
Treat fixture counts as assertions. The duplicate-threshold register records source version, canonical grain, invented row position, synthetic key, event timestamp, amount unit, item count, source label, fingerprint version, row role, expected group, threshold version, owner, reviewer, exception, and prior accepted value needed for bounded reviewer escalation.
Declare in advance. At checkpoint 5, reperform the duplicate-import and split-shipment fixtures plus one counterexample, report only counts and categories, and state which identity, reconciliation, privacy, accounting, fraud, platform, or deletion conclusion remains outside this checker.
Unexpected allowance
Default to zero and escalate differences. The duplicate-threshold register records source version, canonical grain, invented row position, synthetic key, event timestamp, amount unit, item count, source label, fingerprint version, row role, expected group, threshold version, owner, reviewer, exception, and prior accepted value needed for bounded reviewer escalation.
Never waive structure. At checkpoint 6, reperform the duplicate-import and split-shipment fixtures plus one counterexample, report only counts and categories, and state which identity, reconciliation, privacy, accounting, fraud, platform, or deletion conclusion remains outside this checker.
Split exception
Require distinct shipment roles and fingerprints. The duplicate-threshold register records source version, canonical grain, invented row position, synthetic key, event timestamp, amount unit, item count, source label, fingerprint version, row role, expected group, threshold version, owner, reviewer, exception, and prior accepted value needed for bounded reviewer escalation.
No generic repeated-key exemption. At checkpoint 7, reperform the duplicate-import and split-shipment fixtures plus one counterexample, report only counts and categories, and state which identity, reconciliation, privacy, accounting, fraud, platform, or deletion conclusion remains outside this checker.
Privacy gate
Any unsafe content blocks. The duplicate-threshold register records source version, canonical grain, invented row position, synthetic key, event timestamp, amount unit, item count, source label, fingerprint version, row role, expected group, threshold version, owner, reviewer, exception, and prior accepted value needed for bounded reviewer escalation.
No threshold override. At checkpoint 8, reperform the duplicate-import and split-shipment fixtures plus one counterexample, report only counts and categories, and state which identity, reconciliation, privacy, accounting, fraud, platform, or deletion conclusion remains outside this checker.
Evidence gate
Short context, invalid period, or open conflict blocks. The duplicate-threshold register records source version, canonical grain, invented row position, synthetic key, event timestamp, amount unit, item count, source label, fingerprint version, row role, expected group, threshold version, owner, reviewer, exception, and prior accepted value needed for bounded reviewer escalation.
Complete packet. At checkpoint 9, reperform the duplicate-import and split-shipment fixtures plus one counterexample, report only counts and categories, and state which identity, reconciliation, privacy, accounting, fraud, platform, or deletion conclusion remains outside this checker.
Authority gate
Only named reviewers disposition candidates. The duplicate-threshold register records source version, canonical grain, invented row position, synthetic key, event timestamp, amount unit, item count, source label, fingerprint version, row role, expected group, threshold version, owner, reviewer, exception, and prior accepted value needed for bounded reviewer escalation.
Ready cannot delete. At checkpoint 10, reperform the duplicate-import and split-shipment fixtures plus one counterexample, report only counts and categories, and state which identity, reconciliation, privacy, accounting, fraud, platform, or deletion conclusion remains outside this checker.
Restoration gate
Require backup and tested recovery before operational change. The duplicate-threshold register records source version, canonical grain, invented row position, synthetic key, event timestamp, amount unit, item count, source label, fingerprint version, row role, expected group, threshold version, owner, reviewer, exception, and prior accepted value needed for bounded reviewer escalation.
Preserve original. At checkpoint 11, reperform the duplicate-import and split-shipment fixtures plus one counterexample, report only counts and categories, and state which identity, reconciliation, privacy, accounting, fraud, platform, or deletion conclusion remains outside this checker.
Duplicate Candidate Thresholds: grain and provenance integrity control
Partition every packet by source type, canonical event grain, currency, period, and version before grouping. Control 1 defines a pass condition, evidence owner, independent reviewer, correction deadline, counterexample, monitoring signal, stop condition, and restoration trigger for bounded reviewer escalation.
Mixed populations block. Apply it while keeping structural validation, canonical mapping, candidate grouping, protected disposition, downstream reconciliation, and destructive authority separate.
Duplicate Candidate Thresholds: fingerprint and candidate evidence control
Version the fingerprint recipe and distinguish exact tokens, probable business keys, repeated identifiers, and legitimate exceptions. Control 2 defines a pass condition, evidence owner, independent reviewer, correction deadline, counterexample, monitoring signal, stop condition, and restoration trigger for bounded reviewer escalation.
A candidate is not identity proof. Apply it while keeping structural validation, canonical mapping, candidate grouping, protected disposition, downstream reconciliation, and destructive authority separate.
Duplicate Candidate Thresholds: threshold and expectation control control
Declare timestamp, amount, expected-group, and unexpected-group rules before running fixtures. Control 3 defines a pass condition, evidence owner, independent reviewer, correction deadline, counterexample, monitoring signal, stop condition, and restoration trigger for bounded reviewer escalation.
Changes require retesting. Apply it while keeping structural validation, canonical mapping, candidate grouping, protected disposition, downstream reconciliation, and destructive authority separate.
Duplicate Candidate Thresholds: dated confirmation contract control
Require real source-review and policy-effective dates, keep policy no later than source review, affirm all nine controls, and reject copied duplicate-import and split-shipment packets. Control 4 defines a pass condition, evidence owner, independent reviewer, correction deadline, counterexample, monitoring signal, stop condition, and restoration trigger for bounded reviewer escalation.
Missing or duplicated evidence blocks. Apply it while keeping structural validation, canonical mapping, candidate grouping, protected disposition, downstream reconciliation, and destructive authority separate.
Duplicate Candidate Thresholds: bounded public packet control
Limit each scenario to 2–100 synthetic rows and 50,000 evidence characters, strictly parse thresholds, and mask every derived group under Block. Control 5 defines a pass condition, evidence owner, independent reviewer, correction deadline, counterexample, monitoring signal, stop condition, and restoration trigger for bounded reviewer escalation.
A public worksheet is not a production deduplication engine. Apply it while keeping structural validation, canonical mapping, candidate grouping, protected disposition, downstream reconciliation, and destructive authority separate.
Duplicate Candidate Thresholds: privacy and output minimization control
Use invented public descriptors, report counts only, and keep protected rows in authorized storage. Control 6 defines a pass condition, evidence owner, independent reviewer, correction deadline, counterexample, monitoring signal, stop condition, and restoration trigger for bounded reviewer escalation.
Never echo private values. Apply it while keeping structural validation, canonical mapping, candidate grouping, protected disposition, downstream reconciliation, and destructive authority separate.
Duplicate Candidate Thresholds: human disposition authority control
Require a named reviewer, retained reference, reason, reconciliation, and approval before excluding anything. Control 7 defines a pass condition, evidence owner, independent reviewer, correction deadline, counterexample, monitoring signal, stop condition, and restoration trigger for bounded reviewer escalation.
Ready cannot delete. Apply it while keeping structural validation, canonical mapping, candidate grouping, protected disposition, downstream reconciliation, and destructive authority separate.
Duplicate Candidate Thresholds: monitoring and restoration control
Preserve source, prior rules, dispositions, derived totals, stop triggers, and a tested restore path. Control 8 defines a pass condition, evidence owner, independent reviewer, correction deadline, counterexample, monitoring signal, stop condition, and restoration trigger for bounded reviewer escalation.
Rollback evidence is mandatory. Apply it while keeping structural validation, canonical mapping, candidate grouping, protected disposition, downstream reconciliation, and destructive authority separate.
Exact rule: synthetic duplicate lab 1
Reperform both packets. Fingerprint equality creates a candidate group. Change one row label, synthetic key, timestamp, amount, item count, source label, fingerprint, role, expected group, threshold, evidence term, or scope statement only; preserve the rest and record exact, probable, repeated-key, split, unexpected, and decision outputs.
Still review provenance. Test clean, boundary, and failed values without exposing production rows. Explain the dominant change, protected evidence still required, disposition authority, and exact stop or restoration action before any operational use.
Probable rule: synthetic duplicate lab 2
Reperform both packets. Same order role, key, count, amount, and time window creates Review. Change one row label, synthetic key, timestamp, amount, item count, source label, fingerprint, role, expected group, threshold, evidence term, or scope statement only; preserve the rest and record exact, probable, repeated-key, split, unexpected, and decision outputs.
No auto-delete. Test clean, boundary, and failed values without exposing production rows. Explain the dominant change, protected evidence still required, disposition authority, and exact stop or restoration action before any operational use.
Timestamp window: synthetic duplicate lab 3
Reperform both packets. Use zero or narrow minutes at one event timezone. Change one row label, synthetic key, timestamp, amount, item count, source label, fingerprint, role, expected group, threshold, evidence term, or scope statement only; preserve the rest and record exact, probable, repeated-key, split, unexpected, and decision outputs.
Version it. Test clean, boundary, and failed values without exposing production rows. Explain the dominant change, protected evidence still required, disposition authority, and exact stop or restoration action before any operational use.
Amount tolerance: synthetic duplicate lab 4
Reperform both packets. Use explicit absolute units and rounding convention. Change one row label, synthetic key, timestamp, amount, item count, source label, fingerprint, role, expected group, threshold, evidence term, or scope statement only; preserve the rest and record exact, probable, repeated-key, split, unexpected, and decision outputs.
No hidden currency conversion. Test clean, boundary, and failed values without exposing production rows. Explain the dominant change, protected evidence still required, disposition authority, and exact stop or restoration action before any operational use.
Expected groups: synthetic duplicate lab 5
Reperform both packets. Treat fixture counts as assertions. Change one row label, synthetic key, timestamp, amount, item count, source label, fingerprint, role, expected group, threshold, evidence term, or scope statement only; preserve the rest and record exact, probable, repeated-key, split, unexpected, and decision outputs.
Declare in advance. Test clean, boundary, and failed values without exposing production rows. Explain the dominant change, protected evidence still required, disposition authority, and exact stop or restoration action before any operational use.
Unexpected allowance: synthetic duplicate lab 6
Reperform both packets. Default to zero and escalate differences. Change one row label, synthetic key, timestamp, amount, item count, source label, fingerprint, role, expected group, threshold, evidence term, or scope statement only; preserve the rest and record exact, probable, repeated-key, split, unexpected, and decision outputs.
Never waive structure. Test clean, boundary, and failed values without exposing production rows. Explain the dominant change, protected evidence still required, disposition authority, and exact stop or restoration action before any operational use.
Split exception: synthetic duplicate lab 7
Reperform both packets. Require distinct shipment roles and fingerprints. Change one row label, synthetic key, timestamp, amount, item count, source label, fingerprint, role, expected group, threshold, evidence term, or scope statement only; preserve the rest and record exact, probable, repeated-key, split, unexpected, and decision outputs.
No generic repeated-key exemption. Test clean, boundary, and failed values without exposing production rows. Explain the dominant change, protected evidence still required, disposition authority, and exact stop or restoration action before any operational use.
Privacy gate: synthetic duplicate lab 8
Reperform both packets. Any unsafe content blocks. Change one row label, synthetic key, timestamp, amount, item count, source label, fingerprint, role, expected group, threshold, evidence term, or scope statement only; preserve the rest and record exact, probable, repeated-key, split, unexpected, and decision outputs.
No threshold override. Test clean, boundary, and failed values without exposing production rows. Explain the dominant change, protected evidence still required, disposition authority, and exact stop or restoration action before any operational use.
Evidence gate: synthetic duplicate lab 9
Reperform both packets. Short context, invalid period, or open conflict blocks. Change one row label, synthetic key, timestamp, amount, item count, source label, fingerprint, role, expected group, threshold, evidence term, or scope statement only; preserve the rest and record exact, probable, repeated-key, split, unexpected, and decision outputs.
Complete packet. Test clean, boundary, and failed values without exposing production rows. Explain the dominant change, protected evidence still required, disposition authority, and exact stop or restoration action before any operational use.
Authority gate: synthetic duplicate lab 10
Reperform both packets. Only named reviewers disposition candidates. Change one row label, synthetic key, timestamp, amount, item count, source label, fingerprint, role, expected group, threshold, evidence term, or scope statement only; preserve the rest and record exact, probable, repeated-key, split, unexpected, and decision outputs.
Ready cannot delete. Test clean, boundary, and failed values without exposing production rows. Explain the dominant change, protected evidence still required, disposition authority, and exact stop or restoration action before any operational use.
Restoration gate: synthetic duplicate lab 11
Reperform both packets. Require backup and tested recovery before operational change. Change one row label, synthetic key, timestamp, amount, item count, source label, fingerprint, role, expected group, threshold, evidence term, or scope statement only; preserve the rest and record exact, probable, repeated-key, split, unexpected, and decision outputs.
Preserve original. Test clean, boundary, and failed values without exposing production rows. Explain the dominant change, protected evidence still required, disposition authority, and exact stop or restoration action before any operational use.
Duplicate Candidate Thresholds: intent-specific implementation walkthrough
duplicate-threshold register checkpoint 1 addresses exact rule for bounded reviewer escalation. Fingerprint equality creates a candidate group. Record the classification decision, failed alternative, reviewer question, retained evidence, correction owner, downstream check, monitoring signal, and restoration value. Still review provenance.
duplicate-threshold register checkpoint 2 addresses probable rule for bounded reviewer escalation. Same order role, key, count, amount, and time window creates Review. Record the classification decision, failed alternative, reviewer question, retained evidence, correction owner, downstream check, monitoring signal, and restoration value. No auto-delete.
duplicate-threshold register checkpoint 3 addresses timestamp window for bounded reviewer escalation. Use zero or narrow minutes at one event timezone. Record the classification decision, failed alternative, reviewer question, retained evidence, correction owner, downstream check, monitoring signal, and restoration value. Version it.
duplicate-threshold register checkpoint 4 addresses amount tolerance for bounded reviewer escalation. Use explicit absolute units and rounding convention. Record the classification decision, failed alternative, reviewer question, retained evidence, correction owner, downstream check, monitoring signal, and restoration value. No hidden currency conversion.
duplicate-threshold register checkpoint 5 addresses expected groups for bounded reviewer escalation. Treat fixture counts as assertions. Record the classification decision, failed alternative, reviewer question, retained evidence, correction owner, downstream check, monitoring signal, and restoration value. Declare in advance.
duplicate-threshold register checkpoint 6 addresses unexpected allowance for bounded reviewer escalation. Default to zero and escalate differences. Record the classification decision, failed alternative, reviewer question, retained evidence, correction owner, downstream check, monitoring signal, and restoration value. Never waive structure.
duplicate-threshold register checkpoint 7 addresses split exception for bounded reviewer escalation. Require distinct shipment roles and fingerprints. Record the classification decision, failed alternative, reviewer question, retained evidence, correction owner, downstream check, monitoring signal, and restoration value. No generic repeated-key exemption.
duplicate-threshold register checkpoint 8 addresses privacy gate for bounded reviewer escalation. Any unsafe content blocks. Record the classification decision, failed alternative, reviewer question, retained evidence, correction owner, downstream check, monitoring signal, and restoration value. No threshold override.
duplicate-threshold register checkpoint 9 addresses evidence gate for bounded reviewer escalation. Short context, invalid period, or open conflict blocks. Record the classification decision, failed alternative, reviewer question, retained evidence, correction owner, downstream check, monitoring signal, and restoration value. Complete packet.
duplicate-threshold register checkpoint 10 addresses authority gate for bounded reviewer escalation. Only named reviewers disposition candidates. Record the classification decision, failed alternative, reviewer question, retained evidence, correction owner, downstream check, monitoring signal, and restoration value. Ready cannot delete.
duplicate-threshold register checkpoint 11 addresses restoration gate for bounded reviewer escalation. Require backup and tested recovery before operational change. Record the classification decision, failed alternative, reviewer question, retained evidence, correction owner, downstream check, monitoring signal, and restoration value. Preserve original.
Evidence boundary for bounded reviewer escalation
The duplicate-import packet contains two invented order rows sharing one fingerprint plus one unrelated row. The split-shipment packet repeats an ORD-SYN key across distinct shipment roles, values, timestamps, and fingerprints.
The packet demonstrates entered candidate-group logic only. It cannot prove production identity, deletion safety, source completeness, platform error, fraud, accounting accuracy, privacy compliance, payout reconciliation, tax treatment, or the correct retained record.
Release, monitor, and restore the duplicate-threshold register
Block shape, pattern, timestamp, numeric, source, fingerprint, role, context, threshold, privacy, evidence, scope, or conflict failures. Review probable or unexpected groups. Ready clears only fixtures that match declared expectations.
Before indexing or operational use, preserve evidence and rollback artifacts; run typecheck, unit, integration, build, content, similarity, SEO, image, link, privacy, mobile, strict-route, deployment, and live checks; then monitor drift without claiming causality.
Sources and further reading
- W3C: Model for Tabular Data and Metadata on the Web: Official row, primary-key, source-order, provenance, and repeated-primary-key validation model.
- W3C: CSV on the Web Primer: Official schema, identifier, validation, and documented-processing examples.
- IETF RFC 4180: Informational CSV record, header, field-count, quoting, interoperability, and privacy context.
- Etsy Help: Download sold transactions: Official distinction among order items, orders, payment sales, and deposits.
- Shopify Help: Exporting orders: Official order-export and transaction-history structure and delivery guidance.
- Seller Profit Guard methodology: Evidence, privacy, correction, release, monitoring, and rollback controls.
- Seller Profit Guard data privacy: Local-first boundaries for synthetic rows, identifiers, fingerprints, orders, buyers, and raw files.
Related Seller Profit Guard tools
- Duplicate Order Checker: Group invented candidate rows without deleting or merging anything.
- Seller CSV Import Validator: Validate synthetic structure before duplicate review.
- Seller CSV Column Mapper: Map sources to one canonical grain before grouping rows.
- Payment Reconciliation: Reconcile retained order and payment populations after disposition.
- Ad Attribution Reconciliation Checker: Classify aggregate attribution rows separately.
- SKU Naming Generator: Design stable product identifiers without buyer data.
- Guides: Browse related seller evidence workflows.
- How It Works: Understand browser-local processing boundaries.
- Methodology: Review source, formula, correction, release, and restoration rules.
- Data Privacy: Protect customer, payment, address, credential, and raw export data.
- Changelog: Track dated public changes.
- Duplicate Order Checker Formula and Inputs: Define the exact fingerprint, probable-match, repeated-key, and split-shipment logic for synthetic seller rows, including thresholds and privacy boundaries.
- Duplicate Import Worked Example: Work through one invented repeated-file import and one unrelated order row without using customer or production data, then document review controls.
- Split Shipment Duplicate Check: Preserve legitimate shipment rows that share an order reference while exposing why order-level uniqueness would be unsafe.
- Duplicate Order Checker Mistakes: Diagnose grain, fingerprint, threshold, provenance, privacy, exception, and destructive-action mistakes that create false duplicate claims.
- Duplicate Order Check Data Sources: Map duplicate-review inputs to first-party export documentation, protected source pointers, canonical dictionaries, and versioned synthetic fixtures.
- Duplicate Imports vs Split Shipments: Compare repeated file imports and legitimate split shipments at a consistent evidence level without collapsing their different grains.
- Weekly Duplicate Review Routine: Turn duplicate candidate review into a repeatable weekly control with versioned fixtures, protected dispositions, reconciliation, monitoring, and restoration.
- Interpret Duplicate Check Results: Read exact groups, probable groups, repeated keys, split-shipment groups, unexpected counts, and decisions without claiming production identity.
- Duplicate Review Audit Template: Use a checklist and change log for source, grain, fingerprint, thresholds, exceptions, dispositions, reconciliation, authority, monitoring, and restoration.
Next step: Open Seller Profit Guard.
This is operational planning help, not tax, accounting, legal, financial, or platform-policy advice. Review the Terms and disclaimer, and verify current platform rules and fee assumptions before changing prices.