Command Info

Name: whois:dedupe

Description: Delete duplicate whois_data docs, keeping the newest per domainName (dry-run unless --no-confirm)

Status: completed

Start Time: 2026-10-13 16:03:42

End Time: 2026-10-13 16:03:44

Total Time: 2 seconds

Dispatched Jobs Count: 0

Successful Jobs Count: 0

Failed Jobs Count: 0

Output

16:03:42 Lock acquired for command: whois:dedupe
16:03:42 🔍 Scanning whois_data for duplicate domainName values...
16:03:42 Duplicate groups: 308
16:03:42 Redundant documents: 10338
16:03:42 Distinct keys: 2436 (0 with a legacy spelling to rewrite)
16:03:42 canyonthemes.com × 208
16:03:42 ayakacasinos.com × 397
16:03:42 xn--lck0a4du98mjrdpy0itfm.jp × 67
16:03:42 stichtingunitvictor.nl × 105
16:03:42 sunplaza.jp × 67
16:03:42 … 303 more group(s)
16:03:44 Archive: 10338 document(s) copied to whois_data_dedupe_archive (existing snapshots kept).
16:03:44 ✅ Deleted 10338 redundant whois_data document(s); rewrote 0 keeper(s) to the normalized key.
16:03:44 Pre-mutation copies are in whois_data_dedupe_archive (the first snapshot per _id is kept).
16:03:44 Next: php artisan mongo:ensure-indexes — creates the unique whois_data.domainName index now that duplicates are gone.
16:03:44 Lock released for whois:dedupe