Command Info

Name: websites:cleanup-duplicates

Description: Find and clean up duplicate websites (including IDN Unicode/Punycode duplicates)

Status: completed

Start Time: 2026-07-10 16:09:10

End Time: 2026-07-10 16:09:12

Total Time: 2 seconds

Dispatched Jobs Count: 0

Successful Jobs Count: 0

Failed Jobs Count: 0

Output

16:09:10 Lock acquired for command: websites:cleanup-duplicates
16:09:11 🔍 Starting duplicate website cleanup...
16:09:11 Found 1 group(s) of duplicate websites.
16:09:11 Re-keying domain-keyed data onto the keeper BEFORE merging, so nothing is orphaned.
16:09:11 <fg=yellow>Duplicate group for: https://adlogger.org</>
16:09:11 <fg=green>KEEP: ID 3cfc1c33-d85c-456e-8fcb-31cba35e16b8, www.adlogger.org (type LINK, status LIVE)</>
16:09:11 <fg=red>DELETE: ID 3f145f93-5828-402a-b852-856ed442282b, adlogger.org (type LINK, status LIVE)</>
16:09:11 ⚠️ Keeper and losers already share the canonical domain_name. If websites:canonicalize-hosts already ran, data filed under the old variant may be missed.
16:09:12 📊 Cleanup complete:
16:09:12 ✅ Groups processed: 1
16:09:12 ⏭ Groups skipped (re-key/keeper failures): 0
16:09:12 ❗ Groups aborted (unexpected error): 0
16:09:12 🔄 Domain-keyed docs re-keyed onto keepers: 0
16:09:12 🧹 Logical duplicates merged: 0
16:09:12 ✅ Losers deleted: 1
16:09:12 ⏭ Losers skipped (reassign failures): 0
16:09:12 🔤 Keepers canonicalized: 1
16:09:12 💡 Re-run websites:audit-idn-duplicate-data to confirm 0 at-risk docs for the merged groups.
16:09:12 Lock released for websites:cleanup-duplicates