Welcome to DU! The truly grassroots left-of-center political community where regular people, not algorithms, drive the discussions and set the standards. Join the community: Create a free account Support DU (and get rid of ads!): Become a Star Member Latest Breaking News Editorials & Other Articles General Discussion The DU Lounge All Forums Issue Forums Culture Forums Alliance Forums Region Forums Support Forums Help & Search

General Discussion

erronis

(22,195 posts)

5. Reposts are hard to avoid since they may include information coming from different sources.

Reply to MichMan (Reply #2)

Sun Nov 30, 2025, 05:05 PM

Sunday

I usually try to do a search of one or two key terms before posting but that doesn't always work.

I like the idea of DU offering a step after a post is created:

Build a list of prior recent posts that have content that matches at some high percentage. This can be done with Levenshtein distances
Present the top 5 or so prior posts that have a high match
Ask the new post submitter if they want to continue to add a new post or add the new information to one of the already existing ones.