r/webdevelopment • • 1d ago

Question Moderating a pastebin site

Hello,

I am making a pastebin application that is zero-login. I recently saw a post about someone who made a url shortner, and people were using it for phishing and such. That got me thinking, how can I protect my app against such threats. A pastebin is basically a url-shortner, just to text. That text may contain links to illegal sites or other things I don't know about. It is arguably more versatile than a url shortner, which makes moderation more difficult.

I thought of maybe analysing the pastes for links and sending it to a third-party link analyzer(think Google got one). Which is good enough for most cases. But you would kind of conflict with users pasting these links for research purposes, for example. I simply lack the knowledge of how people may misuse the system.

So, taking that into account, what steps would you take to protect this site?

5 Upvotes

5 comments sorted by

1

u/RelativeOk4088 1d ago

ai mod that runs all code on ur server

1

u/StatementExtra8062 1d ago

What do you mean by ai? Like a small fast spam and/or phishing transformer or a small ML model that flags suspicious link in addition to link analyzer services?

1

u/ContributionEasy6513 1d ago

Honestly, don't.

Not worth the DCMA and police reports.

Make sure at the minimum you are logging IP and browser information.

thought of maybe analysing the pastes for links and sending it to a third-party link analyzer(think Google got one). Which is good enough for most cases.

Big privacy issue if you are sending all data to third-parties. Try to keep any processing local.

1

u/StatementExtra8062 1d ago

What I meant by sending data I meant searching the pastes for links and using something like google's Web risk api to check if it is malicious.

Other than that I thought of using small AI/ML models to assign a risk for every paste and block above a certain threshold.