Anti-spam: Restrict new users from posting hyperlinks / images

Re: Anti-spam: Restrict new users from posting hyperlinks / images

Yves Julien — Sun, 12 Jan 2014 14:11:14 -0600

Hello Sheik,

I'm actually looking for such a add-on to block those annoying Spammers.

Will you're version works with Phorum version 5.1.16a ?

It would interesting if you could have a feature to deactivate this function after a certain x of post. The reason for this is because some newly register user can take month before posting. I know spammers that register account months in advance before starting spamming. Probably to circumvent those add-on like yours.

Thanks,

Yves

Re: Anti-spam: Restrict new users from posting hyperlinks / images

tecmade — Sun, 09 Dec 2012 05:08:42 -0600

Sorry, invalid thread

Re: Anti-spam: Restrict new users from posting hyperlinks / images

sheik — Wed, 17 Oct 2012 05:56:45 -0500

I have now added support for the Premium Subscribers Module, so you can disable restrictions for premium subscribers to your forum.

The module seems to be working well on my forum, so is now available for public download at [www.phorum.org]

/\dam

Re: Anti-spam: Restrict new users from posting hyperlinks / images

sheik — Mon, 15 Oct 2012 11:28:32 -0500

Initial admin screen, note I have added a "maximum message length" for different users. If this has already been implemented elsewhere I will remove it.

I am going to run this in the wild for a few days and if there are no problems I will release it.

/\dam

Re: Anti-spam: Restrict new users from posting hyperlinks / images

sheik — Mon, 15 Oct 2012 09:15:17 -0500

The above algorithm in code:

// first count and remove all bbcode [ url ] tags and everything between them
$parsed_message = preg_replace('@[url(.*?)[/url\]@', '', $message["body"],-1,$num_bbcodelinks);
		
// now count and remove all remaining http*://*. strings to catch http and https links
$parsed_message = preg_replace('/http(.*?)\:\/\/(.*?)\./i', '', $parsed_message, -1, $num_hyperlinks);
		
// now count and remove all remaining www.* strings
$parsed_message = preg_replace('/www(.*?)\./i', '', $parsed_message, -1, $num_wwwlinks);
		
// count all mailto.* strings
preg_match_all('@[email(.*?)[/email\]@', $parsed_message, $matches);
$num_mailtolinks = count($matches[0]);
		
$total_num_links = $num_hyperlinks + $num_bbcodelinks + $num_wwwlinks + $num_mailtolinks;

Initial tests seem to work OK.

/\dam

Re: Anti-spam: Restrict new users from posting hyperlinks / images

sheik — Mon, 15 Oct 2012 06:01:49 -0500

OK, one possible algorithm would involve doing multiple calls to preg_replace.
eg:
- match all instances of pairs of bbcode url open and close tags. Delete all of these strings and make a note of how many matches there were.
- use the output from the above bulk replace to search for strings that start with "http ://" - again count and delete them
- use the output from the above bulk replace to search for strings that start with "www.*." - count them
- add up the three totals from the above, and it *should* give an accurate link count for my previous example.

I think this would work but I'd need to code and test it.
It would use up slightly more memory and CPU than my previous (incorrect) algorithm as the message body would be copied in memory and more intensive regexes would be performed on it.

Thoughts?

/\dam

Re: Anti-spam: Restrict new users from posting hyperlinks / images

sheik — Sun, 14 Oct 2012 23:57:36 -0500

Thanks Thomas, I have a proof-of-concept module working that restricts unregistered users only.

I am detecting unregistered users by:

$tsregistered = $PHORUM["user"]["date_added"];
if (!$tsregistered){ // user is UNREGISTERED

Is there a better way?

Additionally, I could use some advice on how to target hyperlinks.
As far as I know, there are three ways to post web links in Phorum and spammers certainly use all of these on my forums:

1: Enter a straightforward http:// address - Phorum auto-parses this to make it clickable
2: Use the bbcode tag (note, you do not need to prefix with http:// for this to work, bbcode will make *anything* clickable and let the browser worry about what to do with it)
3: Just type a www.foo.com address - it won't be made clickable but users will see it.

I am counting instances of (1) using:

preg_match_all('@(https?://([-\w\.]+)+(:\d+)?(/([\w/_\.]*(\?\S+)?)?)?)@', $message["body"], $matches);

(I swiped this off the web, preliminary testing suggests it seems to work)

instances of (2) using:

preg_match_all('/\[url/', $message["body"], $matches);

(I'm just counting opening bbcode url tags, I don't care about closing ones)

and instances of (3) using:

preg_match_all('/\\www\.(.*?)\./i', $message["body"], $matches);

(this should look for any consecutive string starting with "www." (case-insensitive) and containing at least one other ".")

Now, the problem with the above is that my *total* count of links will often be higher than it should be.
For example, http://www.this.test.link is technically only one link but my regexs above will count it as 2 http links, 1 bbcode link and 2 www links, giving a total of 5 hyperlinks instead of one.

After this gets solved "mailto" links would need to be detected too.

It is late here, so I'm going to sleep on the problem - feedback would be appreciated.

/\dam

Re: Anti-spam: Restrict new users from posting hyperlinks / images

Thomas Seifert — Sun, 14 Oct 2012 04:07:25 -0500

have a look at the posting hooks, for example the check_post hook [www.phorum.org] .
But you will have to do your own parsing for links there.

Re: Anti-spam: Restrict new users from posting hyperlinks / images

sheik — Sat, 13 Oct 2012 18:36:42 -0500

Yes, but then you have to redo your changes if you want to benefit from updates to the original codebase.
I agree your suggestion is quicker and easier - I just think it's cleaner to keep it as a separate mod.

/\dam

Re: Anti-spam: Restrict new users from posting hyperlinks / images

DavidVonB — Sat, 13 Oct 2012 18:11:05 -0500

Well, since BBCode is a module, you can create a new mod and activate that rather than the "standard" BBCode module.

Re: Anti-spam: Restrict new users from posting hyperlinks / images

sheik — Sat, 13 Oct 2012 13:27:37 -0500

I'd rather keep it a clean module rather than hacking core routines.
My inclination would be to use a hook before bbcode gets involved, to strip out anything starting with "http ://", "ftp ://" etc based on the user's registration date and the module's own, internal logic.
Ideally I'd then use another hook to display a message to the user explaining what has happened to their post and why.

This should actually be a fairly straightforward module to write. I'd just appreciate some guidance on the hooks to use, and also how to pull back the current user's registration date.

Some admins might also like to base the rules upon how many posts a user has made, so that would be good to know how to extract too.

Cheers,

/\dam

Re: Anti-spam: Restrict new users from posting hyperlinks / images

DavidVonB — Sat, 13 Oct 2012 04:58:55 -0500

I did something like that a number of years ago (for the links). You need to modify the bbcode module
function bbcode_url_handler($content, $args) (in the api.php program in the mod subdirectory)

You just need to add some conditional code toward the end of the function and modify what gets returned.

Anti-spam: Restrict new users from posting hyperlinks / images

sheik — Fri, 12 Oct 2012 09:28:47 -0500

(Apologies if this has been requested before, I have been away from these forums for over a year)

Has anybody written a module to restrict new users from posting hyperlinks?
This would make the job of a spammer harder.

Ideally, the module would be configurable and flexible enough to support things like the following:

Maximum number of hyperlinks per post for unregistered users
Maximum number of hyperlinks per post for registered users younger than x days
Maximum number of hyperlinks per post for registered users
Maximum number of images per post for unregistered users
Maximum number of images per post for registered users younger than x days
Maximum number of images per post for registered users
No restrictions for users older than y days

I haven't written a Phorum module for a few years, but would be willing to write this one if somebody gave me some pointers.

Thank you,

/\dam