Reviewing Anti-Spam Offerings 311
Joel Snyder writes "Just finished looking into the innards of 40+ anti-spam products at Network World. The biggest, ugliest, and most comprehensive look at this market that's ever been done. Conclusions: lots of great products to choose from at the top (a dozen or more); a few stinkers in the bunch; and it's basically impossible to review Spam Assassin, which is unfortunate."
Objective (Score:2, Insightful)
"Although these tests were conducted with the assistance of Borderware, we where careful to ensure results where fair and objective."
So, that would be why borderware's product got the #1 position?
Re:Objective (Score:2, Informative)
>"Although these tests were conducted with the
> assistance of Borderware, we where careful to
> ensure results where fair and objective."
So deep that... they must be in some other article. I don't know where you cut-and-pasted that out of, but it sure wasn't the article referenced in this post.
Re:Objective (Score:2, Interesting)
Conclusion: Mods don't check facts - if you want excellent karma post completely false information hinting at a evil corporate/government conspiracy.
GG, mod *this* up (Score:2)
Re:Objective (Score:3, Insightful)
IronPort Systems, a messaging appliance vendor, was asked not to participate in the test because Opus One has an existing consulting contract with this company - including them in the test would have created a conflict of interest.
Re:Objective (Score:2)
Thunderbird (Score:2, Interesting)
Re:Thunderbird (Score:2)
Thunderbird's spam filtering really is amazing. Spend 2 weeks 'training' it with what is spam and what is not, and then tell it to automatically move spam to the junk folder. I have 150 junk mails from the past week -- never saw any of them in my inbox and not one is a false positive.
Re:Thunderbird (Score:2)
Re:Thunderbird (Score:3, Interesting)
A reporting feature (even if thunderbird just exports a database csv file) would provide more value to me. I'd also like to be able to transfer my thunderbird spam filtering profile to new installations (after reformatting, for example).
A lot of other packages (e.g. spamassassin) support some
Re:Thunderbird (Score:3, Informative)
But I do see your point... however, you also have to understand that with Thunderbird, you're not really running a separate application to filter your spam (or running anything on your server for it) - this is just a free email client that does it's own filtering.
Though as I said, I'm quite satisfied. And of course, your mileage may vary.
Re:Thunderbird (Score:3, Informative)
Re:Thunderbird (Score:2)
25/270 = 9.25% of your spam missed.
So, it eliminates nearly 91% of your spam, and you don't think that's great? I've seen commercial programs that don't work that well. You've also got to consider that this is just a bunch of rules that decide based on a few criteria that a message may or may not be spam. I'd much rather a few false negatives than a single false positive, so 9
In-line SPAM filtering - never hits your server (Score:4, Interesting)
I have said it before on here, but I use Mx-logic.com to filter e-mail before it even gets to my mail server (as their filtering is in-line). They run multiple concurrent virus scanners, and you can set all policies related to attachments, sizes, virus scanning, quarantines, SPAM (deny, accept, etc, for different "levels" of probability).
It's really efficient. I haven't gotten a virus in any attachments and maybe just 2-3 SPAM messages / month (down from 100+ / day). It also does cool stuff like remove the imbedded tracking images from SPAM HTML messages (should one get through), etc. No, I don't work for them. I used to quarantine messages and review it weekly (that were medium / high probability spam), now I trust their service so much I just deny receipt to my mail server of any Medium+ probability SPAM
Re:In-line SPAM filtering - never hits your server (Score:2)
"In-line"? That doesn't really make any sense. Sounds like what you're doing is just sending all of your e-mail through someone else's server before it goes to your server. That might be an okay solution for some, but it's not like it's really anything special -- you can easily set that up yourself if you like using another server under your own control.
Re:In-line SPAM filtering - never hits your server (Score:2)
Re:In-line SPAM filtering - never hits your server (Score:3, Interesting)
Only problem with in-line scanning is the time/resource it takes to do it.
While great for low-volume mail servers, you really need a beefy box to enable you to have enough MTA threads for handling the initial SMTP communication, threads for doing the virus scanning/spam filtering, and CPU to do it in the time allowed by the SMTP standard (I *think* it is 180 seconds... probably enough time).
I don't know if there's an advantage to not accepting virus-laden mail as one can biff it "off line" without inv
Re:In-line SPAM filtering - never hits your server (Score:2, Informative)
Re:In-line SPAM filtering - never hits your server (Score:2)
Re:In-line SPAM filtering - never hits your server (Score:2)
Number 1 - Too many missed messages. I've been adding domains to the block list for a year now. I still get more spam messages.
Number 2 - Poor configuration options. The only things I can change is the "aggressiveness" in 4 or 5 catagories (bulk email, porn, attachments, etc), or adding addresses/domains to a white/blacklist. Spam Assassin lets me change scores for different things, which is very nice.
Number 3 - Dependance on offsite server. Gen
That is unfortunate (Score:5, Funny)
Re:That is unfortunate (Score:3, Interesting)
Re:That is unfortunate (Score:5, Funny)
Re:That is unfortunate (Score:2)
Re:That is unfortunate (Score:2)
Re:That is unfortunate (Score:2)
Penny Arcade had a strip about this exact kind of thing, I can't find it for the life of me though.
SpamAssassin? (Score:5, Insightful)
I can only wonder what it was that they asked and who they asked. There are several companies that provide products based on SA, and the developers are very responsive.
I'll have to look in more depth later and see if any of the products they reviewed were SA-based.
Still, a review that does not cover common open source implementations such as DSPAM and SA is not a review that I would put much stake in.
Re:SpamAssassin? (Score:2)
From what I gather, there were. They're saying they couldn't review SpamAssassin as such because you're dealing with a community and not a company, but they do have SpamAssassin based products.
Enterprise support (Score:4, Insightful)
Re:Enterprise support (Score:2)
Translation: Someone else to blame.
Re:Enterprise support (Score:2)
Why is that a problem? People who know what they are responsible for are more likely to do a good job.
Re:Enterprise support (Score:2)
Re:Enterprise support (Score:2)
Red Hat Enterprise Linux is specifically geared to this market (to the exclusion of smaller business customers, who are generally priced out of Red Hat's support pricing), and ships with SA as a supported piece of the OS.
Next concern?
Barracuda (Score:3, Interesting)
IT Department? (Score:2)
Re:SpamAssassin? (Score:2, Informative)
"However, two commercial vendors, Roaring Penguin (on Unix) and NoSpamToday! (on Windows) sent products that exposed their SpamAssassin cores. Although neither met our false-positive threshold for inclusion in the top 12 finalists (probably because of difficulty of tuning Bayesian engines and neural networks in a test lab setting), we were very pleased to have them participate in the project."
Still, a poster that does not RTFA before making such a comment is not a poster I would put much stake i
Where's SpamAssassin? (Score:2, Informative)
The short answer is that no one submitted it, but of course there's more to it than that. This year we reached out to the SpamAssassin community and asked them to participate. Although a few well-meaning souls volunteered to be the contacts for SpamAssassin, when it came time to test no one would step up to the plate and represent the product at a level that would make it competitive to the other enterprise-focused vendors.
Interest in SpamAssassin is understandable. In the small-business market,
Thunderbird very good (Score:2, Informative)
Re:Thunderbird very good (Score:2, Insightful)
Re:Thunderbird very good (Score:3, Insightful)
...but does nothing at all to reduce an ISP's bandwidth, storage, and tech support costs. As such, "just convert everyone to Thunderbird" is more or less useless as a first-line response against spam.
The real payoff is in blocking spam before it ever gets into the system. This is where greylisting, RHSBLs, and server-side spam filtering can save a bundle of cash, both in hardware and reduced administration time.
Disclaimer
Avoiding spam (Score:2, Informative)
Re:Avoiding spam (Score:5, Informative)
There are many ways in which spammers harvest and generate spam messages, and not all of them require entering your e-mail address into web forms.
I have a number of e-mail addresses, some of which date back to the early 90's and use daily, and others which are more recent and which I've never used at all.
My oldest e-mail address was my primary e-mail adddress for newsgroup postings for many, many years. I haven't given or used that address in roughly 2 years now (as I'm using a different address that forwards to this old mailbox), and yet I still get dozens of spam messages being sent to this address daily (all of which are thankfully auttomatically filtered).
On the other end of the spectrum is my Gmail account. I have never used this account for anything at all. I've never sent an e-mail from it, or used it to register for anything. And yet it too receives spam (all of which Google also does a good job of filtering automatically). An old e-mail account I got from my ISP when I signed up for my first cable modem was similar -- I already had a mailbox and never used that account. I never even bothered _checking_ it, until one day nearly a year later out of curiousity to see how many spam messages it may have received -- only to find the mailbox was filled with hundreds of spam messages.
I often see messages where the list of recipients was obviously generated by attaching a list of user names to each entry in a list of domains and then sending the results. And who knows how many Windows e-mail worms out there are sending users address book entries back to spammers.
Best practices can reduce your spam load from certain vectors, but not all of them, making some form of filtering good policy. When even unused mailboxes are getting clogged with spam, however, you know that best practices alone just aren't enough.
Yaz.
Spamassassin (Score:5, Interesting)
The mere appearance of SA, though, is impressive because those trade rags rarely include anything open source (partly due to marketing opportunity for commercial, paying companies).
Jerry http://www.syslog.org/ [syslog.org]
The Best Defense... (Score:4, Insightful)
Do what I do: create a Yahoo (or some other free e-mail) account and use that address for all questionable forms you fill out.
I've had the same address now for almost three years now and receive about five spams per week, at most.
Re:The Best Defense... (Score:2)
Also, it only takes one unscrupulious company to ruin your email address forever. I get 50 spams a day that use my *FULL* name and address on a private email i have never posted.
Re:The Best Defense... (Score:2)
Re:The Best Defense... (Score:2)
stevehenderson is a common word? Is it a verb or a noun?
Re:The Best Defense... (Score:2)
Long, Complicated Email Addresses Beat Spammers [about.com]
Re:The Best Defense... (Score:2)
Re:The Best Defense... (Score:4, Insightful)
Do what I do: create a Yahoo (or some other free e-mail) account and use that address for all questionable forms you fill out.
I've had the same address now for almost three years now and receive about five spams per week, at most.
Maybe that works well on a personal level, it's what I suggest to my friends. However, on a professional level, it doesn't work. You need to give your address out to people, you need them to be able to contact you. That's the nature of doing business, and being careful who you give it to only goes so far.
All it takes is for one person who has your address to be careless and have their address book harvested by a worm. That may be beyond their control, maybe their IT department is clueless. Maybe they use your address on a webform to send you "info" or a "greeting card".
That's why spam filters are necessary, some of us cannot work without having our email addresses out in the real world.
Re:The Best Defense... (Score:2)
and also not do the things you don't do:
Sure, the disposable address idea works great if you only use email for personal conversation exclusively with a small group of people you already know, and as a consumer.
But if you want to publish anything, participate p
Funny (Score:2)
Re:Funny (Score:2)
Built In Tools?? (Score:2)
Too bad (Score:2)
On a side note I have started using SpamBayes-Experimental on my outlook box and it is working well so far.
Re:Too bad (Score:3, Informative)
Re:Too bad (Score:2)
Just regurgitating marketing numbers (Score:4, Interesting)
Re:Just regurgitating marketing numbers (Score:2, Interesting)
Re:Just regurgitating marketing numbers (Score:2)
Out of curiousity, what's your mail volume and what percentage of that is legit?
Spam Solution (Score:3, Informative)
Re:Spam Solution (Score:2)
Ahh, greylisting. All the convenience of deleting mail indiscriminately, with none of the guilt...
MessageLabs (Score:3, Interesting)
Why block spam? (Score:4, Funny)
Re:Why block spam? (Score:2, Troll)
Bullshit review inclusion criteria (Score:2, Informative)
"We invited every anti-spam vendor in our online Buyer's Guide to participate"
And what is there "online Buyer's Guide"? - a pay for inclusion directory!
Between that and their #1 choice helping them with the review process - I have serious questions as to the value of this report
. Accurately simulating a bunch of different anti-spam systems all getting the same e-mail is a bit of
bspam also excellent (Score:3, Informative)
Reject on SMTP. (Score:3, Informative)
RBL (list.dsbl.org : bl.spamcop.net : blackholes.mail-abuse.org : sbl-xbl.spamhaus.org : multihop.dsbl.org : cbl.abuseat.org) + greylistd [debian.org] == average 0 spam in inbox/day.
What I like best about this approach is that you reject most of the spam at SMTP-time without accepting it. If I could I'd add spam-assassin-on-SMTP to the end of the chain, but my server is tight on memory :-(
(Unfortunately there's a bug somewhere between the debian greylistd and python whereby the daemon shuts down on me all the time, but I've lodged a bug report and hope to get some help tracking it down.)
Re:Reject on SMTP. (Score:2)
IPTables --> Postfix --> (new filter that checks SPF records, not fully implemented yet) --> private access list --> RBLs (multiple, at least 20) --> Amavis --> clamd --> spamassassin --> procmail
I don't care what anyone says, RBLs are the best solution, next to my own personal access list and my iptables blocks.
Best solution f
RBLs rule (Score:5, Interesting)
I see no reason to use client or server-side products that analyze the mail content, when this slows down mail service and reliability. RBLs, blocking mail based on the legitimacy of the source address has proven to be the most effective method of curtailing spam, and unlike all the other solutions, this one aversely affects spammers by not allowing them to consume your resources.
If you're in the business of making money off selling spam products, I can see your support of these various half-way solutions, but otherwise, the best way IMO is to employ RBLs at the server level and slowly work towards SMTP whitelisting. I contend this is an inevitability if the authorities don't start prosecuting spammers for their illegal computer tampering.
Re:RBLs rule (Score:2, Interesting)
I would agree that a well-designed reputation-based DNS blacklist can immensely increase the spam catch rat
Re:RBLs rule (Score:4, Insightful)
If I had followed your advice and used all those RBLs, including SORBS, to immediately reject 86% of incoming connections, then 200 of the 1201 legit messages currently in my inbox (none are spam) and various archived mail folders would not be there. That's over 16% false positive rate!
Perhaps not all of those 86% rejected connections were really spam, but rather legitimate mail that bounced. You'll never know, since you dropped the connection before getting the message.
Maybe you don't care about false positives. But I do. That's why I use a cpu-intensive filter, rather than RBLs that are notorious for high rates of false positives.
Maybe you're an admin at a cash-strapped ISP with high mail loads and old servers that can barely handle them. But in my world, CPU cycles are cheap... and hassles of false positives, expecially from prospective customers, are expensive.
Which one? (Score:2)
I'm still waiting... (Score:2, Funny)
Discovered on Previously Cached Version... (Score:2, Insightful)
Where's SpamAssassin?
Although a few well-meaning souls volunteered to be the contacts for SpamAssassin, when our marketting department contacted them regarding advertising no one would step up to the plate and shell-out for print ads like the other enterprise-focused vendors.
They thought it was spam (Score:2)
I don't know how much I trust their conclusions (Score:4, Informative)
It's only one point, but they make a fairly big deal out of it.
Re:I don't know how much I trust their conclusions (Score:4, Interesting)
On the other hand, I don't understand why ANYONE ships ANYTHING that talks on port 80 anymore. It's not like OpenSSL hasn't been proven through-and-through (or you can write your own). Port 80 might be fine for pictures of your vacation, but the management interface on a corporate mail server should be encrypted and authenticated.
However, if you want to discount a 10,000 word article for a single error, then you're going to have a hard time believing anything you ever read anywhere ever.
Smart Spam Usage. (Score:3, Informative)
Spammers will Spam you if they can Guess or Get your Email Address so the trick is to make it hard for them to get it.
Re:Smart Spam Usage. (Score:2, Insightful)
Re:Smart Spam Usage. (Score:2)
Basic? I do not think that word means what you think it means.
Re:Smart Spam Usage. (Score:4, Insightful)
9. Check those checkboxes and make sure that you will not receive Spam from them they may be worded funny so that you will check yes to them.
Rule #1: Spammers lie
If a website is going to collection your personal information to sell to third parties, they're going to do so regardless of whether they have a nice privacy notice. Put another way, these people make their living my lying and stealing, but you expect their privacy notice to be an accurate reflection of their real intent?
Disregard privacy notices. If they're an honest company, then they won't need one. If they're spam-friendly, then they won't care about adding one more lie to the mix.
By the way, I find it interesting that your homepage is a link into an MLM website. I clicked the link, added a random junk item to my shopping cart, and proceeded to checkout. When it asked for my "advisor number", I followed the link to their "Finding your Advisor" search. I typed in "fras" (based on the "advno" parameter in your URL) and determined that your name is Todd Fraser, and you live in Troy, NY.
That's about as far as I'm interested in fleshing out your personal information that you posted to the Internet. I'd call you to talk about it in person at the number Google returned when I searched for "todd fraser troy, ny" (you just live a block from a golf course - is it a nice one?) but I'm still at work.
For trying your hardest to protect your email address, you're awfully eager to give away your real name, address, and phone number. I've given up even attempting to hide mine, but I also post to Slashdot with my real email address so I tend not to worry about such things.
gmail? (Score:3, Interesting)
My gmail account has had 2 false positives out of 500 messages. Given the vulnerability to having your address fall into unknown hands that is inherent in Google's viral marketing technique for promoting the product, I would bet LOTS of other GMAIL users have the large number of spams coming in...even on new accounts where they have been careful who they gave the address too. I get about a dozen spam items a day but when one of the sh!theads sells his address list to the next spammer, I can get a burst. Bottom line: ZERO spams in my inbox...none...not any. The Bayesian stuff that spammers try to circumvent, the spoofed headers...so far none of it fools Google. And since it buffers the spam in its capacious 1Gb-per-account holdings, I have 30 days to check for false positives at my liesure.
Questions?
1. what vulnerability?
when you accept a google gmail invitation, no matter how many hands it has gone through, Google posts a notification of your new address to the original giver of the invite...who could be some spammer you never met....happened to me.
2. any pattern to the false positives?
not sure...only have two data points. Those two items were email alerts from newspaper subscriptions which tend to be crambed with ad text and ad links...in which case, gmail is clearly trying to do me a favor and I appreciate the effort.
Worthless accuracy table (Score:4, Insightful)
At minimum, they should have taken the false positive rate, added it to the percent missed and ranked by that. Doing so sends BorderWare into the middle of the pack where it belongs, and more likely winners rise to the top. (Postini and MailFrontier). Pretty shoddy reporting when the end reader has to take your numbers and plug them into a spreadsheet to make any sense out of them.
They could have also weighted the two error rates, but deciding on weights would be pretty subjective. Some might think false positives should be weighted higher, while others might think the opposite. Ranking them without weights would have been an acceptable compromise.
MailWasher Pro (Score:2)
But because of certain lame functionality, I refuse to recommend it to anyone.
The problem is that it sends fake bounce messages to the return addresses unless you configure it otherwise. That may have changed since I looked at it, but a quick look at their web page shows that they still do the fake bounces.
Fake bounce messages are incredibly lame since the vast majority of spam does not have the return address of the real source. On top of that
Where is spamgourmet? (Score:3, Interesting)
Not only does it allow you to cut off spam, it gives you traceable addresses that can be used to see who leaked email to spammers. And it's perfect against phishing attempts.
Re:SpamAssassin? (Score:5, Informative)
We also reached out to the SpamAssassin community (see "What about SpamAssassin?"), but couldn't find someone who could act as a representative for support and configuration assistance. However, two commercial vendors, Roaring Penguin (on Unix) and NoSpamToday! (on Windows) sent products that exposed their SpamAssassin cores.
They have a whole page [nwfusion.com] discussing this.
I don't agree with their assumption. (Score:2)
It doesn't base it on the language. Just the strings. The non-Italian speakers who were getting Italian spam, would classify it as spam, but that wouldn't
Re:SpamAssassin? (Score:3, Interesting)
Add IBM HTTP Sever and Stronghold (both of which are Apache based), then you would have a fair analogy. For some reason the authors perfered to have an offical representative of the Spam Assassin group, rather than some vendor who was willing to step up
Re:SpamAssassin? (Score:3, Insightful)
Re:SpamAssassin? (Score:3, Informative)
You did not read the article. From the Who got left out or opted out [nwfusion.com] page:
Re:SpamAssassin? (Score:4, Informative)
Re:SpamAssassin? (Score:2, Troll)
CF the Stock analyst [unitedmedia.com].
Re:Did you read the article? (Score:3, Insightful)
Re:BitDefender w/ Spamassassin (Score:2)
well move those netflix messages back into your inbox and train spamassassin on your "ham"
sub your own username for "username" of courseyahoo.no is better? (Score:2)
Re:Postini (Score:2, Informative)
Re:Copycat, clueless cat (Score:2, Informative)
Or, you could go back to February, 2003, and see the same methodology being prototyped at the Demo conference (http://www.nwfusion.com/reviews/2003/0224antispam demo.html)
Let's see: Feb 2003: 2 products.
Sept 2003: 16 products, with 4 top overall performers.
Dec 2004, 36 products, with 12 top overall performers.
And Network Comput
Re:Stop complaining about spam (Score:2, Insightful)
My fine capitalist customers pay to get email, not to get unwanted bulk advertising, much of it fraudulent, and a lot of it in fact coming from computers that have been made into zombies by worm writers breaking the law.
Re:POPFile (Score:2)
Because the POPFile project hasn't got any money to buy ads in their magazine. I'm sure that if we did then they'd review it.
In the meantime word of mouth is vital to POPFile and other similar projects.
John.