Testing the on-demand detection of different AV with old malwares.

[sujay]

Hi Guys, I was testing the On-demand detection of different AV with some old malware collections. I will give you the information. But please understand that this malwares are almost 2 years old and there are some more tools in a security products to defend malwares. So, please take the results for informational purpose only. Please don't conclude anything.
Also another problem with the test is that I could not perform the test at the same time. So, a malware which is not detected during my test may be detected now with the updated database. But chances are less because these are already very old samples. Remember I am not an expert. This is a amateur test only.
Tested products until now.
1. Immunet Free
2. Immunet Pro
3. Emsisoft Antimalware
4. Avira Premium
5. SAS Pro
6. MBAM
7. Digital Patrol
8. K7 Antivirus
9. eScan
10. Dr.Web
11. Clam Cloud
12. Digital Defender
13. Norman
14. F-Prot AV
15. Kaspersky
16. Iobit360
17. Spyemergency
18. The Cleaner
19. Trend Micro
20. Hitman Pro
21. Sophos
22. Panda AV
23. Advanced System Protector
24. Eset
25. FortiClient
26. Solo Antivirus
27. Twister Antivirus
28. Ad-Aware Free
29. AVG
30. VBA32
31. Quick Heal
32. Rising
33. AhnLab
34. Jiangmin
35. Kingsoft
36. SpySweeper
37. Vexira
38. Avast
39. Arcavir
40. nProtect
41. ViRobot
42. Antiy
43. Iolo
44. Authentium
45. Blue Point Security
46. MSE
47. Comodo
48. Net Protector
49. eAcceleration
50. Zillya!
51. Paretologic
52. mks_vir
53. Wuzzup
54. Blink Personal
55. Drive Sentry
56. Spyware Terminator (w/o Clam AV)
57. FSB Antivirus
58. Norton Antivirus 2011 beta
59. Trojan Remover
60. Coranti
61. Ashampoo
62. Trustport
63. Webroot
64. Windows Defender
65. My Free Antivirus
66. F Secure
67. Bullguard
68. CA
69. Cyber Defebder
70. Norton 2010
71. ByteHero
72. Protector Plus
73. MaxSecure Spyware Detector
74. G Data
75. Trojan Hunter
78. MAXSECURE AV 2010
79. MaxSecure Antivirus Pro 2010
80. Norton Power Eraser
81. CMC Antivirus
82. ClamWin
83. Counterspy
84. Spyware Doctor
85. Outpost AV
86. Zone Alerm AV
87. Bitdefender
88. Eset AV
89. McAfee
90. BkAV Pro
91. Tizer Secure
92. Vipre
93. VirIT Explorer


[P.S: Immunet fails to quarantine almost all threats in an on-demand scan. So, for the free and pro version of Immunet I did the calculation by extracting malwares from an archive. In that way Immunet quarantines threat successfully. Also after that I scanned remaining threats multiple times to ensure that no threat is left which are detected by Immunet.](Problem seems to have solved now)


Please suggest me if you want more products to be included.

Set 1 contains 500 samples.

Immunet free 414/500 (82.8%)
Immunet Pro 495/500 (99%)
Emsisoft Antimalware 500/500 (100%)
Avira Premium 500/500 (100%)
SAS Pro 406/500 (81.2%)
MBAM 471/500 (94.2%)
Digital Patrol 472/500 (94.4%)
K7 441/500 (88.2%)
eScan 493/500 (98.6%)
Dr.Web 445/500 (89%)
Clam Cloud 464/500 (92.8%)
Digital Defender 393/500 (78.6%)
Norman 483/500 (96.6%)
F-Prot 442/500 (88.4%)
Kaspersky 462/500 (92.4%)
Iobit360 296/500 (59.2%)
SpyEmergency 287/500 (57.4%)
The Cleaner 40/500 (8%)
TrendMicro 472/500 (94.4%)
Hitman Pro 472/500 (94.4%)
Sophos 456/500 (91.2%)
Panda 490/500 (98%)
Advanced System Protector 466/500 (93.2%)
Eset 478/500 (95.6%)
Forticlient 486/500 (97.2%)
Solo 104/500 (20.8%)
Twister 497/500 (99.4%)
Ad-Aware Free 480/500 (96%)
AVG 467/500 (93.4%)
VBA32 462/500 (92.4%)
Quick Heal 448/500 (89.6%)
Rising 384/500 (76.8%)
AhnLab 462/500 (92.4%)
Jiangmin 464/500 (92.8%)
Kingsoft 461/500 (92.2%%)
SpySweeper 200/500 (40%)
Vexira 461/500 (92.2%)
Avast 486/500 (97.2%)
Arcavir 460/500 (92%)
nProtect 485/500 (97%)
ViRobot 439/500 (87.8%)
Antiy 463/500 (92.6%)
Iolo 322/500 (64.4%)
Authentium 479/500 (95.8%)
Blue Point Security 499/500 (99.8%)
MSE 464/500 (92.8%)
Comodo 495/500 (99%)
Net Protector 2010 334/500 (66.8%)
eAcceleration 472/500 (94.4%)
Zillya! 469/500 (93.8%)
Paretologic 474/500 (94.8%)
mks_vir 321/500 (64.2%)
Wuzzup 474/500 (94.8%)
Blink 491/500 (98.2%)
Drive Sentry 491/500 (98.2%)
Spyware Terminator 429/500 (85.8%)
FSB AV 471/500 (94.2%)
Norton 2011 beta 465/500 (93%)
Trojan Remover 80/500
Coranti 499/500 (99.8%)
Ashampoo 497/500 (99.4%)
Trustport 493/500 (98.6%)
Webroot 466/500 (93.2%)
Windows defender 223/500 (44.6%)
My Free Antivirus 444/500 (88.8%)
F-Secure 493/500 (98.6%)
Bullguard 494/500 (98.8%)
CA 326/500 (61.4%)
Cyberdefender 355/500 (71%)
Norton 2010 464/500 (92.8%)
ByteHero 218/500 (43.6%)
Protector plus 170/500 (25.4%)
Maxsecure spyware detector 335/500
G Data 497/500 (99.4%)
Trojan Hunter 216/500 (43.2%)
MAXSECURE AV 2010 500/500 (100%)
MaxSecure Antivirus Pro 2010 453/500 (90.6%)
Norton Power Eraser 468/500 (93.6%)
CMC Antivirus 357/500 (71.4%)
Clamwin 406/500 (81.2%)
Counterspy 442/500 (88.4%)
Spyware Doctor 478/500
Outpost 408/500
Zone Alerm 451/500 (90.2%)
Bitdefender 492/500 (98.4%)
Eset 478/500 (95.6%)
McAfee 486/500
BKAv Pro 452/500
Tizer Secure 59/500 (11.8%)
Vipre 460/500
VirIT eXplorer 86/500


Set 2 contains 5000 samples.

Immunet free 2469/5000 (49.38%)
Immunet Pro 4903/5000 (98.06%)
Emsisoft Antimalware 4986/5000 (99.72%)
Avira Premium 4961/5000 (99.22%)
SAS Pro 223/5000 (4.46%)
MBAM 150/5000 (3%)
Digital Patrol 4829/5000 (96.58%)
K7 3308/5000 (66.16%)
eScan 4718/5000 (94.36%)
Dr.Web 4590/5000 (91.8%)
Clam Cloud 2470/5000 (49.4%)
Digital Defender 3485/5000 (69.7%)
Norman 4459/5000 (89.18%)
F-Prot 4014/5000 (80.28%)
Kaspersky 4924/5000 (98.48%)
Iobit360 2183/5000 (43.66%)
SpyEmergency 1274/5000 (25.48%)
The Cleaner 410/5000 (8.2%)
Trend Micro 4761/5000 (95.22%)
Hitman Pro 2959/5000 (41.58%)
Sophos 4800/5000 (95.6%)
Panda 4723/5000 (94.46%)
Advanced System Protector 3231/5000 (64.62%)
Eset 4497/5000 (89.94%)
Forticlient 4900/5000 (98%)
Solo 2793/5000 (55.86%)
Twister 4950/5000(99%)
Ad-Aware 2922/5000 (58.44%)
AVG 4669/5000(93.38%)
VBA32 4591/5000 (91.82%)
Quick Heal 2961/5000 (59.22%)
Rising 3747/5000 (74.94%)
AhnLab 4109/5000 (82.18%)
Jiangmin 3649/5000 (72.98%)
Kingsoft 3751/5000 (75.02%)
SpySweeper 1571/5000 (31.42%)
Vexira 4245/5000 (84.9%)
Avast 4867/5000 (97.34%)
Arcavir 4839/5000 (96.78%)
nProtect 4851/5000 (97.02%)
ViRobot 4806/5000 (96.12%)
Antiy 4000/5000 (80%)
iolo 4329/5000 (86.58%)
Authentium 4868/5000 (97.36%)
Blue Point Security 4972/5000 (99.44%)
MSE 4654/5000 (93.08%)
Comodo 4980/5000 (99.6%)
PC Tools Free 4461/5000 (89.22%)
Net Protector 256/5000 (5.12%)
eAcceleration 4806/5000 (96.12%)
Zillya 4067/5000 (81.34%)
Paretologic 4948/5000 (98.96%)
mks_vir 4710/5000 (94.2%)
Wuzzup 1266/5000 (25.32%)
Blink 4602/5000 (92.04%)
Drive Sentry 1306/5000 (26.12%)
Spyware Terminator 723/5000 (14.46%)
FSB AV 2802/5000 (56.04%)
Norton 2011 beta 4251/5000 (85.02%)
Trojan Remover 74/5000
Coranti 4965/5000(99.3%)
Ashampoo 4977/5000 (99.54%)
Trustport 4972/5000 (99.48%)
Webroot 4853/5000 (97.06%)
Windows Defender 704/5000 (14.08%)
My Free Antivirus 3858/5000 (77.16%)
F-Secure 4948/5000 (98.96%)
Bullguard 4947/5000 (98.94%)
CA 3027/5000 (60.54%)
Cyberdefender 3873/5000 (77.46%)
Norton 2010 4410/5000 (88.2%)
ByteHero 849/5000 (16.98%)
Protector Plus 3400/5000 (68%)
MAxsecure spyware detector 1522/5000
G Data 4970/5000 (99.4%)
Trojan Hunter 476/5000
Maxsecure AV 2010 4953/5000 (99.06%)
MaxSecure Antivirus Pro 2010 2348/5000 (46.96%)
Norton Power eraser 283/5000 (5.66%)
CMC Antivirus 4880/5000 (97.6%)
ClamWin 3679/5000 (73.58%)
Counterspy 2160/5000 (43.2%)
Spyware Doctor 4877/5000
Outpost 4497/5000 (89.94%)
Zone Alerm 4086/5000 (81.72%)
Bitdefender 4914/5000 (98.28%)
Eset 4555/5000 (91.1%)
McAfee 4915/5000 (98.3%)
BkAV Pro 3276/5000 (65.52%)
Tizer Secure 229/5000 (4.58%)
Vipre 2246/5000
VirIT Explorer 865/5000


For Updates see here
http://www.raymond.cc/forum/spyware-...tml#post192822

Results in a sequential manner here
http://www.raymond.cc/forum/spyware-...tml#post193536

[sm1]

Thanks Sujay for the test. Big difference between Immunet free and pro. I think the pro version uses bitdefender engine.

[sujay]

Thanks Sujay for the test. Big difference between Immunet free and pro. I think the pro version uses bitdefender engine.

You are welcome.. Yes Immunet Pro uses Bitdefender engine...

[7even]

I'm also disappointed with the results of SAS and MBAM. Too bad for these users favorite.

[sujay]

I'm also disappointed with the results of SAS and MBAM. Too bad for these users favorite.

Dude its not a complete AV and IMO in the second set the proportion of Virus is greater. Also these are old malwares and many vendors don't like to incorporate old malwares into database.

[LunarWolf]

@sujay, nice one!

Any hopes of you showing kaspersky, eset and avast free v5?

MBAM did alright for the 1st set. BUt I am still satisfied with it. Because it is one of the tool I used to clean an infected pc.

[sujay]

Thank you lunar. I will test KIS, Avast and eset for sure but I have many in the list. But I think at first I will try less popular ones. Next result will be published in a hour...

[keypees2005]

Good job, if possible, try to include more AVs.

[sujay]

Good job, if possible, try to include more AVs.

Thanks keypass2005 ..

[hellnoire]

So you completely turned off the real time scanners for this?