Competitive Benchmarks: Dennis Technology Labs
Who is Dennis Technology Labs?
Dennis Technology Labs is an independent testing facility that evaluates personal and business technology, including hardware and software. They specializes in security testing, using a world-class anti-malware testing framework. They work with businesses, technology vendors and magazines to provide accurate and realistic test results that are useful to consumers and vendors' internal teams. Their services, including performance tests and the results they produce, are world-class.PC Total Protection Suites 2011
Seven Popular Anti-Virus Programs Compared for Effectiveness
In January 2011, Dennis Technology Labs performed endpoint security benchmark testing on eleven market-leading Consumer endpoint solutions including:
- Avira Premium Security Suite 2011
- ESET Smart Security 4
- G Data TotalCare/InternetSecurity 2011
- McAfee Total Protection/Internet Security 2011
- Symantec Norton 360 v5/Internet Security 2011
- Webroot Internet Security Complete 2011
- BitDefender Total Security/Internet Security 2011
- F-Secure Internet Security 2011
- Kaspersky PURE/Internet Security 2011
- Panda Global Protection/Internet Security 2011
- Trend Micro Titanium Maximum Security/Internet Security 2011
Testing Methodology
Products were exposed to genuine internet threats that real customers could have encountered during the test period. Crucially, this exposure was carried out in a realistic way, reflecting a customer’s experience as closely as possible. For example, each test system visited genuinely infected websites and downloaded pages, exploits and malicious files exactly as an average user would. Also tested was how each product handled legitimate applications. These were downloaded from Download.com or the original site as directed by Download.com. The popularity of each program was taken into account. Products are awarded marks for detecting real threats and providing adequate protection. Points are deducted for failing to protect the system and for falsely condemning legitimate software.
Trend Titanium Maximum Security performed better than most of its competitors and Trend Micro and Symantec tied in Total Accuracy:
Total Accuracy Scores

Source: Dennis Technology Labs, January 2011
Detailed view of the test results:
Protection Details

Source: Dennis Technology Labs, January 2011
Why Trend Micro outperformed the competition
Trend Micro has outperformed the competition in a number of recent tests (see NSS Labs & AV-Test.org) due to the Smart Protection Network™ infrastructure that powers all of our solutions. This unique cloud-client architecture that uses Smart feedback to source new potential threats and patent-pending correlation that analyzes multiple threat vectors (web, email, file) in real-time allows Trend Micro to react faster than other vendors against new threats. Our multi-layered approach to security gives us a decided advantage over the competition in combating today's sophisticated threats as well as the volume of new threats.
1 This assumes that the users were using the same version and patch-level of Windows and other software.Trend Micro Consistency over Time
Traditional tests have focused on identifying the product that can best detect a set of known malware files during a closed test. This type of testing is outdated and does not take into account how threats typically propagate today, or how computers are used. Dennis Technology Labs has developed one of the few real-world tests within our industry that gives users a good view of the efficacy of the solutions against today’s threats.
Consistency in real-world tests may be compromised due to the following:
- Vendor is still focused on file-based protection which is difficult to keep updated with the number of new threats being released each hour.
- Vendor does not provide blocking of malicious URLs, which is the source of most infections today.
- Vendor does not have automated sourcing of unknown threats.
- Vendor does not have automatic correlation of new threat data in order to quickly identify unknown threats
- Vendor does not have cloud-based protection and still requires signature files to be delivered to each and every endpoint computer, thus delaying the time to protect.
The Trend Micro Smart Protection Network provides a consistent source of blocking real-world threats. This is due to the Smart Protection Network infrastructure that not only powers products for consumer, SMB, Enterprise, Partner and SaaS customers but also powers our mobile, endpoint, server, messaging, network, gateway, and SaaS solutions. This unique cloud-client architecture that uses Smart feedback to source new potential threats, patent-pending correlation that analyzes multiple threat vectors (web, email, file) in real-time and in-the-cloud reputation databases to deliver protection wherever our customers connect, allows Trend Micro to react faster than other vendor against new threats. Our cloud-based protection network is the most evolved and comprehensive network in the industry blocking over 5.5 billion email, web and file-based threats targeting our customers daily.
