Return to Home
Skip to main content

Don't be Fooled: A Guide to Finding Credible Vendor Comparison Reports

Published Date
Author Stephanie Clarke

The software industry is a complex space, with new solutions and technology emerging faster than ever before. With so many options to choose from, it can be challenging to select the right software solution and vendor partner you can trust. This is where vendor comparison reports from credible analysts such as Gartner, Forrester, IDC, Celent and Aragon come in handy. However, the reality is that there are now a number of less credible reports out there that can mislead potential software buyers, leaving them with the wrong solution or uninformed guidance. In this article, we’ll discuss how to spot “pay to play” reports and provide some tips on how you can ensure the reports you’re looking at come from a credible source.

Gartner, Forrester and IDC are well-known analyst firms that cover a wide range of technology markets. They provide comprehensive research and analysis on the latest market trends, emerging technologies and vendor landscapes. In addition to these large firms, there are also smaller boutique firms that specialize in specific market segments or industries. For instance, Aspire CCS focuses specifically on Customer Communications Management technology, while Celent and Aite-Novarica specialize in the Financial Services and Insurance space. These smaller firms are able to provide more targeted and detailed analyses of specific markets, and their reports can be invaluable resources for companies looking for solutions in those areas.

How to Identify Credible Analyst Reports

Legitimate analyst firms go through a rigorous process to create vendor reports that are based on valid and credible research. This process generally involves sending a Request for Information (RFI) to all vendors, followed by technology briefings, demos and interviews with customers and technology partners. This process can take several months and ensures that the analyst firms have enough information to make a valid comparison of the technology providers.

The RFI process is essential because it allows analyst firms to gather detailed information about the vendors’ products, services and capabilities. This information is used to create comprehensive vendor profiles that form the basis for the report. The technology briefing process is equally important because it allows the analyst firms to ask specific questions about the vendors’ products and services and gain a deeper understanding of the market trends or challenges. 

Legitimate analyst firms conduct research on their own to supplement the information they receive from the vendors. This research can include surveys, market analysis and interviews with industry experts and technology partners with experience implementing the technology solutions being evaluated. This approach ensures that the report is based on a broad and accurate understanding of the market.

What are “Pay-to-Play" Reports? 

‘”Pay to play”’ reports are created by companies that have a vested interest in promoting specific vendors. These companies may have a financial relationship with the vendors, such as accepting payments to include them in the report or ranking them higher than they may deserve. The goal of these reports is to create a false sense of credibility that leads potential software buyers to believe they are getting objective and impartial information. However, the reality is that these reports are often biased and misleading. They may also contain inaccurate or outdated information.  

How to Spot Them 

  1. No Transparency: If the company producing the report does not disclose the methodology or criteria used to select vendors or rank them, it could be a sign that they are hiding something.
  2. Limited Scope: If the report focuses only on a select group of vendors or fails to explore the entire market, it is likely that it was created to promote a specific vendor rather than provide a comprehensive analysis of the market.
  3. Promotional Language: If the report uses promotional language, it could be a sign that the vendor had a say in the report’s creation.
  4. Duplicate Content: If you observe that the content of this year’s report is almost identical to that of the previous year’s, that’s a clear indication that the analyst firm did not invest much effort in creating the report, which may raise questions about its credibility. 

How to Ensure Reports Come from a Credible Source

  1. Do Your Own Research: It is essential to do your own research and evaluate the vendors’ products and services based on your needs. Don’t rely solely on third-party reports.
  2. Check for Transparency: Always look for transparency in reports. The company producing the report should be open about its methodology and criteria for selecting vendors.
  3. Look for Comprehensive Reports: Credible reports should cover the entire market, not just a select group of vendors. Reports that have a narrow focus or recycle content year after year should raise red flags.
  4. Look for an Independent Voice: Look for reports that are produced by an independent, impartial and respected industry analyst firm with a track record for credibility. Most credible analyst firms are regularly publishing thought leadership on the category being covered, so be sure to do your research. 

Our Top Analyst Picks for Customer Communications Management (CCM) Coverage:

• IDC

• Aspire CCS

• Gartner

• Forrester

• Celent

• Aite-Novarica 

• Aragon

Conclusion

Choosing the right software solution is essential for the success of any business. Vendor comparison reports can be a valuable resource to help companies make informed decisions. However, not all vendor comparison guides are created equal. It is crucial to be aware of the "pay to play" reports that can be misleading. 

Smart Communications is committed to upholding the integrity of vendor comparison reports and, as a matter of policy, does not participate in, promote or publish any "pay to play" reports on our website. By taking this stance, we ensure that our customers and community can trust that our participation or inclusion in a report is based solely on the merits of our products and services. This approach aligns with our commitment to transparency, integrity, and providing our customers with accurate and unbiased information to make informed decisions.

See how Smart Communications stacks up by reading these popular reports.