An Overview of The BI Survey 12
What is The BI Survey?
The BI Survey is the world's largest and most detailed annual survey of business intelligence software usage. The results are published via an online analysis tool and an iPad App which allow you to compare end-user feedback on leading BI products and to perform your own custom analysis of the results. A number of reports are also published which uncover the key findings of The Survey.
How will The BI Survey 12 help me?
The BI Survey 12 will enable you to compare leading BI products across multiple criteria and find out which tools are the best fit for your organization. It also reveals the best practices which lead to the most successful BI projects and will save you time and money in research hours and consulting fees.
What do I get when I purchase The BI Survey 12?
The BI Survey is made up of six main components:
The BI Survey Analyzer
Access to an online tool that allows you to analyse the survey data every which way. You can select your own customized group of products and run reports displaying how the products stack up against each other in real world deployments. Click here to find out more.
The BI Survey 12: The Results
A PDF report containing expert analysis of the survey results, revealing the best and worst products, emerging market trends and other interesting findings. Click here to find out more.
The BI Survey 12: iPad App
New this year: The iPad App literally puts The BI Survey findings at your fingertips. It allows you to compare competing BI products side-by-side across a broad range of criteria, any time, anywhere. Click here to find out more.
The BI Survey 12: Vendor Performance Summaries
A new series of twenty-seven product-focused reports. Each Vendor Performance Summary provides a high-level overview of the key survey findings - including highlights and lowlights - about a particular product. Click here to find out more.
The BI Survey 12: Trending Topics Series
A series of seven PDF reports which home in on the latest market trends in the business intelligence industry. Each report covers a single theme revealing adoption rates, usage trends and feedback from real-word deployments. Topics covered include 'mobile BI' and 'big data'. Click here to find out more.
The BI Survey 12: Best Practices
What The Survey teaches us about the factors that lead to the most successful BI tool selection projects. This report tells you why projects succeed and fail in the real world and helps you avoid costly mistakes by recommending best practices that work. Click here to find out more.
What is the basis of The BI Survey 12 data?
The BI Survey 12 is based on findings from the world's largest and most comprehensive survey of business intelligence end-users, conducted earlier this year. In total, 2864 people submitted responses to the survey of which 2155 answered a series of detailed questions about their usage of a named product.
Which products are analyzed in The BI Survey 12?
All products that attracted over 30 survey responses are analyzed in detail in The BI Survey 12. This year twenty-seven products are included, the most ever. These range from offerings from all the major vendors to a number of tools from independent software companies.
Click here for a full list of the products included in The BI Survey 12.
What will The BI Survey 12 tell me?
The BI Survey 12 answers a myriad of questions about BI product selection and usage. This is just a selection of the issues that The BI Survey 12 tackles:
The Business Benefits Index
One thing that all BI deployments ought to have in common is that they should deliver business benefits. This section explains The Business Benefits Index (BBI), our proprietary nine-point method of identifying the level of success achieved from the implementation of a BI solution and provides a variety of analyses based on this measure.
Goals Achievement Index
In addition to our analysis of the Business Benefits of BI software projects, we also carried out a detailed analysis of goal achievement. This analysis compares project results with the initial list of goals set when a project was started. There are many ways to evaluate BI products technically, but measuring their customers’ success focuses more on the real purpose of implementation.
Deployment, costs and applications
This section looks at several aspects of BI deployments, including how widely BI is deployed, the ongoing admin/maintenance effort and the cost of ownership and applications. We aggregated results of several questions in the survey and calculate a cost of ownership index which shows the relative costs per seat of the products in The Survey.
The purchase cycle
This section analyzes how people buy BI tools and how satisfied they are. It considers the various influences on their decisions, what factors they feel are important and the resultant success rate with different tools.

Implementation and rollout times
The success of a project depends at least as much on how well it is implemented as on what product is used. We therefore asked respondents which resources had been used to implement their systems, what the external consulting costs were, and the length of time to the initial rollout. We also examine the correlations between those factors and overall project success.
Problems in BI projects
BI deployments depend on a complex choreography of people, data and technology. If any of these fails to perform, the problems soon mount up — and the majority of our respondents identified at least one major problem that had occurred. This section analyzes these problems and how they relate to other factors. It also looks at what would deter people from deploying their solutions more widely.
Cloud BI
For some time now, it has been confidently assumed by many observers that BI applications were mainly deployed via the web. In actual fact, responses to The BI Survey in previous years have never really supported this received wisdom. The BI Survey 12 examines current levels of cloud BI adoption rates, and identifies the vendors that are leading the way in this area.

Data Volumes
Most BI vendors enjoy boasting of their products’ scalability. They frequently fail to define what they mean by ‘scalable’, but one common definition is based on the amount of data they can handle. We therefore try to cut through this boastful fog to find out how much data real users report handling in their applications. This section seeks to analyze reported data volumes by a number of parameters before addressing that perennial question: "Is bigger better?"
Performance
Poor query performance is by far the most frequently reported product-related problem in previous editions of The BI Survey. By having a better understanding of which products perform well or badly, you will be assisted in your product choice, and will know what problems are likely to occur if you choose a product that is known to be slower. You will also have more realistic expectations for performance than you can get from a slick demo with trivial amounts of data and no complex architectures. And if you do choose a product that is known to have performance problems, you should be prepared to invest in faster hardware.
As with previous editions, but unlike most other published surveys, The BI Survey 12 remains completely vendor-independent. This means that vendors had no power to set any of the questions, nor any influence over how the survey responses were analyzed and presented. All information provided is used only in aggregate form and is kept strictly confidential.

