Trends in Business Intelligence | The top 6 BI trends of 2015

The 6 Biggest Trends in Business Intelligence for 2015

Written by

Passionned Group is a leading analyst and consultancy firm specialized in Business Analytics and Business Intelligence. Our passionate advisors assist many organizations in selecting the best Business Analytics Software and applications. Every two years we organize the election of the smartest company.

Everything in the digital economy is concerned with data. Businesses that are becoming increasingly smarter, collect and analyze data in a structured way, so they can make high quality, fact-based decisions fast. The increasing importance and use of data has led to new developments that are going to have a big impact on Business Intelligence. In practical terms, the Passionned Group predicts the following six Business Intelligence trends for 2015.

1. Digital Ethics & Privacy

Digital Ethics & Privacy

Personal data is sacred in Europe. We expect other continents and countries to follow. The Data Protection Act means the privacy of its citizens data must be guaranteed. The implementing bodies, the Data Protection Authorities, define ‘personal data’ as any data that can be directly traced back to a natural person. This also applies to encrypted or aggregated data.

The new digital economy demands a new ethic for Business Intelligence and Analytics. How can data be obtained? What is data used for? A number of large data owners are known to have hardly any reservations at all when it comes to the commercialization of data. That cannot be allowed to continue.

For a long time, the Authorities have been something of a paper tiger, that was limited to making recommendations and initiating investigations after the damage had been done. Recently however, some Authorities has been given the power to impose fines!

mr. Leo Kerklaan“Personally, I think the issue of digital ethics is extremely important, because it’s going to affect or decide the applicability of data. Businesses will soon have to supply objective proof that any personal data they’ve used can only be used for the purpose it was obtained.”

Leo Kerklaan MSc
Associate Partner

As consumer researchers have discovered, there is a general trend for the younger generation to be less concerned about privacy, and exchange parts of their privacy for discounts and attractive offers. Privacy is becoming, as it were, a new currency.

One concrete step in the field of privacy protection is the phenomenon data masking, a new functionality in the professional ETL toolkit that makes it possible to analyze anonymized data. If ‘suspicious’ patterns occur, an identity can only be revealed after formal authorisation.

2. Internet of Things

Internet of Things

Increasingly, more measuring instruments, cameras and other methods of recording are located in public spaces, at home or at specific business locations. More and more new products and services are based on the data generated by devices (sensors, meters, cameras). Think of smart metres, pumps with sensors three kilometres below sea level and even diapers that generate data. These devices all send their data to a platform fitted with analytical software: for some of them, that will involve around several kilobytes once a day, whilst for others, like aircraft engines, it will involve a real-time stream exceeding terabytes per hour.

All of this (real-time) data is tested, qualified and used to make decisions via a qualified model. There are thousands of examples of such applications in almost every sector, and the number is growing by the day. This results in an enormous flow of data that needs to be moved and analyzed. In addition to which, use of the internet, and mobile (4G) telephone networks is increasing too.

3. Data Storytelling

Data Storytelling

Information only begins to come to life if a story is told with it. We‘re all familiar with the development of “Human Interest” stories in journalism. News and facts are hung together on human experiences and emotions.

Some people refer to data storytelling as the next step in the development of data visualisation. Understandably, because, on the basis of visualized data, the user gains more and more insight into the story behind the data. Some software vendors now already supply the capacity to apply a story line to a data visualisation. It’s an interesting development.

It isn’t yet completely clear quite where storytelling should be put on the menu with discovery, exploration, visualisation and data presentation. It’s also debatable whether existing Business Intelligence tools are able to improve communication about data. And isn’t it actually more about storyfinding? This may appear to be a semantic issue, but that’s far from the case. Naturally, ‘Storytelling’ sounds OK, but it’s about discovering the story behind the data, not so much about recounting it.

4. Shortage of data scientists

Shortage of data scientists

Bringing different kinds and types of data together creatively, obtaining previously unimagined insights and translating them into practical issues remains the work of human beings. The exponential growth and availability of data, coupled with the ever growing need for analytics ensures that the existing shortage of data scientists will continue to rise. A good data scientist understands statistics, data blending and data visualisation.

“The severe shortage of data scientists has made us think in different ways. Earlier research showed us there was a strong relationship between successful big data applications, the required data science skills, innovation and intelligence of a business. But the calculation: ‘What does BI deliver?’ is sometimes made very quickly with big data! We therefore want to offer assistance to organizations who have a need for temporary data scientists and temporary BI/Analytics capability, so that more organizations can benefit from this wonderful (new) field.”

Daan van Beek
Managing Director

5. Data lakes and eco systems

Data lakes and eco systems

An enormous amount of data is becoming available, if only by virtue of the rise of the Internet of Things and open data. More and more businesses are storing data in its original form, in large but accessible and inexpensive storage pools (Hadoop, NoSQL). Due to the fact that the data destination isn’t yet known, the data is stored with all its attributes, in contrast to data marts, for example. Organizations can therefore go and fish in the data lake whenever they want to.

Over time, this method of data storage becomes its own ecosystem: the data lake heats up, as it were, data evaporates by deletion, ‘clouds’ arise when data sets are separated, new data comes in as ‘rain showers’, and there are several ‘rivers’ that bring a steady stream of data to the lake.

You need to be careful that the lake doesn’t turn into a swamp because of the lack of uniform definitions and performance problems. For this reason, smart data management is also a necessity.

6. Big Data bites two letters from ETL

Big Data bites two letters from ETL

In the extension of data lakes, the familiar Extract-Transform-Load-process (ETL) for loading data warehouses and making BI possible takes place in fewer and fewer cases. Big Data is simply too big to be loaded (L) and transformed (T). Increasingly, data streaming is introduced, but this is often only prompted when it is clear which report or analysis is requested at that time.

The analytical platform transforms the various data sets ‘on-the-fly’ into a single data model, for example, Hadoop, in conjunction with the BI solution. To get a decent response time, as much as possible is performed in-memory. So Big Data actually bites two letters from ETL – the letters T and L – which immediately raises the question: ‘Is there still a future for ETL?’

Take also a look at our completely updated ETL Tools & Data Integration Survey.

  1. Avatar The 6 Biggest Trends in Business Intelligence for 2015 David Boot-Olazabal says:

    Hi PassionNed,
    Great stuff, a bit abstract sometimes. I miss some focus on BI in smaller and midsize companies. And their use of the newer, more cost effective, BI tools.
    Could be that this is not seen yet as a big trend in BI, but in my humble opinion, it would be worth mentioning though.

    Kind regards,
    David Boot-Olazabal

    • Avatar The 6 Biggest Trends in Business Intelligence for 2015 Daan says:

      David, thanks for your comments. I believe that organizations that use newer, more innovative bi tools will have the same challenge when it comes to privacy, the internet of things etc. But I think you are right if you believe that the newer BI tools like Qlik and Tableau are more suitable for data story telling, guides analysis and social BI. Pentaho has excellent features for big data (lakes) crunching, an end user can analyse that data very easily. The older tools are catching up but are not that good.
      I was wondering why you think that these trends don’t apply for small or medium sized companies. Even small companies can register or collect huge amounts of data.

Comment on this post by Daan van Beek

Your email address will not be published. Required fields are marked *

A selection of our customers

Become a customer with us now

Do you also want to become a customer of ours? We are happy to help you with trends in business intelligence (the top 6 bi trends of 2015) or other things that will make you smarter.

Daan van Beek, Managing Director

DAAN VAN BEEK MSc

Managing Director

contact me directly

Fact sheet

Number of organizations serviced
6416
Number of training courses
6417
Number of participants trained
6418
Overall customer rating
8.9
Number of consultants & teachers
6419
Number of offices
3
Number of years active
14