This article describes a practical method for BI professionals, business and information analysts, and controllers, to systematically develop proper KPIs. Our method of defining KPIs, the SMART KPI Toolbox, is well-documented and also makes them technically implementable. One of the advantages of good business intelligence is that every user can effortlessly see the information relevant to them on the screen. Besides descriptive reports and analysis possibilities, that means relevant Key Performance Indicators (KPIs) that provide quick insight into the performance of the team, department, or segment of the business. KPIs are a part of performance management.
If the challenges associated with Big Data are handled well by making things relevant, digestible, and specific, you can go from Big Data to Right Data and then make the Right Decisions. Then, you'll be able to make the four Vs of Big Data work to your advantage: you'll see more and see better as an organization! Volume: see more. Velocity: spot things faster. Variety: see more detail and more nuance.
Do you want to stay ahead of the competition and give your customers the best possible experience? Become a data-driven organization. Instead of making decisions based on opinions, gut feeling, who yells the loudest, or because "that's just the way we've always done it," your organization will take action based on data and facts. A study by the MIT Center for Digital Business shows that organizations that make data-driven decisions have 4% higher productivity while earning 6% more profit. That may not seem like a lot to some, but over $1 million in profits, we're already talking about $60,000. That amount of money can get you a pretty decent BI system. Other studies have shown that successfully using BI can lead to 33% more satisfied customers. And with IoT applications, we can save $63 billion worldwide in healthcare. You can find many advantages of data-driven working in all kinds of areas. That's why you should make data an integral part of your company's DNA now, in just five steps.
The Gemiva-SVG Group aids people with a mental, physical, or multiple disability, and people with non-inborn brain damage. Gemiva asked Passionned Group for advice on the architecture and organization of its data warehouse, plus advice on which ETL tool to use. The advice project was completed to great satisfaction, and was rated a 9 out of 10 by Gemiva. There were four main questions plaguing Gemiva that they wanted Passionned Group to answer.
In this technology-driven world, we like to believe in progress. It can be easy to forget that “new” isn't always better. A prime example of this is the “data lake” phenomenon: a figurative lake of data, which became a hype in Business Intelligence (BI) and Big Data circles. Many companies rushed to jump on the bandwagon and built their own data lake. But was this such a good idea, or would it have been better to think about what can be accomplished using a data lake first?
The demand for data scientists is rapidly growing. This function is becoming increasingly important within organizations and its salary is growing to match its importance. Research by the McKinsey Global Institute shows that the lack of analytical and management talent in successfully implementing Big Data is one of the biggest challenges the USA is facing. The McKinsey Global Institute estimates that there are four to five million openings for data scientists in 2018 alone. The hunt for data scientists has been opened. This jack of all trades in your organization should possess many talents in order to help shape and direct the explosive amount of new possibilities provided by big data. But is this realistic?
During our interviews with the different ETL vendors at the beginning of 2018 we have seen a number of general trends and topics emerge. Especially those vendors that operate on the cutting edge are very eloquent on where they see ETL and Data Integration going. Apart from the “hard”, technical developments, we can see that a small number of vendors have a keen eye for the “soft” side of ETL and Data Integration, being data governance and the role of human intervention in maintaining data quality. This was perhaps the most surprising aspect of our survey. We believe that this is also where vendors can truly distinguish themselves.
In this article I’m going to share some of my experiences from the SAS Analyst Conference, May 27 - 29, 2015, in Marbella. I had a one-on-one meeting with Scott Gidley, senior director Research and Development, and we had an interesting discussion about the future of data management, Hadoop, Big Data, data warehouses, and Data Lakes. I see a clear trend in data management and integration: the role of the data warehouse is changing rapidly and a lot of analytics will be done without it. Data warehouse developers should be warned!
A decade ago the vast majority of data warehouse systems were hand crafted, but the market for ETL software has steadily grown and the majority of practitioners now use ETL tools in place of hand-coded systems. Does it make sense to hand-code (SQL) a data warehouse today, or is an ETL tool a better choice? What are the 7 biggest benefits of using an ETL tool? We now generally recommend using an ETL tool, but a custom-built approach can still make sense, especially when it is model-driven. This publication summarizes the seven biggest benefits of ETL tools and offers guidance on making the right choice for your situation.
Contrary to many studies that evaluate ETL tools based only on their current market share and functionality, our study (the ETL Tools & Data Integration Survey) also attempts to evaluate ETL tools based on their expected future performance. With the market changing as quickly as it is today, market share is about the past, and says little about the future. Many products, including WordPerfect, Lotus 123, and Harvard Graphics once had a huge market share, but proved to have very little future potential. The growth potential as defined within the confines of this ETL study looks at how frequently a vendor releases new, valuable features; an important indicator for innovation and the strategic importance of the product to the vendor.
The maximum number of points awarded in our ETL tools & Data Integration Survey to an ETL tool for its ease-of-use was eleven. A maximum of two points was awarded for each of the four attributes, indicated by one or more plus (+) signs, and points were allocated depending on the number of days of training suggested by the vendors (less training required – more points for Ease of Use).If the verdict was negative indicated by one or more minus (-) signs, points were deducted. If, for example, ease of use, WYSIWYG, and logical order earned a plus sign and screen design a minus sign, the tool was awarded two points (one point for each plus sign, minus one point for the minus sign). Since it can take considerable time to improve the usability of a product we have compared the product (where possible) over a three year period. The maximum number of points was 11.
Question: Which ETL tools can support Data Vault modeling out-of-the-box? What are the challenges and issues building a data vault with ETL tools? 1. Marcel de Wit - See another discussion on LinkedIn (still active; Dutch) 2. Daan van Beek - Thanks Marcel, I did read the comments of that discussion too, it was the reason I started this discussion actually. After reading it, it was still unclear to me whether ETL tools do support Data Vault out-of-the-box like slowly changing dimensions or not. So, who knows the answer(s)? The vendors?
You can still hand-code an extract, transform and load system, but in most cases the self-documentation, structured development path and extensibility of an ETL tool is well worth the cost. Here's a close look at the pros and cons of buying rather than building. The Extract, Transformation, and Load (ETL) system is the most time-consuming and expensive part of building a data warehouse and delivering business intelligence to your user community.
Ab Initio has been around now for a long very time in the ETL market space to make a name for themselves. Their marketing approach appears to be one of mystique: maintain secrecy around the product while allowing some information out about the high-end customers, creating interest because of the tantalizing tidbits they provide. Their website is more typical of an advertising firm with nothing meaningful to say than a technology company. Years later (2015) this is still the case. Their website loads very slowly and is full of flash (no HTML) and there is even no phone number or contact form. Our guess: they are finished.
For the last three months of last year Passionned Group have run a poll on their ETLtool.com site asking visitors what they thought were the most important requirements when choosing an ETL tool. The ETLtool.com site has been running since 2005 and advises visitors on the various ETL (data integration) tools available, what their strong and weak points are, how to choose an ETL tool and sells a 100 page report where popular products are analyzed and compared to facilitate choosing the right product for individual circumstances.