Introduction to the Enterprise Big Data Framework
Introduction of the Enterprise Big Data Framework in 5 minutes.
Big Data has been the Big buzzword of the last decade. Yet there are very few companies who have actually implemented this successfully and get real value out of their data.
My name in Jan-Willem Middelburg, and I am the author of the Big Data Framework. And in this video, I am going to walk you through the six key components of the Big Data Framework.
The first key component of the Big Data Framework is to have a Big Data strategy. Because without a good Big Data strategy you don’t know where you’re going, and literally every road will take your there.
There are zettabytes of data out there, and you can potentially spend your whole life analyzing different kinds of data. So the first step that organizations need to take is to define, and write down, a good Big Data strategy.
What do you want to get out of your data? How do you want to make a good business case? And where do you retrieve your money? These are some of the key components that need to be written down into a Big Data strategy. And that is literally the first step.
The second step is that you need to have the technology to be able to analyze large quantities of data. And within Big Data, we refer to that as a Big Data architecture. You need to have the technology in place, the connectivity, but also the software to deal with this on a day-to-day basis.
So in the Big Data architecture section of the Big Data Framework, we will look at your IT infrastructure, and whether it is able to cope with massive quantities of data that move in and out of your organization very very quickly.
The third component of the Big Data Framework has everything to do with algorithms. Because, yes, you do need to have a bit of statistical knowledge, and even some machine learning skills in order to retrieve value from data.
And this is really important, because if the math is wrong, your results will be wrong. So in the third section, I will be explaining about some of the common algorithms and techniques that you start to really use to start working with Big Data on a day-to-day basis. In this section, I will learn you everything about common algorithms and how they add value to your organization.
Many organizations set the first couple of steps. They have defined a strategy, they have a good architecture, and they have some knowledge about algorithms. And then frequently is goes wrong. And that is because they have not defined adequate processes.
In order to deal with Big Data, you need to have sound Big Data processes in place. You need to talk about your data management. You need to have a good data governance structure in place. And most importantly, you need to have Big Data security practices.
Who can access your data? At what moments in time? And how do you deal with privacy and security regulations? All of these should be part of your Big Data processes. And this is what is covered in the Big Data processes section of the Big Data framework.
Just like everything that happens in organizations, people are always the most important. Yet this component I see is most frequently forgotten in Big Data organization. You need to have active skills development. You need to put people on training courses. And you need to make sure that your build teams that can get value out of the data.
So in the Big Data Function section, we focus on completely on the people aspect behind Big Data. This is really important, and I am really a strong believer that this is one of the key reasons why so many organizations fail to get value out of their data consistently.
The last element of the Big Data Framework is Artificial Intelligence. And this has been positioned as the outer ring around the Big Data Framework. And the reason for that is very simple. In order to do Artificial Intelligence, you would need to have the same kind of infrastructure, the same type of algorithms that you would require in Big Data organizations.
So organizations that really want to start implanting Artificial Intelligence, should first look at their Big Data organization. And get that in place first, so that they can subsequently move on to get the benefits of Artificial Intelligence. And that is why we have incorporated that into the framework as well.
I hope this video has provided you with some good content, and with some further information about the six core components of the Big Data Framework. If you would like to learn more about Big Data, start subscribing to our YouTube channel, because we will be posting videos regularly. Not only about the theory part, but also how do you apply it in practice.
I hope to see you again in one of our upcoming videos. Thank you so much for watching.
#enterprisebigdataframework