Skip to main content

A Bluffer’s Guide to AI, Algorithmics and Big Data

 Big Data—More Than “Big”

A few years ago, the keyword big data resounded throughout the land. What

is meant is the emergence and the analysis of huge amounts of data that

is generated by the spreading of the Internet, social media, the increasing

number of built-in sensors and the Internet of Things, etc.

The phenomenon of large amounts of data is not new. Customer and

credit card sensors at the point of sale, product identification via barcodes

or RFID as well as the GPS positioning system have been producing large

amounts of data for a long time. Likewise, the analysis of unstructured data,

in the shape of business reports, e-mails, web form free texts or customer

surveys, for example, is frequently part of internal analyses. Yet, what is

new about the amounts of data falling under the term “big data” that has

attracted so much attention recently? Of course, the amount of data avail-

able through the Internet of Things (Industry 4.0), through mobile devices

and social media has increased immensely (Fig. 2.1).

A decisive factor is, however, that due to the increasing orientation of

company IT systems towards the end customer and the digitalisation of

business processes, the number of customer-oriented points of contact that

can be used for both generating data and systematically controlling commu-

nication has increased. Added to this is the high speed at which the corre-

sponding data is collected, processed and used. New AI approaches raise the

analytical value creation to a new level of quality.


Big Data—What Is Not New

The approach of gaining insights from data for marketing purposes is noth-

ing new. Database marketing or analytical CRM has been around for more

than 20 years. The phenomenon of large amounts of data is equally nothing

new: Point of sale, customer and credit cards or web servers have long been

producing large amounts of data. Equally, the analysis of unstructured data

in the shape of emails, web form free texts or customer surveys, for example,

frequently form a part of marketing and research.

is generated by the spreading of the InterBig Data—What Is New

It goes without saying that the amount of data has increased immensely

thanks to the Internet of Things, mobiles and social media—yet this is

rather a gradual argument. The decisive factor is that thanks to the possi-

bilities of IT and the digitalisation of business processes, customer-oriented

points of contact for both generating data and for systematically controlling

communication have increased. Added to this is the high speed at which the

corresponding data is collected, processed and used. Equally, data mining

methods of deep learning and semantic analytics raise the analytical value

creation to a new level of quality.

Definition of Big Data

As there are various definitions of big data, one of the most common ones

will be used here:

“Big data” refers to datasets whose size is beyond the ability of typical database

software tools to capture, store, manage, and analyse.

Comments

Post a Comment

Popular posts from this blog

How to Earn money with Email List Building

 Collecting emails is one of the number one ways to have staying power and build a business online for life. Your email list becomes your B USINESS ASSET​ . As you build rapport with your list and they get to know, like and trust you... sales become effortless! You can earn daily by sending one simple email with an offer to a product (affiliate link). First and foremost where do you get the emails? You must build opt in pages and give people a reason to fill in their email. Give them something in exchange. Free giveaway, compelling headline that makes them curious and want more info. via Blog and/or C apture Page Take a look at my blog as an example:
Post a Comment
Read more

Why Use Machine Learning?

Consider how you would write a spam filter using traditional programming techniques (Figure 1-1): 1. First you would look at what spam typically looks like. You might notice that some words or phrases (such as “4U,” “credit card,” “free,” and “amazing”) tend to come up a lot in the subject. Perhaps you would also notice a few other patterns in the sender’s name, the email’s body, and so on. 2. You would write a detection algorithm for each of the patterns that you noticed, and your program would flag emails as spam if a number of these patterns are detected. 3. You would test your program, and repeat steps 1 and 2 until it is good enough. Since the problem is not trivial, your program will likely become a long list of com‐ plex rules—pretty hard to maintain. In contrast, a spam filter based on Machine Learning techniques automatically learns which words and phrases are good predictors of spam by detecting unusually fre‐ quent patterns of words in the spam examples compared to the ham e...
Post a Comment
Read more

What is Machine Learning

 The term machine learning (ML) as a part of artificial intelligence is ubiq- uitous nowadays. The term is used for a wide number of various appli- cations and methods that deal with the “generation of knowledge from experience”. The well-known US computer scientist Tom Mitchell defines machine learning as follows: A computer program is said to learn from experience E with respect to some class of tasks T and performance measure P, if its performance at tasks in T, as measured by P, improves with experience E (Mitchell 1997). An illustrative example of this would be a chess computer program that improves its performance (P) in playing chess (the task T) by experience (E), by playing as many games as possible (even against itself ) and analysing them (Mitchell 1997). Machine learning is not a fundamentally new approach for machines to generate “knowledge” from experience. Machine learning technology was used to filter out junk e-mails a long time ago. Whilst spam filters that tack- ...
Post a Comment
Read more