Big data: 4 predictions for 2014

our consultant managing the role
Posting date:6/6/2018 7:50 AM

Big data was seen as one of the biggest buzzwords of 2013, when companies often used the term inappropriately and in the wrong context. This year, people will finally understand what it means

One could look back at 2013 and consider it the breakthrough year for big data, not in terms of innovation but rather in awareness. The increasing interest in big data meant it received more mainstream attention than ever before. Indeed, the likes of Google, IBM, Facebook and Twitter all acquired companies in the big data space. Documents leaked by Edward Snowden also revealed that intelligence agencies have been collecting big data in the form of metadata and, amongst other things, information from social media profiles for a decade.

And beyond all of that, big data became everyone's most hated buzzword in 2013 after it was inappropriately used everywhere, from boardrooms to conferences. This has led to countless analysts, journalists and readers calling for people to stop talking about big data. A good example could be seen in the Wall Street Journal last week, where a reader wrote in complaining:

A lot of companies talk about it but not many know what it is.

While that's a problem, it leads to my first prediction:

1. In 2014, people will finally start to understand the term big data. Because, as it stands, many do not.

The truth is that we've only really just started to talk about big data and companies aren't going to stop screaming about their latest big data endeavors. In fact, it's only January and the social bookmarking network Pinterest has already acquired image recognition platform VisualGraph. (Why? Pinterest want to understand what users are "pinning" and create better algorithms to help users better connect with their interests).

So let's get 2014 off on the right foot with a definition of big data, from researchers at St Andrews, that's fairly easy to understand:

The storage and analysis of large and/or complex data sets using a series of techniques including, but not limited to: NoSQL, MapReduce and machine learning.

The main elements revolve about volume, velocity and variety. And the word 'big'? If your personal laptop can handle the data on an Excel spreadsheet, it's not big.

Matt Asay, a journalist with ReadWriteWeb, also does a good job in explaining what makes a big data problem (as opposed to more traditional business intelligence).

If you know what questions to ask of your transactional cash register data, which fits nicely into a relational database, you probably don't have a big data problem. If you're storing this same data and also an array of weather, social and other data to try to find trends that might impact sales, you probably do.

2. Consumers will begin to (voluntarily) give up certain elements of privacy for personalization.

We've all heard of cookies – and we know that our actions around the internet affect the adverts that we see on websites and the suggested items we receive on Amazon. This is a concept that we've not only become accustomed to but also accept. After all, if we're going to have information put in front of us, we'd rather that we could relate to it.

But there have been problems in the past. Some websites have taken advantage of customers, for example increasing the prices for a flight that they've previously expressed interest in (consumers might worry that the price will go up even further and therefore decide to buy a ticket).

But as more companies instil big data techniques, customers will cooperate, on the premise that they will benefit. This is likely to follow Tesco's methodology, whereby customers are sent vouchers for goods that they are likely to buy anyway, creating a win-win situation for both parties. Customers, generally, are happy to receive a discount and retailers are pleased customers are coming back (especially if vouchers have an expiry date).

3. Big data-as-a-service will become a big deal

Despite claims from analysts that all businesses will look to hire data scientists, this just isn't going to happen. Firstly, there's a shortfall of data scientists, which goes some way in explaining why companies are retraining existing staff to work with big data) and secondly, not all companies are ready to (nor do they need to) invest in full-time data scientists to analyze and explain their data.

Instead, just as in other areas, I expect a wave of companies hustling to enter the big data-as-a-service space, an idea that began to creep into the latter parts of 2013. This could be anything from small and medium businesses signing up to anything from entire packages of storing, analyzing, explaining and visualizing data to more compact services, which focus on transferring data to cloud-based servers to allow for an accessible way of questioning the data in the future.

4. And finally... remember how Hadoop is an open-source software? Expect a lot more of that.

Hadoop, famously named after a toy elephant, is a well known piece of software to anyone curious about data science and it provides the backbone for many big data systems, allowing businesses to store and analyze masses of data. Most importantly, it's open source, which means that its implementation was inexpensive, allowing many organizations to understand, rather than ignore, the data they were collecting.

Quentin Gallivan, the chief executive of business analytics software firm Pentaho, explained last month that the rise of new open-source software will bring about more innovation and more ways of understand the data. He said:

New open source projects like Hadoop 2.0 and YARN, as the next generation Hadoop resource manager, will make the Hadoop infrastructure more interactive... projects like STORM, a streaming communications protocol, will enable more real-time, on-demand blending of information in the big data ecosystem.


Click here for the article on the web.

Related blog & news

With over 10 years experience working solely in the Data & Analytics sector our consultants are able to offer detailed insights into the industry.

Visit our Blogs & News portal or check out the related posts below.

Why A Good Work-Life Balance Is Better for Business

Contrary to American sitcoms, work life balance isn’t about sitting in coffee shops contemplating life and complaining about work. However, there are plenty of jobs where you can work from or in a coffee shop. The rise of virtual, remote, and contractual roles has contributed to the demand for work life balance. But, sometimes, in our tech-led world, where business can follow us anywhere, the balance becomes more about setting boundaries. It’s about putting down our mobile phones, closing our laptops, and dipping our toes into other waters.  Where Does Your Country Fit on the Work-Life Balance Scale? European countries have been leading the way with work-life balance for some time, with the Netherlands topping the list at number one. With the UK sitting at number 29 out of the 38 countries in the Organisation for Economic Co-operation and Development (OECD), what’s tipping the scales? 13% of British employees work 50 or more hours per week versus 0.5% of people in the Netherlands work those long hours. The average Brit is therefore only setting aside 14.9 hours for leisure and personal care (including eating and sleeping) a day versus those in the Netherlands who dedicate 15.9 hours. Countries in the Nordics work a maximum of 48-hours per week. However, the reality is significantly lower, with the Finnish working an average of 36.2 hours a week, the Swedes 35.9 hours, Norwegians at 34 hours, and the Danes just 32 hours.Denmark, Finland, Sweden, Norway, and Iceland have become renowned for fostering optimal work-life balance. But, though the Netherlands sits at the number one spot on the OECD, the Danes top the list as the happiest in the world. The Danish welfare model, characterised by quality of life and a good work-life balance offers: Flexible working conditions and social support networks, including maternity leave and childcare facilities. A high degree of flexibility at work – often including adaptable start times and the ability to work from home. Lunch breaks are often at a designated time each day, enabling colleagues to interact, eat together, and get away from their desks. There is a minimum 5 weeks’ paid holiday for all wage earners. The Danish welfare society is characterised by quality of life and a good work-life balance. Work-life balance for the Danes is a healthy balance of priorities. As important as career and ambition is, are is just as important to balance life outside work (pleasure, leisure, family, and health). This understanding of balance not only puts Denmark at the top of the international equality table, it also contributes to a generally high standard of living. Further research shows 33% of working American adults work over the weekend and on holidays. This, in turn, has led 66% to say they don’t feel they have a good work-life balance. One of the main drivers contributing to the need to always be “on” and available is 24/7 technology.  For example, if an employer emails, texts, or rings an employee at dinnertime, the employee often feels compelled to answer straightaway. While 57% of those surveyed feel technology has ruined the family dinner, 40% believe it is okay to answer an urgent call or email at the dinner table. So, it comes back to boundaries and not feeling guilty about ‘switching off’ for a few hours or a few days to ‘recharge’. What Companies are Doing to Improve Work-Life Balance  Nordic businesses remain at the top of the list for best work-life balance. Though much of it is dictated by strict Nordic Labour laws, companies outside the Nordics are beginning to take pages from their playbook.  At a business in Helsinki, Finland, employees are encouraged to go home on time at the end of their day. Often this falls around 5:00pm, though leaving earlier to say, go to a child’s sports activity, is always a guilt-free option.  Like many European businesses, employees also receive five weeks of paid vacation each year. Everyone gets stock options and teams are small with the ability to make autonomous decisions. The theory: this team is closest to the project, they know what is best for it. No management approval required, but only to help share in lessons learned. Many Nordic businesses have shortened hours and a focus on family. By putting family first, businesses report improved productivity and innovation, less absenteeism, and reductions in staff turnover. Other benefits can include: Ability to leave work 30-minutes early to pick up kids from school or take them to sports practice Ability to use sick days to take care of sick children Businesses regularly offer gym memberships, event discounts, leadership classes, and team-building exercises as well as opportunities for employees to take courses and further their education. At one business, in Sweden, for example, employees have access to a leisure centre and recreational activities such as fishing, tennis, and swimming. Though everyone has their own definition of what work-life balance means to them, it can be difficult to follow without government mandates, like in some European countries, or if you’re a small business. Our UK and Europe Salary Guide showed that, with over 98% of respondents working full time, at least some flexibility is now expected. We found that 53% of respondents work at home at least one day a week, and 56% have flexible working hours, highlighting that these ‘benefits’ are now becoming the norm.  Harnham Life As a business, we try to both reflect, and the lead the way with, developments that we see across the Data & Analytics industry. From ensuring our consultants leave on time two days per week to participate in pursuits outside work, to offering one fully-paid Charity Day per year, we place emphasis on creating an environment where our teams feel like they have a good work-life balance. By building a culture where a consultant can set up a book club or arrange a night out on the town, we have formed a business where employee welfare is prioritised.  Though everyone has their own definition of what work-life balance means to them, it can be difficult to follow without government mandates like in some European countries or if you’re a small business. The important thing is to do what’s right for you and sometimes turn off your phone, close your laptop, and meet up with some family or friends in that coffee shop.  Whether you’re looking for a permanent position with more benefits, or the freedom of a contract role, we’re here to help with your job search.  

Key Fraud Trends: How to Stay Safe in the Changing Fraudscape

Sharing and collecting data is part of our everyday lives. Whether our information is shared over social media, e-commerce sites, banks, or elsewhere, this can open up risks.  2017 saw the highest number of identity fraud cases ever, an increase in young people ‘money muling’ and higher bank account takeovers for over-60s. Whilst overall fraud incidences fell 6%, these cases highlight just some of the changing trends as fraud issues stem more from misuse than ever before. Dixons Carphone, Facebook and Ticketmaster are just three cases you may recognise from a string of high profile data breaches this year. Technological advances, more accessible and available data, coupled with an increased sophistication of fraud schemes, makes it more likely that data breaches and fraud attacks will become regular news items. But how is the fraud landscape changing and can technological advances be advantageous in detecting and reducing fraud? Identity fraud increasing for under 21s In June 2018, Dixons Carphone found an attack enabled unauthorised access to personal data from 1.2 million customers. It’s now been uncovered that the number is much higher, closer to ten times initial estimates. Whilst no financial information was directly accessed, personal data such as names, addresses and emails enable fraudsters to fake an identity. Younger fake identities are used more for product and asset purchases which typically require less stringent checks, such as mobile phone contracts and short-term loans.  In 2017, Cifas, a non-profit organisation working to reduce and prevent fraud and financial crime, reported the highest number of identity fraud cases ever. Under 21s are most at risk seeing a 30% increase as they engage more with online retail accounts. Whereas previously identity theft would manifest itself in fraudulent card and bank account activity, it’s now being used to make false insurance claims and asset conversion calling for stronger detection in these industries.  Young People Used as Money Mules This age group aren’t only being targeted for identity theft; there’s a 27% uplift in young people acting as money mules. ‘Money muling’ is a serious offence that carries a 14-year prison sentence in the UK. In most cases, younger people are recruited with the lure of large cash payments to facilitate movement of funds through their account, taking a cut as they go.  In a world where young lives are glamourised and luxurious goods are displayed over social media, this cut can be particularly appealing. Whether aware, believing the reward outweighs the risk, or unaware a money laundering crime is being committed, deeper fraud controls are needed across social media as much as bank accounts. This raises the question as to whether banks should be linking social media to customer details to stop money laundering early on? Increased bank account takeover for over 60s Cifas also reported an increase in account takeovers for over 60s for the same period. Seen by fraudsters as a less tech-savvy and therefore more susceptible demographic, over 60s are increasingly being targeted with online and social engineering scams. The same features which can make some over 60s a target for these scams, can also mean that account takeovers are not immediately noticed and reported, posing yet another difficulty for fraud monitoring and prevention. Vigilance and proactiveness is key. Here are three tips to get you started: Never give personal or security information to someone who contacts you out of the blue, either online, on the phone, or face to face. Always phone and check with the company first. If you make the call then you know you can trust the person on the other end. Check with your bank to see if they offer an elder fraud initiative such as a monitoring service that scans for suspicious activity and alerts customers and their families or educates seniors on types of scams and how to avoid them. When in doubt about something, delay and seek a second opinion. Check with your local library, government offices, or non-profit organisation for more top tips to stay safe from scams and social engineering.   Industry approach Traditionally, financial services organisations have been at the forefront of developing fraud controls; they are often the ones most impacted by the financial risk (the monetary cost of the attacks on their business) and regulatory risk (ensuring their business is adhering to regulations and controls). However, with modern day trends and the changing nature of fraud, all industries need to be focused on reputational risks and prevention. Single big events like Facebook and Dixon Carphone’s data breaches can have a far-reaching impact.  But, there is light at the end of the tunnel. Monzo, an online bank, which bills itself as the future of banking has stepped up the game when it comes to their customer’s security. Upon reports of fraudulent activity on customer cards, they took immediate action to correct the problem. Then they took things a step further, introducing digital analytics to help identify trends and patterns. As patterns emerged, Monzo then notified both the breached business and the authorities. Perhaps a cross-industry collaborative approach is needed as, after all, fraudsters are collaborating. By doing so, businesses will become more proactive, rather than reactive, and can put measures in place to stop potential fraud. If you’ve got a nose for numbers and want to help secure the reputation of businesses the world over, we may have a role for you.  To learn more, call our UK team at +44 020 8408 6070 or email us at ukinfo@harnham.com