A Decade of Data

Joshua Carter our consultant managing the role
Posting date: 12/3/2019 10:53 AM
Y2K was nearly 20 years ago. Remember when we were all worried about the massive changes that could mean; the preparations we made getting ready for the turn of the century? Ten years later, we scoffed at our worries and hopped on the Data bandwagon…some of us. Others are still trying to catch up but in recent years, most businesses have realised it isn’t a matter of “if” you should have a Data strategy and begin to build your team, it’s a matter of “if you don’t do it, you’ll be left behind.”

As the year and the decade come to a close, we thought we’d take a look back and see some of the trends which have shaped a decade of digital transformation. And like everyone who takes a moment to look back and reflect, in our next article, we’ll take a look forward and see what surprises 2020 has in store.

Data Trends Then and Now


Still reeling from the financial crisis of 2008-2009, budget concerns were top of mind for many. The takeaway? Plan, and be flexible. 

Other trends which began in 2010 still exist today, but the vocabulary has changed. And there are further changes still which impact our technologies today and in ways we may not have realized.

  • Train and Retrain becomes Upskill and Reskill. In 2010, organisations were advised to train, and cross train their staff. Not much has changed in ten years as it’s just as important now. Only the vocabulary has changed. Now it’s upskill and reskill those employees with the skill and inclination to pivot into more Data-centric roles within your company.
  • Colocation Concerns Give Rise to the Cloud. Astronomical real estate costs for Data centre space and colocation prices drove businesses to find another way to store and manage their Data. As Cloud Computing spread, it allowed companies to avoid costly IT infrastructures. Not only did this save money, but it also gave businesses the flexibility they needed. In addition to the benefits of enterprise level organisations, cloud computing levels the playing field for smaller businesses to get in on the game.
  • Virtual in the Palm of Your Hand. Smartphones and apps offer project management of our businesses and personal lives from “what’s for dinner?” to “let’s schedule our next meeting.” Our smartphones are a one-stop shop for phone calls, text messages, video conferences, scheduling, communication with remote teams, online banking, bill pay, and more.
  • Eco-friendly is not an option, it’s an imperative. Carbon-emissions and reduction plans were already abuzz within companies. Today, Data has evolved from LEED green building certification to massive advances and predictions on the climate crisis. Standards are set.
  • Blockchain finds friends in finance, and beyond. Though it debuted in 2008 in the finance industry, it was quickly snapped up in every industry from manufacturing to retail to shipping; any business requiring a more organised supply chain. 
  • Rise of Automation and Artificial Intelligence (AI) offers benefits beyond basic tasks. While this evokes fears for many in the workforce, there are benefits which is what’s driving things forward. While this is intended to streamline processes and avoid health risks in dangerous places like factories, there is still some cause for concern. However, some studies suggest people are happy to allow computers to take on mundane, routine, and menial tasks, freeing humans to think more creatively. 
  • Getting Social Goes Online. Though platforms like Facebook and MySpace (yeah, remember MySpace?) were already available in 2010, the plethora of platforms today was a glimmer in our smartphones’ eye. No longer relegated to youth culture, social media has become one of the most important ways for leaders and corporations to communicate with people. 

The Information Age has morphed into the 'Data Decade', with improvements across Data and Analytics, AI, and Machine Learning just to name a few. It’s enhancements within these spectrums which allow Data professionals to search and sort more quickly to provide the most useful Insights for their enterprises.  

It’s estimated that in the next couple of years, 90% of companies will list information as critical and Analytics as essential to their business strategy.

If you’re interested in Marketing & Insights, Robots and Automation, Big Data and Digital or Web Analytics, we may have a role for you. Take a look at our latest opportunities or get in touch with one of our expert consultants to find out more. 

Related blog & news

With over 10 years experience working solely in the Data & Analytics sector our consultants are able to offer detailed insights into the industry.

Visit our Blogs & News portal or check out the related posts below.

Using Data Ethically To Guide Digital Transformation

Over the past few years, the uptick in the number of companies putting more budget behind digital transformation has been significant. However, since the start of 2020 and the outbreak of the coronavirus pandemic, this number has accelerated on an unprecedented scale. Companies have been forced to re-evaluate  their systems and services to make them more efficient, effective and financially viable in order to stay competitive in this time of crisis. These changes help to support internal operational agility and learn about customers' needs and wants to create a much more personalised customer experience.  However, despite the vast amount of good these systems can do for companies' offerings, a lot of them, such as AI and machine learning, are inherently data driven. Therefore, these systems run a high risk of breaching ethical conducts, such as privacy and security leaks or serious issues with bias, if not created, developed and managed properly.  So, what can businesses do to ensure their digital transformation efforts are implemented in the most ethical way possible? Implement ways to reduce bias From Twitter opting to show a white person in a photo instead of a black person, soap dispensers not recognising black hands and women being perpetually rejected for financial loans; digital transformation tools, such as AI, have proven over the years to be inherently biased.  Of course, a computer cannot be decisive about gender or race, this problem of inequality from computer algorithms stems from the humans behind the screen. Despite the advancements made with Diversity and Inclusion efforts across all industries, Data & Analytics is still a predominantly white and male industry. Only 22 per cent of AI specialists are women, and an even lower number represent the BAME communities. Within Google, the world’s largest technology organisation, only 2.5 per cent of its employees are black, and a similar story can be seen at Facebook and Microsoft, where only 4 per cent of employees are black.  So, where our systems are being run by a group of people who are not representative of our diverse society, it should come as no surprise that our machines and algorithms are not representative either.  For businesses looking to implement AI and machine learning into their digital transformation moving forward, it is important you do so in a way that is truly reflective of a fair society. This can be achieved by encouraging a more diverse hiring process when looking for developers of AI systems, implementing fairness tests and always keeping your end user in mind, considering how the workings of your system may affect them.  Transparency Capturing Data is crucial for businesses when they are looking to implement or update digital transformation tools. Not only can this data show them the best ways to service customers’ needs and wants, but it can also show them where there are potential holes and issues in their current business models.  However, due to many mismanagements in past cases, such as Cambridge Analytica, customers have become increasingly worried about sharing their data with businesses in fear of personal data, such as credit card details or home addresses, being leaked. In 2018, Europe devised a new law known as the General Data Protection Regulation, or GDPR, to help minimise the risk of data breaches. Nevertheless, this still hasn’t stopped all businesses from collecting or sharing data illegally, which in turn, has damaged the trustworthiness of even the most law-abiding businesses who need to collect relevant consumer data.  Transparency is key to successful data collection for digital transformation. Your priority should be to always think about the end user and the impact poorly managed data may have on them. Explain methods for data collection clearly, ensure you can provide a clear end-to-end map of how their data is being used and always follow the law in order to keep your consumers, current and potential, safe from harm.  Make sure there is a process for accountability  Digital tools are usually brought in to replace a human being with qualifications and a wealth of experience. If this human being were to make a mistake in their line of work, then they would be held accountable and appropriate action would be taken. This process would then restore trust between business and consumer and things would carry on as usual.  But what happens if a machine makes an error, who is accountable?  Unfortunately, it has been the case that businesses choose to implement digital transformation tools in order to avoid corporate responsibility. This attitude will only cause, potentially lethal, harm to a business's reputation.  If you choose to implement digital tools, ensure you have a valid process for accountability which creates trust between yourself and your consumers and is representative of and fair to every group in society you’re potentially addressing.  Businesses must be aware of the potential ethical risks that come with badly managed digital transformation and the effects this may have on their brands reputation. Before implementing any technology, ensure you can, and will, do so in a transparent, trustworthy, fair, representative and law-abiding way.  If you’re in the world of Data & Analytics and looking to take a step up or find the next member of your team, we can help. Take a look at our latest opportunities or get in touch with one of our expert consultants to find out more.

Weekly News Digest - 11th-15th Jan 2021

This is Harnham’s weekly news digest, the place to come for a quick breakdown of the week’s top news stories from the world of data and analytics. KDNuggets: 20 core Data Science concepts for beginners The field of Data Science is one that continuously evolves. For Data Scientists, this means constantly learning and perfecting new skills, keeping up to date with crucial trends and filling knowledge gaps.  However, there are a core set of concepts that all Data Scientists will need to understand throughout their career, especially at the start. From Data Wrangling to Data Imputation, Reinforcement Learning to Evaluation Metrics, KDNuggets outlines 20 of the key basics needed.  A great article if you’re just starting out and want to grasp the essentials or, if you’re a bit further up the ladder and would appreciate a quick refresh.  Read more here.  FinExtra: 15 DevOps trends to watch in 2021 As a direct response to the COVID-19 pandemic, there is no doubt that DevOps has come on leaps and bounds in the past year alone. FinExtra hears from a wide range of specialists within the sector, all of whom give their opinion on what 2021 holds for DevOps.  A few examples include: Nirav Chotai, Senior DevOps Engineer at Rakuten: “DataOps will definitely boom in 2021, and COVID might play a role in it. Due to COVID and WFH situation, consumption of digital content is skyrocket high which demands a new level of automation for self-scaling and self-healing systems to meet the growth and demand.” DevOps Architect at JFrog: “The "Sec'' part of DevSecOps will become more and more an integral part of the Software Development Lifecycle. A real security "shift left" approach will be the new norm.” CTO at International Technology Ventures: “Chaos Engineering will become an increasingly more important (and common) consideration in the DevOps planning discussions in more organizations.” Read the full article here.  Towards Data Science: 3 Simple Questions to Hone Python Skills for Beginners in 2021 Python is one of the most frequently used data languages within Data Science but for a new starter in the industry, it can be incredibly daunting. Leihua Yea, a PHD researcher at the University of California in Machine Learning and Data Science knows all too well how stressful can be to learn. He says: “Once, I struggled to figure out an easy level question on Leetcode and made no progress for hours!” In this piece for Towards Data Science, Yea gives junior Data Scientists three top pieces of advice to help master the basics of Python and level-up their skills. Find out what that advice is here.  ITWire: Enhancing customer experiences through better data management From the start of last year, businesses around the globe were pushed into a remote and digital way of working. This shift undoubtedly accelerated the use of the use of digital and data to keep their services as efficient and effective as possible.  Derak Cowan of Cohesity, the Information Technology company, talks with ITWire about the importance of the continued use of digital transformation and data post-pandemic, even after restrictions are relaxed and we move away from this overtly virtual world.  He says: “Business transformation is more than just a short-term tactic of buying software. If you want your business to thrive in the post-COVID age, it will need to place digital transformation at the heart of its business strategy and identify and overcome the roadblocks.” Read more about long-term digital transformation for your business here.  We've loved seeing all the news from Data and Analytics in the past week, it’s a market full of exciting and dynamic opportunities. To learn more about our work in this space, get in touch with us at info@harnham.com.

RELATED Jobs

Salary

£30000 - £80000 per annum + Benefits

Location

Milton Keynes, Buckinghamshire

Description

Are you looking to work amongst talent individuals in a leading Tech company, building valuable relationships and being a key element to the company's success?

Salary

€60000 - €80000 per annum

Location

Paris, Île-de-France

Description

On recherche un profil de DATA SCIENTIST complet (experience de mise en prod' d'algos obligatoire) avec une affinité et expérience pour les sujets finance.

Salary

US$120000 - US$130000 per annum + Additional Benefits

Location

Cincinnati, Ohio

Description

My client in Ohio are looking for big data engineering experts looking to join a learning-based cutting edge environment to grow technically!

recently viewed jobs