The Top Trends to Watch in Big Data & Analytics

Rosie O'Callaghan our consultant managing the role
Posting date: 2/26/2020 2:40 PM
Having a Data Strategy Plan for your business is no longer a nice-to-have. It is a must have, and in most circles is mission-critical to success. Where terms used to be fused (e.g. AdTech, MarTech, FinTech, etc.), infrastructures are now merging to create better and more powerful opportunities to better serve business and the day-to-day tasks of our personal lives.

Data continues to change the landscape of our world and, as we look forward to the future, this shows no sign of slowing. Here are some of the biggest trends shaping Data Analytics right now:

A Smart World: IoT, Conversational Analytics, and NLP


It’s estimated that by 2020, there will be around 30 billion IoT connected devices. Think beyond smart houses and smart cars to video doorbells, smart refrigerators and toasters, setting your thermostat by remote and beyond. As this cadence of progress marches forward, IoT will no longer be a hardware challenge, but a data challenge. 

And according to a Gartner report on Data Analytics trends, it’s estimated 50 percent of analytical queries will be generated via search, voice, or NLP by 2020. Will this make Data Analytics more approachable for the everyman? 

Augmented Analytics


Is Augmented Analytics poised to be the next big thing? With a market valued at US$8.4 billion just a couple of years ago, it’s estimated to grow to US$22.4 billion by 2025. Using Machine Learning and NLP to automate Data preparation for sharing, Augmented Analytics could redefine the way we approach our Data.

Cloud Continues to Come of Age


Cloud IT infrastructure may already be mainstream, but with spending expected to reach US$82.9 billion by 2022, and with over half all software, services, and technology expected to connect to the Cloud in the same timeframe, expect the conversation around the Cloud to keep growing.

Data Science Roles Evolve into Specialties 


Frequently, the term Data Scientist is used to refer to anything to do with Data. From gathering and collecting to developing metrics and offering Data insights and forecasting. But as Data teams became less siloed and IT infrastructures became more specialised, the role has evolved into more specific functions, often with a Machine Learning or NLP focus. However, this evolution didn’t stop at these specifics. 

It’s even made room for those with no programming background. From Marketing Analysts who focus on the customer journey to Business Analysts and Communications Directors who can utilize their soft skills to explain Data professionals’ findings. Whether you’ve got a programming background or an interest in how Data fuels business, the world of Data has opened up. 

Have we reached the end of the beginning? As we find ourselves on the cusp of the next generation of Data & Analytics in both our personal and professional lives, we spoke to Daniel Levine, Trends Expert and Keynote Speaker to gather his thoughts. Here’s what he had to say:

"The biggest overall trend I'm seeing for Data in the coming decade is all about ownership, transparency, privacy, and governance.
Data famously wants to be free, but the opposite has happened as companies across the industrial spectrum have scooped it up and siloed it away.
The 2020s will create unprecedented amounts of Data from biometric recognition, deep learning, digital streaming, smart appliances and more. And ownership will be shared with -- if not controlled by -- individuals rather than governments and corporations.
Blockchain will play a pivotal role in this, offering individuals the ability to safely take control of their own Data. 
Many governments, led by the liberal democracies of Europe, will enact legislation that aligns with new realities and new technologies that empower both institutions and individuals to understand and control their own Data.
The frightening alternative that, when it comes to Big Data, we have reached the end of the beginning whereby a totalitarian dystopian future is nigh."

If you’re interested in Big Data & Analytics, we may have a role for you. Take a look at our current opportunities or get in touch with one of our expert consultants to find out more.   

Related blog & news

With over 10 years experience working solely in the Data & Analytics sector our consultants are able to offer detailed insights into the industry.

Visit our Blogs & News portal or check out the related posts below.

Weekly News Digest - 11th-15th Jan 2021

This is Harnham’s weekly news digest, the place to come for a quick breakdown of the week’s top news stories from the world of data and analytics. KDNuggets: 20 core Data Science concepts for beginners The field of Data Science is one that continuously evolves. For Data Scientists, this means constantly learning and perfecting new skills, keeping up to date with crucial trends and filling knowledge gaps.  However, there are a core set of concepts that all Data Scientists will need to understand throughout their career, especially at the start. From Data Wrangling to Data Imputation, Reinforcement Learning to Evaluation Metrics, KDNuggets outlines 20 of the key basics needed.  A great article if you’re just starting out and want to grasp the essentials or, if you’re a bit further up the ladder and would appreciate a quick refresh.  Read more here.  FinExtra: 15 DevOps trends to watch in 2021 As a direct response to the COVID-19 pandemic, there is no doubt that DevOps has come on leaps and bounds in the past year alone. FinExtra hears from a wide range of specialists within the sector, all of whom give their opinion on what 2021 holds for DevOps.  A few examples include: Nirav Chotai, Senior DevOps Engineer at Rakuten: “DataOps will definitely boom in 2021, and COVID might play a role in it. Due to COVID and WFH situation, consumption of digital content is skyrocket high which demands a new level of automation for self-scaling and self-healing systems to meet the growth and demand.” DevOps Architect at JFrog: “The "Sec'' part of DevSecOps will become more and more an integral part of the Software Development Lifecycle. A real security "shift left" approach will be the new norm.” CTO at International Technology Ventures: “Chaos Engineering will become an increasingly more important (and common) consideration in the DevOps planning discussions in more organizations.” Read the full article here.  Towards Data Science: 3 Simple Questions to Hone Python Skills for Beginners in 2021 Python is one of the most frequently used data languages within Data Science but for a new starter in the industry, it can be incredibly daunting. Leihua Yea, a PHD researcher at the University of California in Machine Learning and Data Science knows all too well how stressful can be to learn. He says: “Once, I struggled to figure out an easy level question on Leetcode and made no progress for hours!” In this piece for Towards Data Science, Yea gives junior Data Scientists three top pieces of advice to help master the basics of Python and level-up their skills. Find out what that advice is here.  ITWire: Enhancing customer experiences through better data management From the start of last year, businesses around the globe were pushed into a remote and digital way of working. This shift undoubtedly accelerated the use of the use of digital and data to keep their services as efficient and effective as possible.  Derak Cowan of Cohesity, the Information Technology company, talks with ITWire about the importance of the continued use of digital transformation and data post-pandemic, even after restrictions are relaxed and we move away from this overtly virtual world.  He says: “Business transformation is more than just a short-term tactic of buying software. If you want your business to thrive in the post-COVID age, it will need to place digital transformation at the heart of its business strategy and identify and overcome the roadblocks.” Read more about long-term digital transformation for your business here.  We've loved seeing all the news from Data and Analytics in the past week, it’s a market full of exciting and dynamic opportunities. To learn more about our work in this space, get in touch with us at info@harnham.com.

Weekly News Digest: 7th - 11th December 2020

This is Harnham’s weekly news digest, the place to come for a quick breakdown of the week’s top news stories from the world of Data & Analytics.  Raconteur: Implementing AI successfully The pandemic has undoubtedly accelerated the implementation of AI systems across a vast range of companies worldwide. Many business leaders and senior teams are aware of, and excited by, the huge scope of opportunities AI will bring into the workplace, especially when it comes to decision making. However, teams are still concerned and frustrated by the lack of understanding of the technology involved and the inadequate amount of reliable Data. With the help of AI and Data specialists, Raconteur explores how senior leaders can solve these issues; from the increasing the investment of both time and money in boosting employee skills training, creating high-quality Data silos or dispersing the workload across the whole team, Data Analysts have a key role to play.  There’s a lot of golden nuggets of advice in this piece, a great resource for Data teams looking to make their AI more effective and efficient in 2021.  Read the full article here. Tech Crunch: Amazon Web Service (AWS) adds natural language search service for business intelligence from its data sets Andy Jassy, CEO of Amazon Web Services, recently delivered a keynote speech at event AWS re:Invent where he discussed Amazon Web Services' latest upgrade – QuickSight Q.  In 2016, AWS launched QuickSight, a business intelligence service allowing business users to have access to product information and customer information, usually something only developers were privy too. But at the time, the natural language processing tools simply weren’t good enough for this to happen. Fast forward four years, and AWS has finally cracked it; QuickSight Q was born.  In this article by Tech Crunch, Jonathan Shieber explores how QuickSight Q will work and how the natural language processing in AWS is a direct challenge to several business intelligence startups.  Read the full article here. ZDNet: Amazon unveils Amazon HealthLake, Big Data store for Life Sciences Taking centre stage at this week’s Amazon Web Service event, AWS re:Invent, Vice President for AI at AWS, Matt Wood, unveiled an all-new service, Amazon HealthLake. The new AI system will be revolutionary for the healthcare and Life Sciences sector, especially when it comes early detection of illnesses such as diabetes.  As said by Wood, “[Currently] the work in these fields is hampered by the way that data is spread throughout numerous repositories in different formats, requiring weeks or months to prepare, stage, transform data.” This overwhelming abundance of data in healthcare can make it much harder for specialists to diagnose and treat patients efficiently.  We know that AWS HealthLake will be a way to store, transform, and analyse health and life science data in the cloud at petabyte scale, making the whole process a lot more streamlined and effective. One to keep an eye on. Read more on HealthLake here.  The Drum: What brands need to know about consent and Data This year, data has played a role like never before in both our day-to-day personal and professional lives. With the quick and unexpected move to online and remote working as a direct impact of COVID-19, keeping on top of and up to date with technology, privacy and data consent has been an ever-growing challenge for brands, businesses and agencies worldwide.   Those businesses that have been putting data safety and consent first, over the past nine months especially, will get ahead of the competition. Those who haven’t are in danger of coming under fire from their own customers, and it may cause irreparable damage to their brand.  At the Drum Digital Summit last month, a panel of data specialists including Niall Hogan, Siva Jayaraj and Colleen Ngo, discussed exactly what brands need to know about data and most importantly data consent moving forward.  The panel agreed that the biggest issue lay in the education of data consent, and more should be done to raise awareness from a young age.  Click here to read more and to listen to the full panel discussion. The Data & Analytics market is one full of exciting and dynamic opportunities. To learn more about our work in this space, get in touch with us at info@harnham.com.

RELATED Jobs

Salary

£20000 - £40000 per annum + commission + bonus + benefits

Location

City of London, London

Description

Great Opportunity to join our UK team, great career opportunities and markets to operate in

recently viewed jobs