4 Barriers Stand Between You and Big Data Insight

A majority of organizations believe that big data can give them a competitive advantage, but nearly 60 percent also believe that moving from data to insight is a major challenge. Consulting firm PwC says four barriers stand between your operation and data insights.

Written by Thor Olavsrud for CIO Magazine — Over the past three years or so, the buzz around big data has continued to grow. While some dismiss it as so much hype, businesses around the world are taking notice: In its recently released 5th annual Digital analytics IQ Survey, consulting firm PwC found that 62 percent of respondents believe big data can give them a competitive advantage.

But believing in the power of big data is one thing; leveraging big data for actionable insights is another. PwC also found that 58 percent of respondents agree that moving from data to insight is a major challenge.
"The amount of information and data that we're collecting now is truly enormous in terms of the volume that is outside the four walls of the organization," says Anand Rao, principal at PwC. "Organizations don't have the right people, they don't have the right structure in place and they're still struggling with some of the tools and techniques."

PwC surveyed 1,108 respondents from 12 countries and across a variety of industries. The respondents were evenly divided between IT and business leaders, and more than 75 percent worked in organizations with revenues of more than $1 billion. PwC found that organizations struggle with four major big data barriers:

  • They're blind to the importance of visualization.
  • They're investing more in gathering data than analyzing it.
  • They're facing a talent gap.
  • They're struggling with insufficient systems to rapidly process information.

Businesses Blind to the Importance of Visualization

When it comes to actually deriving insight from the trove of data at most organizations' disposal, visualization is fundamental. Visualization helps put data into context and bring business cases to life. In many cases, advanced visualization capabilities allow organizations to glean insights that would be impossible otherwise.

For instance, due to archaic records and inaccurate information, most utilities have no idea where all of their underground assets are located, resulting in all-too-common service interruptions for residents when a power line is accidentally cut or a water line bursts.

To avoid these problems, the City of Las Vegas took advantage of smart data to develop a living model of its utilities network. VTN Consulting helped the city aggregate data from various sources into a single real-time 3D model created with Autodesk technology. The model includes both above and below ground utilities, and is being used to visualize the location and performance of critical assets located under the city.

And yet, only 26 percent of global survey respondents are using data visualization. But the picture is very different when you focus in on top performing companies.

Click here for the article on the web.



<< Click here to see more recent news articles >>

 

Latest Jobs

Salary

US$95000 - US$130000 per year + 10% Bonus

Location

New York

Description

Mission driven company growing exponentially in NYC; looking for a Senior Data Analyst focused in Business Intelligence and Data Warehousing.

Salary

US$100000 - US$135000 per year

Location

Santa Monica, California

Description

Harnham is partnered with an artificial intelligence startup out of Los Angeles.

Salary

US$100000 - US$140000 per year + Additional Benefits

Location

Boston, Massachusetts

Description

Hi All, I'm currently recruiting for this position. Please click on the job title below to view the Job Description and apply to it!

Salary

US$120000 - US$160000 per year + Equity

Location

San Francisco, California

Description

The main responsibly for this role is to be the driving force in design and development of data solutions on the AWS hosted platform. .

Salary

US$400 - US$480 per day

Location

San Francisco, California

Description

A global leader within the Technology industry is seeking a seasoned Data Warehouse Engineer to add to their top-tier Data & Tech team! Read on!

Harnham blog & news

With over 10 years experience working solely in the Data & Analytics sector our consultants are able to offer detailed insights into the industry.

Visit our Blogs & News portal or check out our recent posts below.

How Cities Are Using Big Data

How Cities Are Using Big Data

High speed trains in Florida. Driverless cars in Arizona. National grid union agreements. All these and more are working to create a more smoothly operating system of infrastructure. While privacy laws and transparency vie for attention at every level of government in the US, cities have taken the onus of using data to make decisions.   The functionality a critical infrastructure society is built on – railroad tracks, flare stacks, power lines – has been brought together by robotics and AI. The decentralization of intelligence, cloud systems which remotely control Industrial IoT, and AI are just a few of the ways in which 2019 will be a breakout year for Distributed AI. New York City Uses Data to Alleviate Damage Risk to Buildings In their race to stay ahead of Big Data, they may also find ways to improve they might never have discovered without it. New York City has limited staff who can analyze its million properties and incorporate analytics to discern fire risk considering past risk and building traits. City coding has therefore become more important than ever to alleviate potential risk.   Philadelphia Focuses on City Interaction with its Residents Evidence-based decision making has debuted in Philadelphia’s GovLabPHL, a multi-agency collaboration. Together, they are centralizing and digitizing records making information easier to share among agencies that historically kept information to themselves. With everything in one place, they can provide city services to their residents much more effectively and efficiently. Florida’s First High Speed TGV Train Rolled out late last year, this high-speed train travels from Miami to West Palm Beach with plans to branch into Orlando and Tampa soon. America’s first high speed passenger train in years will help alleviate road traffic, noise pollution, and more. Data collected may include best safety measures, business practices, and economic value to the city and its residents as money shifts from car buying to rail ticket purchases. The Ethics of Data and Potential Risk of Bias Gaining insights into human behaviors, ease of transportation, and predictive information to curb damage to buildings and other city properties are all important to a smart city’s infrastructure. But, data is, after all, input by humans and isn’t infallible; falling prey to natural biases. Researches and analysts caution decision-making from computer-based algorithms isn’t perfect and should be considered with discretion. For example, the rise in AI, face recognition software, traffic cams, and statistics currently on file may hold a prejudice against certain ethnicities based upon their developer’s biases. This is especially glaring in criminal behavior predictions and as such, policymakers need to think critically and to not take technology at face value. After all, those inputting the data are human, and our biases have a way of seeping into our information. In 2019, AI systems are no longer the robotic machines once shown in movies as something to fear. Today, vendors who build these systems must not only focus on the value provided, but also consider moral foundation of their service. It’s important to understand exactly why and how data will be collected and with whom it will be shared. As cities and businesses continue to catch up, this knowledge is necessary for long-term viability, credibility, and transparency. Trust is a crucial element of data strategy.  See Through Cities – Transparency is Key City governments and researchers are working to lessen discriminatory outcomes by turning to transparency. Major cities such as Philadelphia and New York have opened up their websites and invited the public to examine information and their methods of interpreting the data. New York implemented a task force to study how the city uses data and its goal is to present in December of this year ways the city should assess its automated decision-making for transparency, equity, and opportunity. This is a pivotal year for cities to understand their urban ecosystems. Understanding challenges such as traffic, pollution, parking and inefficiency of movement in urban areas may help realize how, when, and where people are moving. With core infrastructures in place, movement may be reduced. In addition, mobility will become efficient and lessen people’s need to move around for better jobs and/or housing. AI is the tool to help cities gain visibility into this type of data. It will enable not only visibility, but also foster prediction capabilities, and provide actionable insights to improve our understanding of why, how, and the way we move. If you’re interested in Big Data & Analytics, we may have a role for you. We specialize in junior and senior roles. Check out our current vacancies or contact one of our recruitment consultants to learn more.  For our West Coast Team, call (415) 614 4999 or send an email to sanfraninfo@harnham.com.   For our Mid-West and East Coast Teams, call (212) 796 6070 or send an email to newyorkinfo@harnham.com.

What Does the Future of Tech Hold as Businesses Look to the New Year?

What Does the Future of Tech Hold as Businesses Look to the New Year?

Black Friday. Cyber Monday. Tech Tuesday? The weekend surrounding Thanksgiving is full of opportunities to save big. This week sees even more action at the two-day AI and Big Data Conference in Santa Clara, California. Though LinkedIn may show news of Silicon Valley upsets, no one has told these thought leaders, forward-thinking brands, and hot start-ups as this conference is expected to be the biggest yet. In the spirit of the season, we thought we’d hone in on building a foundation for your digital transformation as you look to the new year. Lay the Foundation  With AI at the heart of modern applications in today’s business world, it’s important to not only have digital leaders who can take the reins, but also, data scientists who are pivotal developers. These are the individuals who have mastered the tools and skills of data science. They can understand and translate the data gathered via machine learning and AI for such common applications as predictive analytics, consumer experience, and image-based search. To create an effective AI pipeline, developers need a place to store, manage, and control models as part of the DevOps lifecycle.  In addition, they’ll need a data lake to store, aggregate, and prepare data for exploration, predictive modelling, and training. Like so many technologies of today, DevOps is part of an integrated collaboration environment, and is the baseline from which all pipeline functions emanate.  Things to Consider as You Build Your AI Strategy Artificial Intelligence (AI) has been a buzzword for a number of years, but as many businesses are quickly coming to know, it’s important to have the right strategy, and that includes knowing when to apply it to solve business problems, and when not.  Here are a few things to think about as you plan: Ask what problem you want AI to solve. Think it through. Identify where it can be most effective and understand that it is not a solution for everything. It’s a huge investment, so if there are other ways to solve your problem, identify those solutions first. Do your research. Consider the legal aspects as you analyze and set a benchmark for industry trends. Have a solid understanding of analytics. If you’re using AI in your business strategy, make sure you understand your data in order to either implement it successfully, or know enough to pull the plug.  Educate Your Team by Including them in the transformation. Remind them it’s not about machines taking over their jobs, but that it’s an opportunity to grow. Offer opportunities for upskilling, and education.  Trends in Transformation If your company wants to stay ahead of the competition, now is the time to embrace the technology of the future. Create an immersive customer experience, pair your analysis with machine learning, and get comfortable with experimentation in support of your organization’s goals. We’re looking forward to being inspired by the thought leaders and new tech evangelists at this week’s AI and Big Data Expo, discovering how businesses are using artificial intelligence, machine learning, and data analysis to find new ways to engage and improve their customer experience.  If you’re interested in Big Data and Analytics, we may have a role for you. We specialize in junior and senior roles. If you’re attending the Big Data and AI Expo in Silicon Valley, November 28 and 29, stop by our booth and say hi. We look forward to meeting you and can discuss opportunities on the spot.  If you can’t make it, you can check out our current vacancies or contact one of our recruitment consultants to learn more.  For our West Coast Team, call (415) 614 4999 or send an email to sanfraninfo@harnham.com.   For our Mid-West and East Coast Teams, call (212) 796 6070 or send an email to newyorkinfo@harnham.com.

Recently Viewed jobs