Breaking Code: How Programmers and AI are Shaping the Internet of Tomorrow

our consultant managing the role
Posting date: 9/13/2018 9:10 AM
Data. It’s what we do. But, before the data is read and analysed, before the engineers lay the foundation of infrastructure, it is the programmers who create the code – the building blocks upon which our tomorrow is built. And once a year, we celebrate the wizards behind the curtain. 

In a nod to 8-bit systems, on the 256th day of the year, we celebrate Programmers’ Day. Innovators from around the world gather to share knowledge with leading experts from a variety of disciplines, such as privacy and trust, artificial intelligence, and discovery and identification. Together they will discuss the internet of tomorrow. 

The Next Generation of Internet


At the Next Generation Internet (NGI), users are empowered to make choices in the control and use of their data. Each field from artificial intelligent agents to distributed ledger technologies support highly secure, transparent, and resilient internet infrastructures.

A variety of businesses are able to decide how best to evaluate their data through the use of social models, high accessibility, and language transparency. Seamless interaction of an individual’s environment regardless of age or physical condition will drive the next generation of the internet. But, like all things which progress, practically at the speed of light, there is an element of ‘buyer beware’, or in this case, from ‘coder to user beware’.

Caveat Emptor or rather, Caveat Coder


The understanding, creation, and use of algorithms has revolutionised technology in ways we couldn’t possibly have imagined a few decades ago. Digital and Quantitative Analysts aim to, with enough data, be able to predict some action or outcome. However, as algorithms learn, there can be severe consequences of unpredictable code

We create technology to improve our quality of life and to make our tasks more efficient. Through our efforts, we’ve made great strides in medicine, transportation, the sciences, and communication. But, what happens when the algorithms on which the technology is run surpasses the human at the helm? What happens when it builds upon itself faster than we can teach it? Or predict the infinite variable outcomes? Predictive analytics can become useless, or worse dangerous. 

Balance is Key


Electro-mechanical systems we could test and verify before implementation are a thing of the past, and the role of Machine Learning takes front and centre. Unfortunately, without the ability to test algorithms exhaustively, we must walk a tightrope of test and hope.

Faith in systems is a fine balance of Machine Learning and the idea that it is possible to update or rewrite a host of programs, essentially ‘teaching’ the machine how to correct itself. But, who is ultimately responsible? These, and other questions, may balance out in the long run, but until then, basic laws regarding intention or negligence will need to be rethought.

Searching for a solution 


In every evolution there are growing pains. But, there are also solutions. In the world of tech, it’s important to put the health of society first and profit second, a fine balancing act in itself.

Though solutions remain elusive, there are precautions technology companies can employ. One such precaution is to make tech companies responsible for the actions of their products, whether it is lines of rogue code or keeping a close eye on avoiding the tangled mass of ‘spaghetti’ code which can endanger us or our environment.

Want to weigh in on the debate and learn how you can help shape the internet of tomorrow? If you’re interested in Big Data and Analytics, we may have a role for you.

Check out our current vacancies. To learn more, contact our UK team at +44 20 8408 6070 or email us at info@harnham.com.

Related blog & news

With over 10 years experience working solely in the Data & Analytics sector our consultants are able to offer detailed insights into the industry.

Visit our Blogs & News portal or check out the related posts below.

HOW TO MAXIMISE YOUR TRAVEL DATA WITH THE RIGHT ANALYTICS

Summer is here and over half will be planning their holiday via mobile phone. Heathrow Airport, one of the busiest airports in the world, will be filled to the brim with eager travelers. Hotels and cruise ships will be bursting at the seams. But, will the people traveling today, be the same people traveling next summer? How will the travel organisations know?  They’ll need data analytics to help them make sense of all their data with advice and direction on how best to utilise nuggets of actionable insights.   It wasn’t that long ago, at the busiest time of the year, Heathrow, as well as most of the airports around Europe, shut down. Why? Because no had planned for something of that magnitude – the snowstorm of the century some said. Tangible evidence of planning for every scenario, no matter how unlikely.   What Would a Data Professional Do?  Data professionals ask questions. They create scenarios. In the above instance, what might a Data Engineer have asked? In a data-driven world, could the airport shutdowns have been prevented? Would scenarios and algorithms have helped to scale corrections faster?  These are just a few of the questions a data professional might ask. But, in order to provide solutions, first you need a builder – a data engineer. You don’t always have to build from the ground up, though. Sometimes, reconstruction and refurbishment are just what’s needed to bring a project back to its former glory.  Digital Transformation in Travel  As travel companies prepare for the upcoming Digital Travel Summit at the end of this month, they’ve released a report targeting certain areas on which to focus. Not the least of which is the need for stronger data analytics with less than half reporting they have a plan in place but are looking to improve it.  One of the main areas of focus according to the report is lack of programming skills coupled with a hesitant approach by management. The complexity and difficulty of trying to analyse and personalise the sheer amount of consumer data available is also a factor.  And without the right tools, it’s even more difficult. Knowing what data is useful and what is isn’t is a major challenge, as well as the ability to track large amounts of data in real time can be a daunting task. These challenges and more, offer the perfect opportunity for a seasoned Data Engineer to step in, and take on a leadership role.  Take the Next the Step  Are you a Data Engineer ready to take your career to the next level? Are you a wizard at big data technologies with a leadership bent? Then we may have a role for you. A leading e-commerce company is looking to transform their data infrastructure (Python, AWS, Airflow) by hiring a senior data engineer.  Check out our other current vacancies or contact Joshua Carter, Recruitment Consultant with a Data Engineering focus at +44 20 8408 6070 or email joshuacarter@harnham.com to learn more.

Route to the role of Data Engineer

Do you like breaking things down to see how they work? Do you want to build something that helps solves problems and can make lives better? Are you a puzzle solver curious about the world around you with a knack for mathematics? Do you prefer to work behind the scenes or front of stage? If you want to be the person behind the curtain, then this is your year. The year of the Data Engineer is here.  In last week’s article, we talked about Data Engineer as the unsung hero of the data science world and briefly touched on route to the role of engineer. Though experience supersedes education, you do need the basics – a bachelor’s degree in computer science, data science, applied math, physics, statistics, software/computer engineering which can lead to a Master’s in Data Engineering and to cement your knowledge – fellowships and professional organisations are now available around the world. In today’s article, we’ll cover a few options.  Lay Your Educational Foundation Computer Science, Data Science, and Engineering programs abound in university today, but no school can really teach big data skills. It’s too focused. Most schools today offer general purpose tech education with a focus on web development or backend systems. And here begins that Catch-22. Though experience supersedes education, you still need a framework from which to build.  More often than not, if you type Data Engineer into Google looking for education programs, you’ll get undergrad opportunities for Data Science. However, that’s not to say a Bachelor’s in Data Science can’t lead you to a Master’s in Data Engineering. So, how do you get from point A to point B? Here are a few suggestions:  Beef up your skills with specific certifications for the languages businesses need – Scala, Python, and Java  Take courses in data engineering technology: Hadoop, Spark, AWS, GCP, Azure etc.   Join a professional organization for Data Engineers such as The Data Warehousing Institute  (TDWI) or the Institution of Engineering and Technology (IET) – here you’ll find articles, resources, and a network of mentors ready to offer advice and suggestions.  Apply for a fellowship  with ASI Data Science – an 8-10 week intensive project with one of their partner companies to solve real-world business problems using Data Science or Data Engineering skills. If you’re a postgrad or higher, this a perfect opportunity to build your portfolio.  Boost Your Data Engineering Resume with These Tips In the world of data engineering, it’s important to highlight the details. Be specific: Companies will be more interested in interviewing you if you can clearly outline why/what you have used different technology for. Keep this punchy and concise, and outline your in-put with said technologiesOutline projects you’ve worked on Detail the technologies you’ve used  David Bianco, a Data Engineer with Urthecast, offers the following advice to data engineering students. Be fluent in the languages and tools you use to get the job Understand the concepts behind what you’re doing Get involved with a community – meetup.com, hackathons, and other groups in your area are great places to get started.  If you’re interested in switching your career  to Big Data, check out Jessen Anderson’s new e-book, The Ultimate Guide to Switching Careers to Big Data -- Upgrading Your Skills for the Big Data Revolution.  Your Turn: Route to the Role of Data Engineer Our data driven world moves at lightning speed and it can be hard to keep up. If you’re a Data Engineer, we want to hear your story.  What was your route to the role? What kind of cross-training programs might businesses and schools employ for future Data Engineers?    What other backgrounds are we overlooking as businesses seek to find and engage this most critical role within their data science teams?    What can we, as recruiters do to engage qualified candidates ready for their next role in the world of data and analytics?