What is Big Data?
Technology is ingrained in every aspect of our lives. We use computers and smartphones for work and study, online banking, shopping, entertainment, social media and to stay in touch with family and friends. The cars we drive and healthcare/fitness devices we wear record valuable information about our driving habits and health. Recent research has shown that over sixty four percent of the population in Ireland use a fitness tracker to monitor their health.
Ireland is among the top three countries in the world with the most internet users. Billions of emails are sent every day worldwide and half of all internet traffic is generated by video, particularly social media. As a result of all this activity, the amount of data we are generating is growing exponentially. This is known as Big Data. Big Data gives accurate real time information. This data is very valuable information that can be collected, analysed, and monetised. Access to high quality data has a powerful impact on industry, individuals and society enabling faster, more efficient, and informed decision making.
What is happening with all this data?
The colossal amounts of data we generate are stored, processed, and maintained in the cloud in data centres. Ireland has over eighty data centres, the vast majority in the Dublin region, with more under construction. It is a dynamic and fast-growing sector involving companies such as Amazon, Apple, Google, Microsoft, Equinix, Digital Reality and Viatel Technology.
Established in 2013, Insight is Science Foundation Ireland’s Research Centre for Data Analytics. It is one of the largest data analytics centres in Europe with 450 researchers based across eight institutions. It has a key role in training the next generation of data scientists in analytics technologies. Their research seeks to use big data and AI to improve our world in areas such as human computer interaction, climate, digital health, and smart cities.
An example of just one sector where data analytics is driving a radical transformation is the rapidly expanding €650 a year world sportstech industry. Big data not only enables us to evaluate new sports technology, inform business decisions and shape fan experiences, but it also creates competitive advantage by analysing athletes’ performances and optimising training strategies.
Data on health collected by fitness trackers and medical devices can be used for early detection and to predict likelihood of serious diseases in populations, thus informing public health policy. However, as with all data, the issue of governance, privacy and security is now very much a topic for discussion.
The staggering amount of data already being generated is forecast to increase rapidly. The integration of Artificial Intelligence (AI) and Machine Learning (ML) in Big Data will enable even more powerful tools to harness a company’s data. All sectors of the economy require skilled data analysts to manage their data. Big Data analysis will give valuable insights that will transform and improve many areas of our lives and the world we live in.
Further information on key skills required to work in Data Analytics is available below.
15 Key Data Analyst Skills You Need to Get Hired
Most positions required a third level qualification, usually in computer science, software engineering, maths or a related discipline. However, there are multiple pathways to join the IT sector where there are skills shortages. These options include:
- FIT Tech Apprenticeships where you learn and earn, are open to school leavers or those who wish to upskill or retrain. Further information available here.
- ICT Skillnet offers free and subsidised training, part-time & online, in critical technology skills. Further information available here.
- Springboard Courses offer free and heavily subsidised courses, including ICT skills conversion courses, to address skills shortages. Further information is available here.
- Further information on careers in Data Centres is available here
- Further information on careers in Cybersecurity is available here
Employment in ICT has increased by a third in Ireland to a new high of 174,000. Any of the routes described above will give you the opportunity to work in this dynamic, thriving sector which offers excellent opportunities for career advancement.