Big data refers to data sets so large, fast-changing or varied that traditional tools such as a single spreadsheet or ordinary database cannot store or process them efficiently. Sources include social media posts, mobile phone records, online transactions, sensors, satellites and scientific instruments. A single telecom operator, for example, records millions of calls, messages and data sessions every day.
Key terms
- Big data
- data too large or complex for traditional tools
- Volume
- the amount of data
- Velocity
- the speed of data creation and processing
- Variety
- the different types and formats of data
- Veracity
- the trustworthiness of data
- Data analytics
- examining data to find patterns and insights
- Distributed processing
- spreading work across many computers
Summary
- Big data is too large/fast/varied for traditional tools.
- Key Vs: volume, velocity, variety, veracity, value.
- Distributed systems and analytics turn data into insight.
- Privacy, security and bias are major concerns.
In everyday life: The Ethiopian Meteorological Institute and agricultural researchers can combine satellite, rainfall and soil data to warn farmers about drought and plan planting.
Check yourself
- Explain the 3 main Vs of big data.
- Give two uses of big data in Ethiopia.
- What is the difference between descriptive and predictive analytics?
Practice questions
1. Which 'V' of big data refers to the speed at which data is generated and processed?
- A. Volume
- B. Variety
- C. Velocity
- D. Veracity
Show answer
Answer: Velocity
Velocity is about speed, such as millions of transactions per second that may need real-time processing.
2. True or false: Images, videos and free-text social-media posts are examples of unstructured data.
Show answer
Answer: True
They do not fit neatly into rows and columns of a table, so they are classed as unstructured data.
On WeLearn
The full lesson: reading notes, worked examples, class activities and the Unit 2 quiz
Study Introduction to Big Data on WeLearnTeach Introduction to Big Data with WeLearn
We will bring a demo to your school: a lesson on your interactive TV, a virtual lab and a classroom game, with your own teachers.
