36 percent of investment professionals use web scraping to derive data.

2019

• 59 percent of executives say big data at their company would be improved through artificial intelligence (AI).
• By 2025, IDC predicts that the total amount of digital data created worldwide will rise to 163 zettabytes, ballooned by the growing number of devices and sensors
• The big data software market was worth $31 billion in 2018, growing 14 percent from the year before.
• In a survey of approximately 700 business professionals, only 15% said their organization is currently very effective in delivering a relevant and reliable customer experience. In the same survey, only 3% of respondents said they are able to act on all of the customer data they collect; 21% say they can act on very little of it.
• By 2025, more than a quarter of all data created will be real-time, with 95% of that data generated by the Internet of Things.
• 60 percent of businesses believe it is harder to source talent for data and analytics positions than for any other roles
• 45 percent of companies run at least some big data workloads in the cloud.
• 8 percent of businesses say data and analytics have fundamentally changed the nature of industry-wide competition
• 70 percent of investment professionals use “alternative data” or plan to do so in the next year.
• 53 percent of companies are adopting big data analytics