Predictit can help you reduce dataset into a smaller one that contains much of the important information and easier to work with

 

Challenges:

Difficult to work with multiple data source and lack of integration for biusiness insights

Disparate data source

Data processing performance issues

What data do we really need 

...