Data processing

TheWebMiner offers data processing services for large data files with tens or hundreds of millions of records. Contact us if any of the following use cases fit any problem you have.

Conversions

We’ve converted between numerous types of files including excel spreadsheets, CSV, XML, JSON, HTML, TXT. We’ve also performed transformations of websites or any of the above mentioned formats to PDF.

Replacement

We’ve also handled complex data replacement based on customer requirements on large files.

Filtering

We’ve performed data cleaning by filtering out broken or non standard records.

Split/Join

We’ve split large files into a number of smaller size volumes, either in the same format or a different one as well as joined a number of smaller files into a larger one or fewer larger volumes.