Tools and processes
dHive is our internal proprietary tool platform, which is based on a typical ETL process (Extract, Transform and Load):
- Extract: We extract data from different external sources, structured and/or unstructured. By using mapping rules the data will be converted into a dHive database, usually with the same structure as the source. In some cases we want only the data that is new or has been changed. In this case the data conversion will only process the changes.
- Transform: Once the data is available in dHive, it is all on one platform and one database. So we can easily join tables, filter and sort the data using specific attributes, pivot to another structure and make business calculations. In this step, we check the data quality and clean the data if necessary. Data validation test cases are automatically executed and analysis reports are generated to discover the changes over time.
- Load: Finally the data is transformed to the final binary product format: NDS.