Daurum: Introduction
•
2 likes•602 views
This document discusses deduplication and data fusion software. It introduces the benefits of identifying duplicated records across databases and merging data from different sources. The process section outlines how the software allows configuring input formats, similarity computations, filters, and validation steps. Successful stories provide examples of how a health service and beer manufacturer used the software to clean databases and identify incorrect deliveries. A demo is available to see the software in action.
![Index ,[object Object]](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)
Recommended
Recommended
More Related Content
Similar to Daurum: Introduction
Similar to Daurum: Introduction (20)
Recently uploaded
Recently uploaded (20)
Daurum: Introduction
- 1. Deduplication & Fusion info@sparsity-technologies.com
- 3. Process
- 6. Process
- 10. Introduction Deduplication Configuration Automatic execution Validation of results Personalized export
- 11. IntroductionDeduplication Configuration Automatic execution Validation of results Personalized export
- 13. IntroductionFusion Configuration Automatic execution Validation of results Personalized export
- 14. IntroductionFusion Configuration Automatic execution Validation of results Personalized export
- 17. Process
- 20. Select relevant columns to link registers
- 21. Relation between columns from different data sources (only when merging)
- 22. Assign types to columns to help using the most adequate automatic filtersCSV Configurations Execution Validation Exportation Excel PDF XML CSV
- 24. Percentage of the importance of each column for the similarity computationCSV Configurations Execution Validation Exportation 30% 35% 35% 100% = Excel PDF XML CSV
- 26. Use filters to make values standard
- 27. Available automatic and specific filters for values such as name, dates, address, etc…CSV Configurations Execution Validation Exportation Excel PDF XML CSV
- 29. Use of dictionaries: name-converter dictionary (I.e.: Pepe Jose)
- 30. Similarity computation algorithm configuration:
- 31. Size for the sliding window: number of registers compared at the same time
- 32. Order by column
- 33. Threshold of accepted similarityCSV Configurations Execution Validation Exportation Excel PDF XML CSV
- 35. Sliding window = 2CSV Configurations Execution Window = 2 Validation Exportation Excel PDF XML CSV
- 41. Visualize by similarity/by group
- 43. Share validation between several supervisorsCSV Configurations Execution Validation Exportation Excel PDF XML CSV
- 46. Process
- 49. Successful storiesBeer Manufacturer Who? Beer manufacturer Objective Detect dealers that deliver to not previously assigned centers Solution Identify duplicates in each dealer’s delivery database and delete them Deduplication with DAURUM Detect deliveries to centers shared between different dealers Fusion with DAURUM Result Master database clean of repetitions and detection of dealers with wrong deliveries
- 51. Process
- 54. Thanks for your attention Any questions? Pere Baleta Ferrer CEO pbaleta@sparsity-technologies.com Josep Lluís Larriba Pey Founder larri@sparsity-technologies.com SPARSITY-TECHNOLOGIES Jordi Girona, 1-3, Edifici K2M 08034 Barcelona info@sparsity-technologies.com http://www.sparsity-technologies.com