I am describing the process of building a data mining scoring engine.

1. Data Mining
Development Process
Dylan Wan
dylanwan.wordpress.com

2. Scoring Engine
• Data Mining Scoring Engine is a system
– Accept inputs
– Produce outputs
– Working under an env
– Internally, it has sub-system and components
• It is not that different from building a software
package (system)
• System development lifecycle is similar

3. Data Mining Process
• Requirement Analysis & Design phase
– Define the Business Questions
– Identify the source data that can answer the questions
– Identify the mining functions and mining algorithms
that may be used
• Scoring Engine Building phase
– Gather the training set
– Prepare the data (Dedup, Cleansing, Reduction, etc)
– Implement the logic in Data Mining tool
– Deploy the scoring engine in the user env

4. Data Mining System
Rule Evaluation
Model selection
Historical Data
House Features and
House Prices
Model
Regression ,
Decision Tree, etc.
Scoring EngineNew Data
House Features
Score
House Price
Data Mining Process