Agnes's SSIS Project Documentation

Prepared By: Agnes TetterSETFOCUS, LLC07/31/2009SSIS Student ProjectALLWORKS Database Documentation I. INTRODUCTION – Project Mission ALLWORKS is a fictitious construction company. In this project we design and build an SQL Server 2005 Database to track employee and customer information, timesheet and labor rates data, as well as a job order information, job materials, and customer invoices. ALLWORKS stored its information in Excel Spreadsheets, XML, and CSV files. In this project we will make some improvements to the existing data sources in order to support more flexible business practice for customer invoicing, use SQL 2005 Integration Services to integrate these external data sources into SQL Server Database. II. LIST OF ALL PACKAGES PACKAGE 3A: EmployeeMasterPackage.dtsx This package will read the contents of the Employee.xls (under employee’s sheet) that is located from C:SetFocusBISourceData and add them to the AllWorksDBStudent database (Employee Table). Employee sheet contains roaster of employees and flag for whether the employee is a contractor or a regular. Source File: C:SetFocusBISourceDataEmployees.XLS, Sheet: Employees Target Table: dbo.Employees Assumption: Insert: Loading a NULL value in EmployeePK(Employee ID) field is prohibited in Employee Table. Update: The Employee table can only be updated if the Employee ID in Employee Spreadsheet is equal to the EmployeeID (EmployeePK in the Employee Table) and other data are not equal Notification: These include two sets of information and this email sent to biproject@setfocus.com. The email server for SMTP connection is Sfexch0003.setfocus.com ,[object Object]

The following row counts:Total numbers of rows in the source file (Employee Spreadsheet) Total number of new rows inserted to the Employee Table Total number of existing rows updated from the Employee Table ,[object Object],The name of the package that processing fails. PACKAGE 3b: EmployeeRatePackage.dtsx This package will read the contents of the Employee.xls (under employee rate sheet) that is located from C:SetFocusBISourceData and add them to the AllWorksDBStudent database (Employee Rates Table). Employee Rate Sheet includes Employee Hourly Rates for each employee and the rate effective date. Source File: C:SetFocusBISourceDataEmployees.XLS, Sheet: Employees Rates Target Table: dbo.EmployeeRates Assumption: Insert: You can only insert new rows to the Employee Rate Table if the following conditions are TRUE: ,[object Object]

EmployeePK (Employee ID) and EffectiveDate(rate effective date) is not Null,

If both EmployeePK (Employee ID) and EffectiveDate(rate effective date) don’t exist in the Employee Rate Table.Update: The Employee Rate table can only be updated if the TransformedEmployeePK(Employee ID in Employee.XLS) is equal to the TargetEmployeePK (EmployeePK in the Employee Table). Notification: These include two sets of information and this email is sent to biproject@setfocus.com. The email server for SMTP connection is Sfexch0003.setfocus.com ,[object Object]

The following row counts:Total number of new rows inserted to the Employee Rate Table Total number of existing rows updated in the Employee Rate Table Total number of invalid rows (those employee that don’t exist in the Employee Table) Failure email notification will include: The name of the package that processing fails. Error Handling: One file is created for all Employees from the Employee Rate Spreadsheet that don’t exist in the Employee Table. This file is save in the C:SetFocusBIProjectsStudentVersionSSISStudentProjectLog File Name: MissingEmployee_EmployeeRatePackage.csv PACKAGE 3c: ClientMasterPackage.dtsx This package will read the contents of the ClientGeographies.xls (under client listing sheet) that is located from C:SetFocusBISourceData and add them to the AllWorksDBStudent database (Clients Table). Client Listing Sheet includes client for AllWorks, along with a CountyKey to associate the client with a county. The information that needed from the Client Listing spreadsheet are the Client No (ClientPK), Account No, Client Name, Project Manager, County Key (CountyPK), Client Image. This package also loads the data from County Definition Sheet to County Table. Source File: C:SetFocusBISourceData ClientGeographies.xls, Sheet: Client Listing and County Definition Target Table: dbo.Clients and dbo.County Assumption: Insert: You can only insert new rows to the Clients Table if the following conditions are TRUE: ,[object Object]

It will not also be inserted if the County Key (CountyPK) does not exist in the County Table. The package will add the county that doesn’t exist in the County first in the County Table.Update: The Client table can only be updated if the Client No (ClientPK) from the Client Listing Spreadsheet is equal to the ClientPK (ClientNo) and if it exist in the Clients Table and the other information that need to be inserted are not equal. Notification: These include two sets of information and this email is sent to biproject@setfocus.com. The email server for SMTP connection is Sfexch0003.setfocus.com ,[object Object]

Total number of rows read from the source file (Client Listing Spreadsheet)Total number of new rows inserted to the Client Table Total number of existing rows updated to the Client Table Total number of invalid rows (those county that don’t exist in the County Table) Failure email notification will include: The name of the package that processing fails. Error Handling: One file is created for all Counties from the Client Listing Spreadsheet that don’t exist in the County Table. This file is save in the C:SetFocusBIProjectsStudentVersionSSISStudentProjectLog File Name: MissingCounty_ClientPackage.csv PACKAGE 3d: ClientGroupingPackage.dtsx This package will read the contents of the Clientgeographies.xls (under special grouping sheet) that is located from C:SetFocusBISourceData and add them to the AllWorksDBStudent database (Client Grouping Table). Special Grouping Sheet includes Grouping# (ClientGroupingPK), GroupingName, and Account Key. In this package we only need the first two data. In this package we use aggregrate data flow task to group the repeating grouping# and GroupingName. Source File: C:SetFocusBISourceData Clientgeographies.xls, Sheet: Special Grouping Target Table: dbo.ClientGroupings Assumption: Insert: You can only insert new rows to the Client Grouping Table if the following conditions are TRUE: ,[object Object]

ClientGroupingPK (Grouping#) from the Special Grouping Sheet is not nullUpdate: The Client Grouping Table can only be updated if the Grouping#(ClientGroupingPK) from the Special Grouping sheet is equal to the ClientGroupingPK in the Client Grouping Table and the GroupingName is different. Notification: These include two sets of information and this email is sent to biproject@setfocus.com. The email server for SMTP connection is Sfexch0003.setfocus.com ,[object Object]

Total number of rows read from the Special Grouping SpreadsheetTotal number of new rows inserted to the Client Grouping Table Total number of existing rows updated to the Client Grouping Table Failure email notification will include: The name of the package that processing fails. PACKAGE 3e: DivisionMasterPackage.dtsx This package will read the contents of the Clientgeographies.xls (under Division Definition sheet) that is located from C:SetFocusBISourceData and add them to the AllWorksDBStudent database (Division Table). Division Definition Sheet includes Division (DivisionPK), Description (DivisionName), and Account Key. In this package we only need the first two data. In this package we use aggregrate data flow task to group the repeating Division and Description. Source File: C:SetFocusBISourceData Clientgeographies.xls, Sheet: Division Definition Target Table: dbo.Division Assumption: Insert: You can only insert new rows to the Division Table if the following conditions are TRUE: ,[object Object]

DivisionPK (Division) from the Divison Definition Sheet is not nullUpdate: The Division Table can only be updated if the Division ( DivisionPK) from the Division Definition sheet is equal to the DivisionPK in the Client Grouping Table and the Description(DivisionName) is different. Notification: These include two sets of information and this email is sent to biproject@setfocus.com. The email server for SMTP connection is Sfexch0003.setfocus.com ,[object Object]

Total number of rows read from the Division Definition SpreadsheetTotal number of new rows inserted to the Division Table Total number of existing rows updated to the Division Table Failure email notification will include: The name of the package that processing fails. PACKAGE 3f: ClientGroupingXrefPackage.dtsx This package will read the contents of the Clientgeographies.xls (under Special Grouping sheet) that is located from C:SetFocusBISourceData and add them to the AllWorksDBStudent database (ClientGroupingXClients Table). Special Grouping Sheet includes Grouping# (ClientGroupingPK), GroupingName, and Account Key. In this package we use three lookups one for the Client, ClientGrouping, and ClientGroupingXClients Tables. The first ttwo lookups will validate that each ClientNo(ClientPK) and Grouping#(ClientGroupingPK) exist in Client Table and ClientGroupings Table respectively before it will be inserted in the ClientGroupingXClients. Source File: C:SetFocusBISourceData Clientgeographies.xls, Sheet: Special Grouping Target Table: dbo.ClientGroupingsXClients Assumption: Insert: You can only insert new rows to the ClientGroupingsXClients Table if the following conditions are TRUE: ,[object Object],Notification: These include two sets of information and this email is sent to biproject@setfocus.com. The email server for SMTP connection is Sfexch0003.setfocus.com ,[object Object]

Total number of rows read from the Special Grouping SpreadsheetTotal number of new rows inserted to the ClientGroupingsXCLients Failure email notification will include: The name of the package that processing fails. PACKAGE 3g: ProjectJobMasterPackage.dtsx This package will read the contents of the ProjectMaster.xls (under Project Master sheet) that is located from C:SetFocusBISourceData and add them to the AllWorksDBStudent database (JobMaster Table). All the columns from Project Master Sheet will be loaded to the JobMaster Table. Source File: C:SetFocusBISourceData ProjectMaster.xls, Sheet: Project Master Target Table: dbo.JobMaster Assumption: Insert: You can only insert new rows to the JobMaster Table if the JobMasterPK (ProjectID) from ProjectMaster.xls is not null. Update: The JobMaster Table can only be updated if the Project ID (JobMasterPK) from the ProjectMaster sheet is equal to the JobMasterPK in the JobMaster Table and other rows are not equal. Error Handling: One file is created for all Clients from the Project Master Spreadsheet that don’t exist in the Clients Table. This file is save in the C:SetFocusBIProjectsStudentVersionSSISStudentProjectLog File Name: MissingClient_ProjectJobMasterPackage.csv Notification: These include two sets of information and this email is sent to biproject@setfocus.com. The email server for SMTP connection is Sfexch0003.setfocus.com ,[object Object],The following row counts: Total number of new rows inserted to the JobMaster Table Total number of existing rows updated to the JobMasterTable Total number of invalid rows (those client that don’t exist in the Client Table) Failure email notification will include: The name of the package that processing fails. PACKAGE 3h: JobTimeSheetPackage.dtsx This package used a ForEachLoop Container to read EmpTime####.csv files that were stored at C:SetFocusBISourceData ime and add them to the AllWorksDBStudent database (JobTimeSheets Table). This package also used Script Task to count the total rows that being processed from each file. Source Folder: C:SetFocusBISourceData ime FileNames: EmpTime500.csv, EmpTime1000.csv, EmpTime2000.csv, EmpTime3000.csv, EmpTime4000.csv Target Table: dbo.JobTimeSheet Assumption: Insert: You can only insert new rows to the JobTimeSheets Table if the following conditions are TRUE: ,[object Object]

JobMasterPK exist in JobMaster Table and EmployeePK exist in Employee TableUpdate: The JobTimeSheets Table can only be updated if the JobMasterPK (Job Number), EmployeePK(Employee ID), and WorkDate(Date) from Emptime####.csv is equal to the JobMasterPK, EmployeePK and WorkDate in the JobTimeSheets Table and other rows are not equal. Error Handling: Three file s are created: ,[object Object]

Agnes's SSIS Project Documentation

Recommandé

Recommandé

Contenu connexe

Tendances

Tendances (20)

En vedette

En vedette (18)

Similaire à Agnes's SSIS Project Documentation

Similaire à Agnes's SSIS Project Documentation (20)

Dernier

Dernier (20)

Agnes's SSIS Project Documentation