BODS Designer 4.0

1. Designer Guide
■ SAP BusinessObjects Data Services 4.0 (14.0.1)
2011-06-09

2. Copyright
© 2011 SAP AG. All rights reserved.SAP, R/3, SAP NetWeaver, Duet, PartnerEdge, ByDesign, SAP
BusinessObjects Explorer, StreamWork, and other SAP products and services mentioned herein as
well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and
other countries.Business Objects and the Business Objects logo, BusinessObjects, Crystal Reports,
Crystal Decisions, Web Intelligence, Xcelsius, and other Business Objects products and services
mentioned herein as well as their respective logos are trademarks or registered trademarks of Business
Objects Software Ltd. Business Objects is an SAP company.Sybase and Adaptive Server, iAnywhere,
Sybase 365, SQL Anywhere, and other Sybase products and services mentioned herein as well as
their respective logos are trademarks or registered trademarks of Sybase, Inc. Sybase is an SAP
company. All other product and service names mentioned are the trademarks of their respective
companies. Data contained in this document serves informational purposes only. National product
specifications may vary.These materials are subject to change without notice. These materials are
provided by SAP AG and its affiliated companies ("SAP Group") for informational purposes only,
without representation or warranty of any kind, and SAP Group shall not be liable for errors or
omissions with respect to the materials. The only warranties for SAP Group products and services
are those that are set forth in the express warranty statements accompanying such products and
services, if any. Nothing herein should be construed as constituting an additional warranty.
2011-06-09

3. Contents
Chapter 1
1.1
1.1.1
1.1.2
1.1.3
1.1.4
1.2
1.2.1
1.2.2
Welcome to SAP BusinessObjects Data Services.................................................................19
Chapter 2
Logging into the Designer.....................................................................................................27
2.1
2.2
Version restrictions................................................................................................................27
Chapter 3
Designer User Interface........................................................................................................29
3.1
3.1.1
3.1.2
3.1.3
3.2
3.3
3.3.1
3.3.2
3.3.3
3.3.4
3.3.5
3.3.6
3.3.7
3.3.8
3.3.9
3.4
3.5
3
Introduction...........................................................................................................................19
Objects..................................................................................................................................29
Welcome...............................................................................................................................19
Documentation set for SAP BusinessObjects Data Services.................................................19
Accessing documentation......................................................................................................22
SAP BusinessObjects information resources.........................................................................23
Overview of this guide............................................................................................................24
About this guide.....................................................................................................................25
Who should read this guide....................................................................................................25
Resetting users......................................................................................................................28
Reusable objects...................................................................................................................29
Single-use objects..................................................................................................................30
Object hierarchy.....................................................................................................................30
Designer window...................................................................................................................31
Menu bar...............................................................................................................................32
Project menu..........................................................................................................................33
Edit menu...............................................................................................................................33
View menu.............................................................................................................................34
Tools menu............................................................................................................................34
Debug menu..........................................................................................................................36
Validation menu.....................................................................................................................36
Dictionary menu.....................................................................................................................37
Window menu........................................................................................................................38
Help menu..............................................................................................................................38
Toolbar...................................................................................................................................39
Project area ..........................................................................................................................41
2011-06-09

4. Contents
3.6
3.7
3.8
3.8.1
3.8.2
3.8.3
3.8.4
3.8.5
3.8.6
3.8.7
3.9
3.9.1
3.9.2
3.9.3
3.10
3.11
3.11.1
3.11.2
3.11.3
3.11.4
3.11.5
3.11.6
3.11.7
3.11.8
3.12
3.12.1
3.12.2
3.12.3
3.12.4
3.12.5
3.12.6
3.12.7
Chapter 4
Projects and Jobs.................................................................................................................67
4.1
4.1.1
4.1.2
4.1.3
4.1.4
4.2
4.2.1
4
Tool palette............................................................................................................................42
Projects.................................................................................................................................67
Designer keyboard accessibility.............................................................................................43
Workspace............................................................................................................................44
Moving objects in the workspace area...................................................................................44
Connecting objects................................................................................................................45
Disconnecting objects............................................................................................................45
Describing objects ................................................................................................................45
Scaling the workspace...........................................................................................................46
Arranging workspace windows...............................................................................................46
Closing workspace windows..................................................................................................46
Local object library.................................................................................................................47
To open the object library.......................................................................................................47
To display the name of each tab as well as its icon.................................................................48
To sort columns in the object library.......................................................................................48
Object editors........................................................................................................................49
Working with objects..............................................................................................................49
Creating new reusable objects...............................................................................................50
Changing object names..........................................................................................................51
Viewing and changing object properties.................................................................................52
Creating descriptions.............................................................................................................53
Creating annotations .............................................................................................................55
Copying objects.....................................................................................................................56
Saving and deleting objects....................................................................................................57
Searching for objects.............................................................................................................59
General and environment options...........................................................................................61
Designer — Environment.......................................................................................................61
Designer — General..............................................................................................................62
Designer — Graphics.............................................................................................................64
Designer — Central Repository Connections.........................................................................65
Data — General.....................................................................................................................65
Job Server — Environment....................................................................................................66
Job Server — General...........................................................................................................66
Objects that make up a project..............................................................................................67
Creating a new project...........................................................................................................68
Opening existing projects.......................................................................................................68
Saving projects......................................................................................................................69
Jobs.......................................................................................................................................69
Creating jobs.........................................................................................................................70
2011-06-09

5. Contents
4.2.2
Chapter 5
Datastores.............................................................................................................................73
5.1
5.2
5.2.1
5.2.2
5.2.3
5.2.4
5.2.5
5.2.6
5.2.7
5.2.8
5.2.9
5.3
5.3.1
5.3.2
5.3.3
5.4
5.4.1
5.4.2
5.4.3
5.5
5.5.1
5.5.2
5.5.3
5.5.4
5.5.5
5.5.6
5.5.7
5.5.8
5.5.9
What are datastores?.............................................................................................................73
Chapter 6
File formats.........................................................................................................................123
6.1
6.2
6.3
6.3.1
6.3.2
6.3.3
5
Naming conventions for objects in jobs..................................................................................71
Understanding file formats...................................................................................................123
Database datastores..............................................................................................................74
Mainframe interface...............................................................................................................74
Defining a database datastore................................................................................................77
Configuring ODBC data sources on UNIX..............................................................................80
Changing a datastore definition..............................................................................................80
Browsing metadata through a database datastore..................................................................81
Importing metadata through a database datastore..................................................................84
Memory datastores................................................................................................................90
Persistent cache datastores...................................................................................................94
Linked datastores...................................................................................................................97
Adapter datastores................................................................................................................99
Defining an adapter datastore..............................................................................................100
Browsing metadata through an adapter datastore................................................................102
Importing metadata through an adapter datastore................................................................102
Web service datastores.......................................................................................................103
Defining a web service datastore.........................................................................................103
Browsing WSDL metadata through a web service datastore................................................104
Importing metadata through a web service datastore...........................................................106
Creating and managing multiple datastore configurations.....................................................106
Definitions............................................................................................................................107
Why use multiple datastore configurations?.........................................................................108
Creating a new configuration................................................................................................108
Adding a datastore alias.......................................................................................................110
Functions to identify the configuration..................................................................................110
Portability solutions..............................................................................................................112
Job portability tips................................................................................................................116
Renaming table and function owner......................................................................................117
Defining a system configuration...........................................................................................121
File format editor..................................................................................................................124
Creating file formats.............................................................................................................126
To create a new file format...................................................................................................126
Modeling a file format on a sample file.................................................................................127
Replicating and renaming file formats...................................................................................128
2011-06-09

6. Contents
6.3.4
6.3.5
6.4
6.4.1
6.4.2
6.4.3
6.5
6.5.1
6.5.2
6.5.3
6.5.4
6.5.5
6.5.6
6.5.7
6.6
6.6.1
6.6.2
6.6.3
6.6.4
6.7
6.7.1
6.7.2
6.7.3
6.7.4
6.8
6.8.1
6.9
6.9.1
6.9.2
6.9.3
6.10
Chapter 7
Data Flows..........................................................................................................................151
7.1
7.1.1
7.1.2
7.1.3
7.1.4
7.1.5
7.1.6
7.1.7
6
To create a file format from an existing flat table schema.....................................................129
What is a data flow?.............................................................................................................151
To create a specific source or target file...............................................................................129
Editing file formats................................................................................................................130
To edit a file format template................................................................................................130
To edit a source or target file...............................................................................................131
Change multiple column properties......................................................................................131
File format features..............................................................................................................132
Reading multiple files at one time.........................................................................................132
Identifying source file names ...............................................................................................133
Number formats...................................................................................................................133
Ignoring rows with specified markers....................................................................................134
Date formats at the field level...............................................................................................135
Parallel process threads.......................................................................................................135
Error handling for flat-file sources.........................................................................................136
File transfers........................................................................................................................139
Custom transfer system variables for flat files......................................................................139
Custom transfer options for flat files....................................................................................140
Setting custom transfer options...........................................................................................141
Design tips...........................................................................................................................142
Creating COBOL copybook file formats...............................................................................143
To create a new COBOL copybook file format.....................................................................144
To create a new COBOL copybook file format and a data file..............................................144
To create rules to identify which records represent which schemas.....................................145
To identify the field that contains the length of the schema's record.....................................146
Creating Microsoft Excel workbook file formats on UNIX platforms .....................................146
To create a Microsoft Excel workbook file format on UNIX ..................................................147
Creating Web log file formats...............................................................................................147
Word_ext function................................................................................................................148
Concat_date_time function...................................................................................................149
WL_GetKeyValue function...................................................................................................149
Unstructured file formats......................................................................................................149
Naming data flows................................................................................................................151
Data flow example................................................................................................................151
Steps in a data flow..............................................................................................................152
Data flows as steps in work flows........................................................................................152
Intermediate data sets in a data flow....................................................................................153
Operation codes..................................................................................................................153
Passing parameters to data flows.........................................................................................154
2011-06-09

7. Contents
7.2
7.2.1
7.2.2
7.2.3
7.3
7.3.1
7.3.2
7.3.3
7.3.4
7.3.5
7.4
7.4.1
7.4.2
7.5
7.5.1
7.5.2
7.5.3
7.6
7.6.1
7.6.2
7.6.3
7.6.4
7.7
Chapter 8
Transforms..........................................................................................................................175
8.1
8.2
8.3
8.3.1
8.3.2
8.4
8.4.1
8.4.2
8.5
8.5.1
8.5.2
8.6
8.6.1
8.6.2
8.6.3
8.6.4
7
Creating and defining data flows..........................................................................................155
To add a transform to a data flow.........................................................................................177
To define a new data flow using the object library.................................................................155
To define a new data flow using the tool palette...................................................................155
To change properties of a data flow.....................................................................................155
Source and target objects....................................................................................................156
Source objects.....................................................................................................................157
Target objects......................................................................................................................157
Adding source or target objects to data flows......................................................................158
Template tables....................................................................................................................160
Converting template tables to regular tables........................................................................161
Adding columns within a data flow .......................................................................................162
To add columns within a data flow........................................................................................163
Propagating columns in a data flow containing a Merge transform........................................163
Lookup tables and the lookup_ext function...........................................................................164
Accessing the lookup_ext editor..........................................................................................165
Example: Defining a simple lookup_ext function....................................................................166
Example: Defining a complex lookup_ext function ................................................................169
Data flow execution.............................................................................................................171
Push down operations to the database server......................................................................171
Distributed data flow execution............................................................................................172
Load balancing.....................................................................................................................173
Caches................................................................................................................................173
Audit Data Flow overview.....................................................................................................174
Transform editors.................................................................................................................178
Transform configurations......................................................................................................179
To create a transform configuration......................................................................................179
To add a user-defined field ..................................................................................................180
The Query transform ...........................................................................................................181
To add a Query transform to a data flow..............................................................................181
Query Editor.........................................................................................................................182
Data Quality transforms ......................................................................................................184
To add a Data Quality transform to a data flow.....................................................................184
Data Quality transform editors.............................................................................................186
Text Data Processing transforms.........................................................................................189
Text Data Processing overview............................................................................................189
Entity Extraction transform overview.....................................................................................190
Using the Entity Extraction transform....................................................................................193
Differences between text data processing and data cleanse transforms...............................194
2011-06-09

8. Contents
8.6.5
8.6.6
8.6.7
8.6.8
8.6.9
Chapter 9
Work Flows.........................................................................................................................201
9.1
9.2
9.3
9.4
9.5
9.5.1
9.5.2
9.5.3
9.6
9.6.1
9.7
9.7.1
9.7.2
9.7.3
9.8
9.8.1
9.8.2
9.8.3
9.9
9.9.1
9.9.2
What is a work flow?............................................................................................................201
Chapter 10
Nested Data........................................................................................................................217
10.1
10.2
10.3
10.3.1
10.3.2
10.3.3
10.3.4
10.3.5
10.4
10.4.1
8
Using multiple transforms.....................................................................................................195
What is nested data?...........................................................................................................217
Examples for using the Entity Extraction transform...............................................................195
To add a text data processing transform to a data flow........................................................196
Entity Extraction transform editor.........................................................................................198
Using filtering options..........................................................................................................199
Steps in a work flow.............................................................................................................202
Order of execution in work flows..........................................................................................202
Example of a work flow........................................................................................................203
Creating work flows.............................................................................................................204
To create a new work flow using the object library...............................................................204
To create a new work flow using the tool palette .................................................................204
To specify that a job executes the work flow one time.........................................................204
Conditionals.........................................................................................................................205
To define a conditional.........................................................................................................206
While loops..........................................................................................................................207
Design considerations..........................................................................................................207
Defining a while loop............................................................................................................209
Using a while loop with View Data........................................................................................210
Try/catch blocks..................................................................................................................210
Defining a try/catch block....................................................................................................211
Categories of available exceptions.......................................................................................212
Example: Catching details of an error...................................................................................213
Scripts.................................................................................................................................214
To create a script.................................................................................................................214
Debugging scripts using the print function............................................................................215
Representing hierarchical data.............................................................................................217
Formatting XML documents.................................................................................................220
Importing XML Schemas......................................................................................................220
Specifying source options for XML files ..............................................................................225
Mapping optional schemas...................................................................................................226
Using Document Type Definitions (DTDs) ...........................................................................228
Generating DTDs and XML Schemas from an NRDM schema.............................................230
Operations on nested data...................................................................................................230
Overview of nested data and the Query transform...............................................................231
2011-06-09

9. Contents
10.4.2
10.4.3
10.4.4
10.4.5
10.4.6
10.4.7
10.4.8
10.5
10.5.1
Chapter 11
Real-time Jobs....................................................................................................................249
11.1
11.2
11.2.1
11.2.2
11.2.3
11.3
11.3.1
11.3.2
11.3.3
11.4
11.4.1
11.4.2
11.4.3
11.4.4
11.5
11.5.1
11.5.2
11.5.3
11.6
11.6.1
11.6.2
11.6.3
11.7
11.7.1
11.7.2
11.7.3
Request-response message processing...............................................................................249
Chapter 12
Embedded Data Flows........................................................................................................269
12.1
9
FROM clause construction...................................................................................................231
Overview of embedded data flows.......................................................................................269
Nesting columns .................................................................................................................234
Using correlated columns in nested data..............................................................................236
Distinct rows and nested data..............................................................................................237
Grouping values across nested schemas.............................................................................237
Unnesting nested data ........................................................................................................238
Transforming lower levels of nested data.............................................................................241
XML extraction and parsing for columns...............................................................................241
Sample scenarios.................................................................................................................242
What is a real-time job?........................................................................................................250
Real-time versus batch.........................................................................................................250
Messages............................................................................................................................251
Real-time job examples........................................................................................................252
Creating real-time jobs.........................................................................................................254
Real-time job models............................................................................................................254
Using real-time job models...................................................................................................255
To create a real-time job with a single dataflow....................................................................257
Real-time source and target objects.....................................................................................258
To view an XML message source or target schema.............................................................259
Secondary sources and targets............................................................................................259
Transactional loading of tables.............................................................................................259
Design tips for data flows in real-time jobs...........................................................................260
Testing real-time jobs...........................................................................................................261
Executing a real-time job in test mode..................................................................................261
Using View Data..................................................................................................................261
Using an XML file target.......................................................................................................262
Building blocks for real-time jobs..........................................................................................263
Supplementing message data..............................................................................................263
Branching data flow based on a data cache value.................................................................265
Calling application functions.................................................................................................266
Designing real-time applications...........................................................................................267
Reducing queries requiring back-office application access....................................................267
Messages from real-time jobs to adapter instances.............................................................267
Real-time service invoked by an adapter instance.................................................................268
2011-06-09

10. Contents
12.2
12.3
12.3.1
12.3.2
12.3.3
12.3.4
12.3.5
Chapter 13
Variables and Parameters...................................................................................................277
13.1
13.2
13.2.1
13.3
13.3.1
13.3.2
13.3.3
13.3.4
13.4
13.4.1
13.4.2
13.4.3
13.5
13.5.1
13.5.2
13.5.3
13.6
13.7
13.7.1
13.8
13.8.1
13.8.2
13.8.3
13.8.4
13.8.5
13.8.6
Overview of variables and parameters..................................................................................277
Chapter 14
Executing Jobs....................................................................................................................301
14.1
14.2
14.2.1
10
Example of when to use embedded data flows.....................................................................270
Overview of job execution....................................................................................................301
Creating embedded data flows.............................................................................................270
Using the Make Embedded Data Flow option.......................................................................271
Creating embedded data flows from existing flows...............................................................272
Using embedded data flows.................................................................................................273
Separately testing an embedded data flow...........................................................................275
Troubleshooting embedded data flows.................................................................................276
The Variables and Parameters window.................................................................................278
To view the variables and parameters in each job, work flow, or data flow............................278
Using local variables and parameters...................................................................................280
Parameters..........................................................................................................................281
Passing values into data flows..............................................................................................281
To define a local variable......................................................................................................282
Defining parameters.............................................................................................................282
Using global variables ..........................................................................................................284
Creating global variables......................................................................................................284
Viewing global variables ......................................................................................................285
Setting global variable values...............................................................................................285
Local and global variable rules..............................................................................................289
Naming................................................................................................................................289
Replicating jobs and work flows...........................................................................................289
Importing and exporting........................................................................................................289
Environment variables..........................................................................................................290
Setting file names at run-time using variables.......................................................................290
To use a variable in a flat file name.......................................................................................290
Substitution parameters.......................................................................................................291
Overview of substitution parameters....................................................................................291
Using the Substitution Parameter Editor...............................................................................293
Associating a substitution parameter configuration with a system configuration...................295
Overriding a substitution parameter in the Administrator......................................................297
Executing a job with substitution parameters .......................................................................297
Exporting and importing substitution parameters..................................................................298
Preparing for job execution...................................................................................................301
Validating jobs and job components.....................................................................................302
2011-06-09

11. Contents
14.2.2
14.2.3
14.3
14.3.1
14.3.2
14.3.3
14.4
14.4.1
14.4.2
14.5
14.5.1
14.5.2
Chapter 15
Data Assessment................................................................................................................315
15.1
15.1.1
15.1.2
15.1.3
15.1.4
15.1.5
15.1.6
15.2
15.2.1
15.2.2
15.2.3
15.3
15.3.1
15.3.2
15.4
15.4.1
15.4.2
15.4.3
15.4.4
15.4.5
15.4.6
15.4.7
Using the Data Profiler.........................................................................................................316
Chapter 16
Data Quality........................................................................................................................353
16.1
16.2
11
Ensuring that the Job Server is running................................................................................303
Overview of data quality.......................................................................................................353
Setting job execution options...............................................................................................303
Executing jobs as immediate tasks.......................................................................................304
To execute a job as an immediate task.................................................................................304
Monitor tab .........................................................................................................................305
Log tab ...............................................................................................................................306
Debugging execution errors.................................................................................................306
Using logs............................................................................................................................307
Examining target data...........................................................................................................309
Changing Job Server options...............................................................................................309
To change option values for an individual Job Server...........................................................312
To use mapped drive names in a path..................................................................................314
Data sources that you can profile.........................................................................................316
Connecting to the profiler server..........................................................................................317
Profiler statistics..................................................................................................................318
Executing a profiler task.......................................................................................................321
Monitoring profiler tasks using the Designer........................................................................326
Viewing the profiler results...................................................................................................327
Using View Data to determine data quality...........................................................................333
Data tab...............................................................................................................................334
Profile tab............................................................................................................................335
Relationship Profile or Column Profile tab.............................................................................335
Using the Validation transform.............................................................................................335
Analyzing the column profile.................................................................................................336
Defining a validation rule based on a column profile..............................................................337
Using Auditing .....................................................................................................................338
Auditing objects in a data flow..............................................................................................339
Accessing the Audit window................................................................................................343
Defining audit points, rules, and action on failure..................................................................344
Guidelines to choose audit points .......................................................................................346
Auditing embedded data flows.............................................................................................347
Resolving invalid audit labels................................................................................................350
Viewing audit results ...........................................................................................................350
Data Cleanse.......................................................................................................................353
2011-06-09

12. Contents
16.2.1
16.2.2
16.2.3
16.2.4
16.2.5
16.2.6
16.2.7
16.2.8
16.2.9
16.2.10
16.3
16.3.1
16.3.2
16.3.3
16.4
16.4.1
16.4.2
16.4.3
16.4.4
16.4.5
16.4.6
16.4.7
16.4.8
16.4.9
16.4.10
16.4.11
16.4.12
16.4.13
16.5
16.5.1
16.5.2
16.5.3
16.5.4
16.5.5
16.5.6
16.5.7
16.5.8
16.5.9
16.5.10
16.5.11
16.5.12
12
About cleansing data............................................................................................................353
Cleansing package lifecycle: develop, deploy and maintain ..................................................354
Configuring the Data Cleanse transform..............................................................................356
Ranking and prioritizing parsing engines...............................................................................357
About parsing data...............................................................................................................358
About standardizing data......................................................................................................364
About assigning gender descriptions and prenames.............................................................364
Prepare records for matching...............................................................................................365
Region-specific data.............................................................................................................367
Japanese data......................................................................................................................368
Geocoding...........................................................................................................................369
POI and address geocoding ................................................................................................370
POI and address reverse geocoding ....................................................................................376
Understanding your output...................................................................................................387
Match..................................................................................................................................389
Matching strategies..............................................................................................................389
Match components..............................................................................................................389
Match Wizard.......................................................................................................................391
Transforms for match data flows..........................................................................................398
Working in the Match and Associate editors........................................................................399
Physical and logical sources.................................................................................................400
Match preparation................................................................................................................404
Match criteria.......................................................................................................................424
Post-match processing.........................................................................................................440
Association matching...........................................................................................................458
Unicode matching................................................................................................................458
Phonetic matching................................................................................................................461
Set up for match reports .....................................................................................................463
Address Cleanse..................................................................................................................464
How address cleanse works.................................................................................................464
Prepare your input data........................................................................................................467
Determine which transform(s) to use...................................................................................469
Identify the country of destination.........................................................................................472
Set up the reference files.....................................................................................................473
Define the standardization options.......................................................................................474
Process Japanese addresses .............................................................................................475
Process Chinese addresses.................................................................................................485
Supported countries (Global Address Cleanse)....................................................................490
New Zealand Certification....................................................................................................492
Global Address Cleanse Suggestion List.............................................................................496
Global Suggestion List.........................................................................................................496
2011-06-09

13. Contents
16.6
16.6.1
16.6.2
16.6.3
16.6.4
16.6.5
16.6.6
16.6.7
16.6.8
16.6.9
16.6.10
16.6.11
16.6.12
16.7
16.7.1
16.8
Chapter 17
Design and Debug..............................................................................................................585
17.1
17.1.1
17.1.2
17.1.3
17.2
17.2.1
17.2.2
17.2.3
17.2.4
17.2.5
17.3
17.3.1
17.3.2
17.3.3
17.3.4
17.3.5
17.3.6
17.3.7
17.4
17.4.1
17.4.2
17.4.3
17.4.4
13
Beyond the basic address cleansing.....................................................................................497
Using View Where Used......................................................................................................585
USPS DPV®.........................................................................................................................497
LACSLink®...........................................................................................................................508
SuiteLink™............................................................................................................................518
USPS DSF2®.......................................................................................................................521
NCOALink® overview...........................................................................................................531
USPS eLOT® .......................................................................................................................550
Early Warning System (EWS)...............................................................................................551
USPS RDI®..........................................................................................................................552
GeoCensus (USA Regulatory Address Cleanse).................................................................556
Z4Change (USA Regulatory Address Cleanse)....................................................................560
Suggestion lists overview.....................................................................................................562
Multiple data source statistics reporting...............................................................................565
Data Quality support for native data types............................................................................583
Data Quality data type definitions.........................................................................................583
Data Quality support for NULL values..................................................................................584
Accessing View Where Used from the object library............................................................586
Accessing View Where Used from the workspace...............................................................588
Limitations...........................................................................................................................588
Using View Data..................................................................................................................589
Accessing View Data...........................................................................................................589
Viewing data in the workspace.............................................................................................590
View Data Properties...........................................................................................................592
View Data tool bar options...................................................................................................596
View Data tabs....................................................................................................................597
Using the interactive debugger.............................................................................................600
Before starting the interactive debugger...............................................................................601
Starting and stopping the interactive debugger.....................................................................604
Panes...................................................................................................................................606
Debug menu options and tool bar.........................................................................................610
Viewing data passed by transforms......................................................................................612
Push-down optimizer............................................................................................................613
Limitations...........................................................................................................................613
Comparing Objects..............................................................................................................614
To compare two different objects.........................................................................................614
To compare two versions of the same object.......................................................................615
Overview of the Difference Viewer window..........................................................................615
Navigating through differences.............................................................................................619
2011-06-09

14. Contents
17.5
17.5.1
17.5.2
Chapter 18
Exchanging Metadata..........................................................................................................623
18.1
18.1.1
18.1.2
18.2
18.2.1
18.2.2
18.2.3
18.2.4
Metadata exchange..............................................................................................................623
Chapter 19
Recovery Mechanisms........................................................................................................629
19.1
19.2
19.2.1
19.2.2
19.2.3
19.2.4
19.2.5
19.2.6
19.2.7
19.3
19.4
19.4.1
19.4.2
19.4.3
Recovering from unsuccessful job execution........................................................................629
Chapter 20
Techniques for Capturing Changed Data............................................................................643
20.1
20.1.1
20.1.2
20.1.3
20.2
20.2.1
20.2.2
20.2.3
20.2.4
14
Calculating column mappings...............................................................................................619
Understanding changed-data capture...................................................................................643
To automatically calculate column mappings ........................................................................620
To manually calculate column mappings ..............................................................................620
Importing metadata files into the software............................................................................624
Exporting metadata files from the software...........................................................................624
Creating SAP universes.......................................................................................................625
To create universes using the Tools menu ...........................................................................625
To create universes using the object library..........................................................................626
Mappings between repository and universe metadata..........................................................626
Attributes that support metadata exchange..........................................................................627
Automatically recovering jobs...............................................................................................630
Enabling automated recovery...............................................................................................630
Marking recovery units.........................................................................................................631
Running in recovery mode....................................................................................................632
Ensuring proper execution path............................................................................................632
Using try/catch blocks with automatic recovery...................................................................633
Ensuring that data is not duplicated in targets.......................................................................635
Using preload SQL to allow re-executable data flows ..........................................................636
Manually recovering jobs using status tables........................................................................637
Processing data with problems.............................................................................................638
Using overflow files..............................................................................................................639
Filtering missing or bad values .............................................................................................639
Handling facts with missing dimensions................................................................................640
Full refresh...........................................................................................................................643
Capturing only changes........................................................................................................643
Source-based and target-based CDC..................................................................................644
Using CDC with Oracle sources..........................................................................................646
Overview of CDC for Oracle databases...............................................................................646
Setting up Oracle CDC........................................................................................................650
To create a CDC datastore for Oracle.................................................................................651
Importing CDC data from Oracle..........................................................................................651
2011-06-09

15. Contents
20.2.5
20.2.6
20.2.7
20.2.8
20.2.9
20.3
20.3.1
20.3.2
20.3.3
20.3.4
20.3.5
20.3.6
20.4
20.4.1
20.4.2
20.4.3
20.4.4
20.4.5
20.4.6
20.5
20.5.1
20.5.2
20.5.3
20.5.4
20.5.5
20.6
Chapter 21
Monitoring Jobs..................................................................................................................697
21.1
21.2
21.2.1
21.2.2
21.2.3
21.2.4
21.2.5
21.2.6
Administrator.......................................................................................................................697
Chapter 22
Multi-user Development......................................................................................................713
22.1
22.2
15
Viewing an imported CDC table...........................................................................................654
Central versus local repository.............................................................................................713
To configure an Oracle CDC source table............................................................................656
To create a data flow with an Oracle CDC source................................................................659
Maintaining CDC tables and subscriptions...........................................................................659
Limitations...........................................................................................................................660
Using CDC with Attunity mainframe sources.......................................................................661
Setting up Attunity CDC......................................................................................................662
Setting up the software for CDC on mainframe sources......................................................663
Importing mainframe CDC data............................................................................................664
Configuring a mainframe CDC source..................................................................................666
Using mainframe check-points.............................................................................................668
Limitations...........................................................................................................................669
Using CDC with Microsoft SQL Server databases ..............................................................669
Overview of CDC for SQL Server databases.......................................................................669
Setting up Microsoft SQL Server for CDC...........................................................................671
Setting up the software for CDC on SQL Server.................................................................673
Importing SQL Server CDC data..........................................................................................674
Configuring a SQL Server CDC source...............................................................................675
Limitations...........................................................................................................................678
Using CDC with timestamp-based sources..........................................................................679
Processing timestamps........................................................................................................680
Overlaps..............................................................................................................................682
Types of timestamps............................................................................................................688
Timestamp-based CDC examples........................................................................................689
Additional job design tips.....................................................................................................695
Using CDC for targets.........................................................................................................696
SNMP support.....................................................................................................................697
About the SNMP agent........................................................................................................697
Job Server, SNMP agent, and NMS application architecture...............................................698
About SNMP Agent's Management Information Base (MIB)................................................699
About an NMS application...................................................................................................701
Configuring the software to support an NMS application......................................................702
Troubleshooting...................................................................................................................711
Multiple users......................................................................................................................714
2011-06-09

16. Contents
22.3
Chapter 23
Multi-user Environment Setup............................................................................................717
23.1
23.2
23.3
23.3.1
23.3.2
23.3.3
23.3.4
Create a nonsecure central repository.................................................................................717
Chapter 24
Implementing Central Repository Security.........................................................................721
24.1
24.1.1
24.1.2
24.1.3
24.2
24.2.1
24.2.2
24.3
24.4
24.5
24.6
24.6.1
Overview..............................................................................................................................721
Chapter 25
Working in a Multi-user Environment.................................................................................727
25.1
25.2
25.2.1
25.2.2
25.3
25.3.1
25.3.2
25.3.3
25.4
25.4.1
25.4.2
25.5
25.5.1
25.5.2
16
Security and the central repository.......................................................................................716
Filtering................................................................................................................................727
Define a connection to a nonsecure central repository.........................................................718
Activating a central repository..............................................................................................718
To activate a central repository............................................................................................719
To open the central object library.........................................................................................719
To change the active central repository................................................................................719
To change central repository connections............................................................................720
Group-based permissions....................................................................................................721
Permission levels.................................................................................................................722
Process summary................................................................................................................722
Creating a secure central repository.....................................................................................723
To create a secure central repository...................................................................................723
To upgrade a central repository from nonsecure to secure...................................................723
Adding a multi-user administrator (optional)..........................................................................724
Setting up groups and users................................................................................................724
Defining a connection to a secure central repository............................................................724
Working with objects in a secure central repository..............................................................725
Viewing and modifying permissions......................................................................................725
Adding objects to the central repository...............................................................................728
To add a single object to the central repository....................................................................728
To add an object and its dependent objects to the central repository...................................729
Checking out objects...........................................................................................................729
Check out single objects or objects with dependents...........................................................730
Check out single objects or objects with dependents without replacement..........................731
Check out objects with filtering............................................................................................732
Undoing check out...............................................................................................................732
To undo single object check out...........................................................................................733
To undo check out of an object and its dependents..............................................................733
Checking in objects..............................................................................................................733
Checking in single objects, objects with dependents............................................................734
Checking in an object with filtering.......................................................................................735
2011-06-09

17. Contents
25.6
25.6.1
25.7
25.7.1
25.7.2
25.7.3
25.8
25.9
25.9.1
25.9.2
25.9.3
25.10
Labeling objects...................................................................................................................735
Chapter 26
Migrating Multi-user Jobs...................................................................................................743
26.1
26.2
26.2.1
26.3
Application phase management............................................................................................743
Index
17
To label an object and its dependents..................................................................................737
Getting objects....................................................................................................................737
To get a single object...........................................................................................................737
To get an object and its dependent objects..........................................................................738
To get an object and its dependent objects with filtering......................................................738
Comparing objects...............................................................................................................738
Viewing object history..........................................................................................................739
To examine the history of an object......................................................................................739
To get a previous version of an object..................................................................................740
To get an object with a particular label..................................................................................740
Deleting objects...................................................................................................................740
Copying contents between central repositories....................................................................744
To copy the contents of one central repository to another central repository.......................744
Central repository migration.................................................................................................745
747
2011-06-09

18. Contents
18
2011-06-09

19. Introduction
Introduction
1.1 Welcome to SAP BusinessObjects Data Services
1.1.1 Welcome
SAP BusinessObjects Data Services delivers a single enterprise-class solution for data integration,
data quality, data profiling, and text data processing that allows you to integrate, transform, improve,
and deliver trusted data to critical business processes. It provides one development UI, metadata
repository, data connectivity layer, run-time environment, and management console—enabling IT
organizations to lower total cost of ownership and accelerate time to value. With SAP BusinessObjects
Data Services, IT organizations can maximize operational efficiency with a single solution to improve
data quality and gain access to heterogeneous sources and applications.
1.1.2 Documentation set for SAP BusinessObjects Data Services
You should become familiar with all the pieces of documentation that relate to your SAP BusinessObjects
Data Services product.
Document
What this document provides
Administrator's Guide
Information about administrative tasks such as monitoring,
lifecycle management, security, and so on.
Customer Issues Fixed
Information about customer issues fixed in this release.
Designer Guide
Information about how to use SAP BusinessObjects Data
Services Designer.
Documentation Map
Information about available SAP BusinessObjects Data Services books, languages, and locations.
19
2011-06-09

20. Introduction
Document
What this document provides
Installation Guide for Windows
Information about and procedures for installing SAP BusinessObjects Data Services in a Windows environment.
Installation Guide for UNIX
Information about and procedures for installing SAP BusinessObjects Data Services in a UNIX environment.
Integrator's Guide
Information for third-party developers to access SAP BusinessObjects Data Services functionality using web services and
APIs.
Management Console Guide
Information about how to use SAP BusinessObjects Data
Services Administrator and SAP BusinessObjects Data Services Metadata Reports.
Performance Optimization Guide
Information about how to improve the performance of SAP
BusinessObjects Data Services.
Reference Guide
Detailed reference material for SAP BusinessObjects Data
Services Designer.
Release Notes
Important information you need before installing and deploying
this version of SAP BusinessObjects Data Services.
Technical Manuals
A compiled “master” PDF of core SAP BusinessObjects Data
Services books containing a searchable master table of contents and index:
• Administrator's Guide
• Designer Guide
• Reference Guide
• Management Console Guide
• Performance Optimization Guide
• Supplement for J.D. Edwards
• Supplement for Oracle Applications
• Supplement for PeopleSoft
• Supplement for Salesforce.com
• Supplement for Siebel
• Supplement for SAP
Text Data Processing Extraction Customization Guide
Information about building dictionaries and extraction rules to
create your own extraction patterns to use with Text Data
Processing transforms.
Text Data Processing Language Reference
Guide
Information about the linguistic analysis and extraction processing features that the Text Data Processing component provides, as well as a reference section for each language supported.
20
2011-06-09

21. Introduction
Document
What this document provides
Tutorial
A step-by-step introduction to using SAP BusinessObjects
Data Services.
Upgrade Guide
Release-specific product behavior changes from earlier versions of SAP BusinessObjects Data Services to the latest release. This manual also contains information about how to
migrate from SAP BusinessObjects Data Quality Management
to SAP BusinessObjects Data Services.
What's New
Highlights of new key features in this SAP BusinessObjects
Data Services release. This document is not updated for support package or patch releases.
In addition, you may need to refer to several Adapter Guides and Supplemental Guides.
Document
What this document provides
Supplement for J.D. Edwards
Information about interfaces between SAP BusinessObjects Data Services
and J.D. Edwards World and J.D. Edwards OneWorld.
Supplement for Oracle Applications
Information about the interface between SAP BusinessObjects Data Services
and Oracle Applications.
Supplement for PeopleSoft
Information about interfaces between SAP BusinessObjects Data Services
and PeopleSoft.
Supplement for Salesforce.com
Information about how to install, configure, and use the SAP BusinessObjects
Data Services Salesforce.com Adapter Interface.
Supplement for SAP
Information about interfaces between SAP BusinessObjects Data Services,
SAP Applications, and SAP NetWeaver BW.
Supplement for Siebel
Information about the interface between SAP BusinessObjects Data Services
and Siebel.
We also include these manuals for information about SAP BusinessObjects Information platform services.
Document
What this document provides
Information Platform Services Administrator's Guide
Information for administrators who are responsible for
configuring, managing, and maintaining an Information
platform services installation.
Information Platform Services Installation Guide for
UNIX
Installation procedures for SAP BusinessObjects Information platform services on a UNIX environment.
21
2011-06-09

22. Introduction
Document
What this document provides
Information Platform Services Installation Guide for
Windows
Installation procedures for SAP BusinessObjects Information platform services on a Windows environment.
1.1.3 Accessing documentation
You can access the complete documentation set for SAP BusinessObjects Data Services in several
places.
1.1.3.1 Accessing documentation on Windows
After you install SAP BusinessObjects Data Services, you can access the documentation from the Start
menu.
1. Choose Start > Programs > SAP BusinessObjects Data Services 4.0 > Data Services
Documentation.
Note:
Only a subset of the documentation is available from the Start menu. The documentation set for this
release is available in <LINK_DIR>DocBooksen.
2. Click the appropriate shortcut for the document that you want to view.
1.1.3.2 Accessing documentation on UNIX
After you install SAP BusinessObjects Data Services, you can access the online documentation by
going to the directory where the printable PDF files were installed.
1. Go to <LINK_DIR>/doc/book/en/.
2. Using Adobe Reader, open the PDF file of the document that you want to view.
1.1.3.3 Accessing documentation from the Web
22
2011-06-09

23. Introduction
You can access the complete documentation set for SAP BusinessObjects Data Services from the SAP
BusinessObjects Business Users Support site.
1. Go to http://help.sap.com.
2. Click SAP BusinessObjects at the top of the page.
3. Click All Products in the navigation pane on the left.
You can view the PDFs online or save them to your computer.
1.1.4 SAP BusinessObjects information resources
A global network of SAP BusinessObjects technology experts provides customer support, education,
and consulting to ensure maximum information management benefit to your business.
Useful addresses at a glance:
23
2011-06-09

24. Introduction
Address
Content
Customer Support, Consulting, and Education
services
Information about SAP Business User Support
programs, as well as links to technical articles,
downloads, and online forums. Consulting services
can provide you with information about how SAP
BusinessObjects can help maximize your information management investment. Education services
can provide information about training options and
modules. From traditional classroom learning to
targeted e-learning seminars, SAP BusinessObjects
can offer a training package to suit your learning
needs and preferred learning style.
http://service.sap.com/
SAP BusinessObjects Data Services Community Get online and timely information about SAP BusinessObjects Data Services, including tips and tricks,
http://www.sdn.sap.com/irj/sdn/ds
additional downloads, samples, and much more.
All content is to and from the community, so feel
free to join in and contact us if you have a submission.
Forums on SCN (SAP Community Network )
http://forums.sdn.sap.com/forum.jspa?foru
mID=305
Blueprints
http://www.sdn.sap.com/irj/boc/blueprints
Product documentation
Search the SAP BusinessObjects forums on the
SAP Community Network to learn from other SAP
BusinessObjects Data Services users and start
posting questions or share your knowledge with the
community.
Blueprints for you to download and modify to fit your
needs. Each blueprint contains the necessary SAP
BusinessObjects Data Services project, jobs, data
flows, file formats, sample data, template tables,
and custom functions to run the data flows in your
environment with only a few modifications.
SAP BusinessObjects product documentation.
http://help.sap.com/businessobjects/
Supported Platforms (Product Availability Matrix)
https://service.sap.com/PAM
Get information about supported platforms for SAP
BusinessObjects Data Services.
Use the search function to search for Data Services.
Click the link for the version of Data Services you
are searching for.
1.2 Overview of this guide
24
2011-06-09

25. Introduction
Welcome to the Designer Guide. The Data Services Designer provides a graphical user interface (GUI)
development environment in which you define data application logic to extract, transform, and load data
from databases and applications into a data warehouse used for analytic and on-demand queries. You
can also use the Designer to define logical paths for processing message-based queries and transactions
from Web-based, front-office, and back-office applications.
1.2.1 About this guide
The guide contains two kinds of information:
•
Conceptual information that helps you understand the Data Services Designer and how it works
•
Procedural information that explains in a step-by-step manner how to accomplish a task
You will find this guide most useful:
•
While you are learning about the product
•
While you are performing tasks in the design and early testing phase of your data-movement projects
•
As a general source of information during any phase of your projects
1.2.2 Who should read this guide
This and other Data Services product documentation assumes the following:
•
You are an application developer, consultant, or database administrator working on data extraction,
data warehousing, data integration, or data quality.
•
You understand your source data systems, RDBMS, business intelligence, and messaging concepts.
•
You understand your organization's data needs.
•
You are familiar with SQL (Structured Query Language).
•
If you are interested in using this product to design real-time processing, you should be familiar with:
•
•
•
25
DTD and XML Schema formats for XML files
Publishing Web Services (WSDL, HTTP, and SOAP protocols, etc.)
You are familiar Data Services installation environments—Microsoft Windows or UNIX.
2011-06-09

26. Introduction
26
2011-06-09

27. Logging into the Designer
Logging into the Designer
You must have access to a local repository to log into the software. Typically, you create a repository
during installation. However, you can create a repository at any time using the Repository Manager,
and configure access rights within the Central Management Server.
Additionally, each repository must be associated with at least one Job Server before you can run
repository jobs from within the Designer. Typically, you define a Job Server and associate it with a
repository during installation. However, you can define or edit Job Servers or the links between
repositories and Job Servers at any time using the Server Manager.
When you log in to the Designer, you must log in as a user defined in the Central Management Server
(CMS).
1. Enter your user credentials for the CMS.
• System
Specify the server name and optionally the port for the CMS.
•
User name
Specify the user name to use to log into CMS.
•
Password
Specify the password to use to log into the CMS.
•
Authentication
Specify the authentication type used by the CMS.
2. Click Log on.
The software attempts to connect to the CMS using the specified information. When you log in
successfully, the list of local repositories that are available to you is displayed.
3. Select the repository you want to use.
4. If you want the software to remember connection information for future use, click Remember.
If you choose this option, your CMS connection information and repository selection are encrypted
and stored locally, and will be filled in automatically the next time you log into the Designer.
5. Click OK to log in using the selected repository.
2.1 Version restrictions
27
2011-06-09

28. Logging into the Designer
Your repository version must be associated with the same major release as the Designer and must be
less than or equal to the version of the Designer.
During login, the software alerts you if there is a mismatch between your Designer version and your
repository version.
After you log in, you can view the software and repository versions by selecting Help > About Data
Services.
Some features in the current release of the Designer might not be supported if you are not logged in
to the latest version of the repository.
2.2 Resetting users
Occasionally, more than one person may attempt to log in to a single repository. If this happens, the
Reset Users window appears, listing the users and the time they logged in to the repository.
From this window, you have several options. You can:
•
Reset Users to clear the users in the repository and set yourself as the currently logged in user.
•
Continue to log in to the system regardless of who else might be connected.
•
Exit to terminate the login attempt and close the session.
Note:
Only use Reset Users or Continue if you know that you are the only user connected to the repository.
Subsequent changes could corrupt the repository.
28
2011-06-09

29. Designer User Interface
Designer User Interface
This section provides basic information about the Designer's graphical user interface.
3.1 Objects
All "entities" you define, edit, or work with in Designer are called objects. The local object library shows
objects such as source and target metadata, system functions, projects, and jobs.
Objects are hierarchical and consist of:
•
Options, which control the operation of objects. For example, in a datastore, the name of the database
to which you connect is an option for the datastore object.
•
Properties, which document the object. For example, the name of the object and the date it was
created are properties. Properties describe an object, but do not affect its operation.
The software has two types of objects: Reusable and single-use. The object type affects how you define
and retrieve the object.
3.1.1 Reusable objects
You can reuse and replicate most objects defined in the software.
After you define and save a reusable object, the software stores the definition in the local repository.
You can then reuse the definition as often as necessary by creating calls to the definition. Access
reusable objects through the local object library.
A reusable object has a single definition; all calls to the object refer to that definition. If you change the
definition of the object in one place, you are changing the object in all other places in which it appears.
A data flow, for example, is a reusable object. Multiple jobs, like a weekly load job and a daily load job,
can call the same data flow. If the data flow changes, both jobs use the new version of the data flow.
The object library contains object definitions. When you drag and drop an object from the object library,
you are really creating a new reference (or call) to the existing object definition.
29
2011-06-09

30. Designer User Interface
3.1.2 Single-use objects
Some objects are defined only within the context of a single job or data flow, for example scripts and
specific transform definitions.
3.1.3 Object hierarchy
Object relationships are hierarchical. The following figure shows the relationships between major object
types:
30
2011-06-09

31. Designer User Interface
3.2 Designer window
The Designer user interface consists of a single application window and several embedded supporting
windows.
31
2011-06-09

32. Designer User Interface
In addition to the Menu bar and Toolbar, there are other key areas of the application window:
Area
Description
Project area
Contains the current project (and the job(s) and other objects within it) available to you at a
given time. In the software, all entities you create, modify, or work with are objects.
Workspace
The area of the application window in which you define, display, and modify objects.
Local object
library
Provides access to local repository objects including built-in system objects, such as transforms,
and the objects you build and save, such as jobs and data flows.
Tool palette
Buttons on the tool palette enable you to add new objects to the workspace.
3.3 Menu bar
This section contains a brief description of the Designer's menus.
32
2011-06-09

33. Designer User Interface
3.3.1 Project menu
The project menu contains standard Windows as well as software-specific options.
Option
Description
New
Define a new project, batch job, real-time job, work flow, data flow, transform,
datastore, file format, DTD, XML Schema, or custom function.
Open
Open an existing project.
Close
Close the currently open project.
Delete
Delete the selected object.
Save
Save the object open in the workspace.
Save All
Save all changes to objects in the current Designer session.
Print
Print the active workspace.
Print Setup
Set up default printer information.
Compact Reposi- Remove redundant and obsolete objects from the repository tables.
tory
Exit
Exit Designer.
3.3.2 Edit menu
The Edit menu provides standard Windows commands with a few restrictions.
Option
Undo
Undo the last operation.
Cut
Cut the selected objects or text and place it on the clipboard.
Copy
Copy the selected objects or text to the clipboard.
Paste
Paste the contents of the clipboard into the active workspace or text box.
Delete
33
Description
Delete the selected objects.
2011-06-09

34. Designer User Interface
Option
Description
Recover Last
Deleted
Recover deleted objects to the workspace from which they were deleted. Only
the most recently deleted objects are recovered.
Select All
Select all objects in the active workspace.
Clear All
Clear all objects in the active workspace (no undo).
3.3.3 View menu
A check mark indicates that the tool is active.
Option
Description
Toolbar
Display or remove the toolbar in the Designer window.
Status Bar
Display or remove the status bar in the Designer window.
Palette
Display or remove the floating tool palette.
Enabled Descriptions View descriptions for objects with enabled descriptions.
Refresh
Redraw the display. Use this command to ensure the content of the workspace
represents the most up-to-date information from the repository.
3.3.4 Tools menu
An icon with a different color background indicates that the tool is active.
Option
Object Library
Open or close the object library window.
Project Area
Display or remove the project area from the Designer window.
Variables
Open or close the Variables and Parameters window.
Output
Open or close the Output window. The Output window shows errors
that occur such as during job validation or object export.
Profiler Monitor
34
Description
Display the status of Profiler tasks.
2011-06-09

35. Designer User Interface
Option
Description
Run Match Wizard
Display the Match Wizard to create a match data flow. Select a transform in a data flow to activate this menu item. The transform(s) that the
Match Wizard generates will be placed downstream from the transform
you selected.
Match Editor
Display the Match Editor to edit Match transform options.
Associate Editor
Display the Associate Editor to edit Associate transform options.
User-Defined Editor
Display the User-Defined Editor to edit User-Defined transform options.
Custom Functions
Display the Custom Functions window.
System Configurations
Display the System Configurations editor.
Substitution Parameter
Configurations
Display the Substitution Parameter Editor to create and edit substitution
paramters and configurations.
Profiler Server Login
Connect to the Profiler Server.
Export
Export individual repository objects to another repository or file. This
command opens the Export editor in the workspace. You can drag objects from the object library into the editor for export. To export your
whole repository, in the object library right-click and select Repository
> Export to file.
Import From File
Import objects into the current repository from a file. The default file
types are ATL, XML, DMT, and FMT. For more information on DMT
and FMT files, see the Upgrade Guide.
Metadata Exchange
Import and export metadata to third-party systems via a file.
BusinessObjects Universes Export (create or update) metadata in BusinessObjects Universes.
Central Repositories
Create or edit connections to a central repository for managing object
versions among multiple users.
Options
Display the Options window.
Data Services Management Display the Management Console.
Console
Related Topics
• Multi-user Environment Setup
• Administrator's Guide: Export/Import, Importing from a file
• Administrator's Guide: Export/Import, Exporting/importing objects
• Reference Guide: Functions and Procedures, Custom functions
• Local object library
• Project area
• Variables and Parameters
• Using the Data Profiler
• Creating and managing multiple datastore configurations
35
2011-06-09

36. Designer User Interface
• Connecting to the profiler server
• Metadata exchange
• Creating SAP universes
• General and environment options
3.3.5 Debug menu
The only options available on this menu at all times are Show Filters/Breakpoints and
Filters/Breakpoints. The Execute and Start Debug options are only active when a job is selected.
All other options are available as appropriate when a job is running in the Debug mode.
Option
Description
Execute
Opens the Execution Properties window which allows you to execute the
selected job.
Start Debug
Opens the Debug Properties window which allows you to run a job in the
debug mode.
Show Filters/Breakpoints
Shows and hides filters and breakpoints in workspace diagrams.
Filters/Breakpoints
Opens a window you can use to manage filters and breakpoints.
Related Topics
• Using the interactive debugger
• Filters and Breakpoints window
3.3.6 Validation menu
The Designer displays options on this menu as appropriate when an object is open in the workspace.
36
2011-06-09

37. Designer User Interface
Option
Description
Validate
Validate the objects in the current workspace view or all objects in the job
before executing the application.
Show ATL
View a read-only version of the language associated with the job.
Display Optimized
SQL
Display the SQL that Data Services generated for a selected data flow.
Related Topics
• Performance Optimization Guide: Maximizing Push-Down Operations, To view SQL
3.3.7 Dictionary menu
The Dictionary menu contains options for interacting with the dictionaries used by cleansing packages
and the Data Cleanse transform.
Option
Description
Search
Search for existing dictionary entries.
Add New Dictionary En- Create a new primary dictionary entry.
try
Bulk Load
Import a group of dictionary changes from an external file.
View Bulk Load Conflict Display conflict logs generated by the Bulk Load feature.
Logs
Export Dictionary
Changes
Export changes from a dictionary to an XML file.
Universal Data Cleanse Dictionary-related options specific to the Universal Data Cleanse feature.
Add New Classification Add a new dictionary classification.
Edit Classification
Add Custom Output
37
Edit an existing dictionary classification.
Add custom output categories and fields to a dictionary.
2011-06-09

38. Designer User Interface
Option
Description
Create Dictionary
Create a new dictionary in the repository.
Delete Dictionary
Delete a dictionary from the repository.
Manage Connection
Update the connection information for the dictionary repository connection.
3.3.8 Window menu
The Window menu provides standard Windows options.
Option
Description
Back
Move back in the list of active workspace windows.
Forward
Move forward in the list of active workspace windows.
Cascade
Display window panels overlapping with titles showing.
Tile Horizontally
Display window panels side by side.
Tile Vertically
Display window panels one above the other.
Close All Windows
Close all open windows.
A list of objects open in the workspace also appears on the Windows menu. The name of the
currently-selected object is indicated by a check mark. Navigate to another open object by selecting its
name in the list.
3.3.9 Help menu
The Help menu provides standard help options.
38
2011-06-09