Contents

Expand All · Collapse All

Title and Copyright Information

Preface

• Audience
• Documentation Accessibility
• Related Documents
• Conventions

What's New In Oracle Data Integrator?

• Release Themes
• New Features

Part I Understanding Oracle Data Integrator

1 Introduction to Oracle Data Integrator

• 1.1 Introduction to Data Integration with Oracle Data Integrator
  • 1.1.1 Data Integration
  • 1.1.2 Oracle Data Integrator
  • 1.1.3 E-LT
• 1.2 Oracle Data Integrator Concepts
  • 1.2.1 Introduction to Declarative Design
  • 1.2.2 Introduction to Knowledge Modules
  • 1.2.3 Introduction to Integration Interfaces
    • 1.2.3.1 Datastores
    • 1.2.3.2 Declarative Rules
    • 1.2.3.3 Data Flow
• 1.3 Typical ODI Integration Projects
  • 1.3.1 Batch Oriented Integration
  • 1.3.2 Event Oriented Integration
  • 1.3.3 Service-Oriented Architecture
  • 1.3.4 Data Quality with ODI
  • 1.3.5 Managing Environments
• 1.4 Oracle Data Integrator Architecture
  • 1.4.1 Repositories
  • 1.4.2 User Interfaces
  • 1.4.3 Design-time Projects
  • 1.4.4 Run-Time Agent

2 Oracle Data Integrator QuickStart

• 2.1 Oracle Data Integrator QuickStart List

Part II Administering the Oracle Data Integrator Architecture

3 Administering the Oracle Data Integrator Repositories

• 3.1 Introduction to Oracle Data Integrator Repositories
• 3.2 Creating Repository Storage Spaces
• 3.3 Creating the Master Repository
• 3.4 Connecting to the Master Repository
• 3.5 Creating a Work Repository
• 3.6 Connecting to a Work Repository
• 3.7 Changing the Work Repository Password
• 3.8 Advanced Actions for Administering Repositories
  • 3.8.1 Attaching and Deleting a Work Repository
  • 3.8.2 Erasing a Work Repository
  • 3.8.3 Renumbering Repositories

4 Setting-up the Topology

• 4.1 Introduction to the Oracle Data Integrator Topology
  • 4.1.1 Physical Architecture
  • 4.1.2 Contexts
  • 4.1.3 Logical Architecture
  • 4.1.4 Agents
  • 4.1.5 Languages
  • 4.1.6 Repositories
• 4.2 Setting Up the Topology
  • 4.2.1 Creating a Context
  • 4.2.2 Creating a Data Server
    • 4.2.2.1 Pre-requisites and Guidelines
    • 4.2.2.2 Creating a Data Server
    • 4.2.2.3 Creating a Data Server (Advanced Settings)
    • 4.2.2.4 Testing a Data Server Connection
  • 4.2.3 Creating a Physical Schema
  • 4.2.4 Creating a Logical Schema
  • 4.2.5 Creating a Physical Agent
  • 4.2.6 Creating a Logical Agent
• 4.3 Managing Agents
  • 4.3.1 Standalone Agent
    • 4.3.1.1 Configuring the Standalone Agent
    • 4.3.1.2 Launching a Standalone Agent
    • 4.3.1.3 Stopping an Agent
  • 4.3.2 Java EE Agent
    • 4.3.2.1 Deploying an Agent in a Java EE Application Server (Oracle WebLogic Server)
      • 4.3.2.1.1 Define the Java EE Agent in the Topology
      • 4.3.2.1.2 Create an WLS template for the Java EE Agent
    • 4.3.2.2 Deploying Datasources from Oracle Data Integrator in WLS for an Agent
  • 4.3.3 Load Balancing Agents
    • 4.3.3.1 Delegating Sessions
    • 4.3.3.2 Agent Unavailable
    • 4.3.3.3 Setting Up Load Balancing

Part III Managing and Reverse-Engineering Metadata

5 Creating and Reverse-Engineering a Model

• 5.1 Introduction to Models
  • 5.1.1 Datastores
  • 5.1.2 Data Integrity
  • 5.1.3 Reverse-engineering
  • 5.1.4 Changed Data Capture
• 5.2 Creating and Reverse-Engineering a Model
  • 5.2.1 Creating a Model
  • 5.2.2 Reverse-engineering a Model
• 5.3 Creating and Reverse-Engineering a Datastore
  • 5.3.1 Creating a Datastore
  • 5.3.2 Reverse-Engineering File Datastores
    • 5.3.2.1 Reverse-Engineering Fixed Files
    • 5.3.2.2 Reverse-Engineering Delimited Files
    • 5.3.2.3 Reverse-Engineering COBOL Files
  • 5.3.3 Adding and Deleting Datastore Columns
  • 5.3.4 Adding and Deleting Constraints and Filters
    • 5.3.4.1 Keys
    • 5.3.4.2 References
    • 5.3.4.3 Conditions
    • 5.3.4.4 Mandatory Columns
    • 5.3.4.5 Filter
• 5.4 Editing and Viewing a Datastore's Data
• 5.5 Using Partitioning
  • 5.5.1 Defining Manually Partitions and Sub-Partitions of Model Datastores
• 5.6 Checking Data Quality in a Model
  • 5.6.1 Introduction to Data Integrity
  • 5.6.2 Checking a Constraint
  • 5.6.3 Perform a Static Check on a Model, Sub-Model or Datastore
  • 5.6.4 Reviewing Erroneous Records

6 Working with Common Format Designer

• 6.1 Introduction to Common Format Designer
  • 6.1.1 What is a Diagram?
  • 6.1.2 Why assemble datastores and columns from other models?
  • 6.1.3 Graphical Synonyms
• 6.2 Using the Diagram
  • 6.2.1 Creating a New Diagram
  • 6.2.2 Create Datastores and Columns
  • 6.2.3 Creating Graphical Synonyms
  • 6.2.4 Creating and Editing Constraints and Filters
  • 6.2.5 Printing a Diagram
• 6.3 Generating DDL scripts
• 6.4 Generating Interface IN/OUT

7 Working with Changed Data Capture

• 7.1 Introduction to Changed Data Capture
  • 7.1.1 The Journalizing Components
  • 7.1.2 Simple vs. Consistent Set Journalizing
• 7.2 Setting up Journalizing
  • 7.2.1 Setting up and Starting Journalizing
  • 7.2.2 Journalizing Infrastructure Details
  • 7.2.3 Journalizing Status
• 7.3 Using Changed Data
  • 7.3.1 Viewing Changed Data
  • 7.3.2 Using Changed Data: Simple Journalizing
  • 7.3.3 Using Changed Data: Consistent Set Journalizing
  • 7.3.4 Journalizing Tools
  • 7.3.5 Package Templates for Using Journalizing

8 Working with Data Services

• 8.1 Introduction to Data Services
• 8.2 Setting Up Data Services
  • 8.2.1 Configuring the Web Services Container
  • 8.2.2 Setting up the Data Sources
  • 8.2.3 Configuring the Model
• 8.3 Generating and Deploying Data Services
  • 8.3.1 Generating and Deploying Data Services
  • 8.3.2 Overview of Generated Services
  • 8.3.3 Testing Data Services

Part IV Developing Integration Projects

9 Creating an Integration Project

• 9.1 Introduction to Integration Projects
  • 9.1.1 Oracle Data Integrator Project Components
    • 9.1.1.1 Oracle Data Integrator Project Components
    • 9.1.1.2 Global Components
  • 9.1.2 Project Life Cycle
• 9.2 Creating a New Project
• 9.3 Managing Knowledge Modules
  • 9.3.1 Knowledge Modules Naming Convention
  • 9.3.2 Choosing the Right Knowledge Modules
  • 9.3.3 Importing and Replacing Knowledge Modules
  • 9.3.4 Encrypting and Decrypting a KM
• 9.4 Organizing the Project with Folders

10 Working with Packages

• 10.1 Introduction to Packages
  • 10.1.1 Introduction to Steps
  • 10.1.2 Introduction to Creating Packages
  • 10.1.3 Introduction to the Package editor
• 10.2 Creating a new Package
• 10.3 Working with Steps
  • 10.3.1 Adding a Step
    • 10.3.1.1 Executing an Interface
    • 10.3.1.2 Executing a Procedure
    • 10.3.1.3 Variable Steps
    • 10.3.1.4 Adding Oracle Data Integrator Tool Steps
    • 10.3.1.5 Model, Sub-Models and Datastore Related Steps
    • 10.3.1.6 Checking a Model, Sub-Model or Datastore
    • 10.3.1.7 Journalizing a Model or a Datastore
    • 10.3.1.8 Reverse-Engineering a Model
  • 10.3.2 Deleting a Step
  • 10.3.3 Duplicating a Step
  • 10.3.4 Running a Step
  • 10.3.5 Editing a Step's Linked Object
  • 10.3.6 Arranging the Steps Layout
• 10.4 Defining the Sequence of Steps
• 10.5 Running the Package

11 Working with Integration Interfaces

• 11.1 Introduction to Integration Interfaces
  • 11.1.1 Components of an Integration Interface
• 11.2 Introduction to the Interface Editor
• 11.3 Creating an Interface
  • 11.3.1 Create a New Interface
  • 11.3.2 Define the Target Datastore
    • 11.3.2.1 Permanent Target Datastore
    • 11.3.2.2 Temporary Target Datastore
    • 11.3.2.3 Define the Update Key
  • 11.3.3 Define the Datasets
  • 11.3.4 Define the Source Datastores and Lookups
    • 11.3.4.1 Define the Source Datastores
    • 11.3.4.2 Define Lookups
    • 11.3.4.3 Define Filters on the Sources
    • 11.3.4.4 Define Joins between Sources
  • 11.3.5 Define the Mappings
  • 11.3.6 Define the Interface Flow
  • 11.3.7 Set up Flow Control and Post-Integration Control
    • 11.3.7.1 Set up Flow Control
    • 11.3.7.2 Set up Post-Integration Control
  • 11.3.8 Execute the Integration Interface
• 11.4 Using the Quick-Edit Editor
  • 11.4.1 Adding and Removing a Component
    • 11.4.1.1 Adding Components
    • 11.4.1.2 Removing Components
  • 11.4.2 Editing a Component
  • 11.4.3 Adding, Removing, and Configuring Datasets
  • 11.4.4 Changing the Target DataStore
  • 11.4.5 Customizing Tables
  • 11.4.6 Using Keyboard Navigation for Common Tasks
• 11.5 Designing Integration Interfaces: E-LT- and ETL-Style Interfaces

12 Working with Procedures, Variables, Sequences, and User Functions

• 12.1 Working with Procedures
  • 12.1.1 Introduction to Procedures
  • 12.1.2 Creating Procedures
    • 12.1.2.1 Create a New Procedure
    • 12.1.2.2 Define the Procedure's Options
    • 12.1.2.3 Create and Manage the Procedure's Commands
  • 12.1.3 Using Procedures
    • 12.1.3.1 Executing the Procedure
    • 12.1.3.2 Using a Procedure in a Package
    • 12.1.3.3 Generating a Scenario for a Procedure
  • 12.1.4 Encrypting and Decrypting Procedures
    • 12.1.4.1 Encrypting a KM or Procedure
    • 12.1.4.2 Decrypting a KM or Procedure
• 12.2 Working with Variables
  • 12.2.1 Introduction to Variables
  • 12.2.2 Creating Variables
  • 12.2.3 Using Variables
    • 12.2.3.1 Using Variables in Packages
    • 12.2.3.2 Using Variables in Interfaces
    • 12.2.3.3 Using Variables in Object Properties
    • 12.2.3.4 Using Variables in Procedures
    • 12.2.3.5 Using Variables within Variables
    • 12.2.3.6 Using Variables in the Resource Name of a Datastore
    • 12.2.3.7 Using Variables in a Server URL
    • 12.2.3.8 Passing a Variable to a Scenario
    • 12.2.3.9 Generating a Scenario for a Variable
• 12.3 Working with Sequences
  • 12.3.1 Introduction to Sequences
  • 12.3.2 Creating Sequences
    • 12.3.2.1 Creating Standard Sequences
    • 12.3.2.2 Creating Specific Sequences
    • 12.3.2.3 Creating Native Sequences
  • 12.3.3 Using Sequences and Identity Columns
    • 12.3.3.1 Tips for Using Standard and Specific Sequences
    • 12.3.3.2 Identity Columns
• 12.4 Working with User Functions
  • 12.4.1 Introduction User Functions
  • 12.4.2 Creating User Functions
  • 12.4.3 Using User Functions

13 Working with Scenarios

• 13.1 Introduction to Scenarios
• 13.2 Generating a Scenario
• 13.3 Regenerating a Scenario
• 13.4 Generating a Group of Scenarios
• 13.5 Exporting Scenarios
• 13.6 Importing Scenarios in Production
  • 13.6.1 Import Scenarios
  • 13.6.2 Replace a Scenario
  • 13.6.3 Working with a Scenario from a Different Repository
• 13.7 Encrypting and Decrypting a Scenario

14 Working with Web Services in Oracle Data Integrator

• 14.1 Introduction to Web Services in Oracle Data Integrator
• 14.2 Data Services
• 14.3 Oracle Data Integrator Run-Time Services
• 14.4 Invoking Third-Party Web Services
  • 14.4.1 Introduction to Web Service Invocation
  • 14.4.2 Using the OdiInvokeWebService Tool
  • 14.4.3 Web Service Invocation in Integration Flows

15 Working with Oracle Data Quality Products

• 15.1 Introduction to Oracle Data Quality Products
• 15.2 The Data Quality Process
  • 15.2.1 Create a Quality Input File
  • 15.2.2 Create an Entity
    • 15.2.2.1 Step 1: Validate Loader Connections
    • 15.2.2.2 Step 2: Create Entity and Import Data
    • 15.2.2.3 Step 3: Verify Entity
  • 15.2.3 Create a Profiling Project
  • 15.2.4 Create a Oracle Data Quality Project
  • 15.2.5 Export the Data Quality Project
  • 15.2.6 Reverse-engineer the Entities
  • 15.2.7 Use Oracle Data Quality Input and Output Files in Interfaces
  • 15.2.8 Run this Quality Project from Oracle Data Integrator
  • 15.2.9 Sequence the Process in a Package

Part V Managing Integration Projects

16 Organizing and Documenting your Work

• 16.1 Organizing Projects with Folders
  • 16.1.1 Creating a New Folder
  • 16.1.2 Arranging Project Folders
• 16.2 Organizing Models with Folders
  • 16.2.1 Creating a New Model Folder
  • 16.2.2 Arranging Model Folders
  • 16.2.3 Creating and Organizing Sub-Models
• 16.3 Using Cross-References
  • 16.3.1 Browsing Cross-References
  • 16.3.2 Resolving Missing References
• 16.4 Using Markers and Memos
  • 16.4.1 Markers
  • 16.4.2 Memos
• 16.5 Handling Concurrent Changes
  • 16.5.1 Concurrent Editing Check
  • 16.5.2 Object Locking
• 16.6 Creating PDF Reports
  • 16.6.1 Generating a Topology Report
  • 16.6.2 Generating a Report for the Version Comparison Results
  • 16.6.3 Generating a Report for an Oracle Data Integrator Object
  • 16.6.4 Generating a Diagram Report

17 Working with Version Management

• 17.1 Working with Object Flags
• 17.2 Working with Versions
• 17.3 Working with the Version Comparison Tool
  • 17.3.1 Viewing the Differences between two Versions
  • 17.3.2 Using Comparison Filters
  • 17.3.3 Generating and Printing a Report of your Comparison Results
• 17.4 Working with Solutions
  • 17.4.1 Working with Elements in a Solution
  • 17.4.2 Synchronizing Solutions
  • 17.4.3 Restoring and Checking in a Solution
  • 17.4.4 Importing and Exporting Solutions

18 Exporting/Importing

• 18.1 Import and Export Concepts
  • 18.1.1 Internal Identifiers (IDs)
  • 18.1.2 Relationships between Objects
  • 18.1.3 Import Modes
  • 18.1.4 Tips for Import/Export
• 18.2 Exporting and Importing Objects
  • 18.2.1 Exporting one ODI Object
  • 18.2.2 Export Multiple ODI Objects
  • 18.2.3 Importing Objects
• 18.3 Repository-Level Export/Import
  • 18.3.1 Exporting and Importing the Master Repository
  • 18.3.2 Export/Import the Topology and Security Settings
  • 18.3.3 Exporting and Importing a Work Repository
• 18.4 Exporting the Technical Environment

Part VI Running and Monitoring Integration Processes

19 Running Integration Processes

• 19.1 Understanding ODI Executions
• 19.2 Executing Interfaces, Procedures, Packages and Model Operations
• 19.3 Executing a Scenario
  • 19.3.1 Executing a Scenario from the Studio
  • 19.3.2 Executing a Scenario from a Command Line
• 19.4 Restarting a Session
  • 19.4.1 Restarting a Session from the Studio
  • 19.4.2 Restarting a Session from a Command Line
• 19.5 Scheduling Scenarios
  • 19.5.1 Scheduling a Scenario with the Built-in Scheduler
    • 19.5.1.1 Scheduling a Scenario
    • 19.5.1.2 Updating an Agent's Schedule
    • 19.5.1.3 Displaying the Schedule
  • 19.5.2 Scheduling a Scenario with an External Scheduler
• 19.6 Simulating an Execution
• 19.7 Managing Executions Using Web Services
  • 19.7.1 Introduction to Run-Time Web Services
  • 19.7.2 Executing a Scenario Using a Web Service
  • 19.7.3 Monitoring a Session Status Using a Web Service
  • 19.7.4 Restarting a Session Using a Web Service
  • 19.7.5 Listing Contexts Using a Web Service
  • 19.7.6 Listing Scenarios Using a Web Service
  • 19.7.7 Accessing the Web Service from a Command Line

20 Monitoring Integration Processes

• 20.1 Introduction to Monitoring
  • 20.1.1 Introduction to Operator Navigator
  • 20.1.2 Sessions
  • 20.1.3 Scenarios and Schedules
• 20.2 Reviewing your Execution Results
  • 20.2.1 Status
  • 20.2.2 Managing Errors
  • 20.2.3 Managing Successful Executions
• 20.3 Managing your Executions
  • 20.3.1 Managing Sessions
    • 20.3.1.1 Starting a Session
    • 20.3.1.2 Stopping a Session
    • 20.3.1.3 Restarting a Session
    • 20.3.1.4 Cleaning Stale Sessions
  • 20.3.2 Managing the Log
    • 20.3.2.1 Filtering Sessions
    • 20.3.2.2 Purging the Log
    • 20.3.2.3 Organizing the Log with Session Folders
    • 20.3.2.4 Exporting and Importing Log Data
  • 20.3.3 Managing Scenarios
    • 20.3.3.1 Scenario Folders
    • 20.3.3.2 Importing Scenarios and Solutions in Production
  • 20.3.4 Managing Schedules

21 Working with Oracle Data Integrator Console

• 21.1 Introduction to Oracle Data Integrator Console
  • 21.1.1 Introduction to Oracle Data Integrator Console
  • 21.1.2 Oracle Data Integrator Console Interface
• 21.2 Using Oracle Data Integrator Console
  • 21.2.1 Connecting to Oracle Data Integrator Console
  • 21.2.2 Generic User Operations
  • 21.2.3 Managing Scenarios and Sessions
  • 21.2.4 Using Data Lineage and Flow Map
  • 21.2.5 Performing Administrative Operations

Part VII Managing the Security Settings

22 Managing the Security in Oracle Data Integrator

• 22.1 Introduction to Oracle Data Integrator Security
  • 22.1.1 Objects, Instances and Methods
  • 22.1.2 Profiles
  • 22.1.3 Users
• 22.2 Setting up a Security Policy
  • 22.2.1 Security Policy Approach
  • 22.2.2 Managing Profiles
    • 22.2.2.1 Creating a New Profile
    • 22.2.2.2 Duplicating a Profile
    • 22.2.2.3 Deleting a Profile
  • 22.2.3 Managing Users
    • 22.2.3.1 Creating a New User
    • 22.2.3.2 Assigning a Profile to a User
    • 22.2.3.3 Removing a Profile from a User
    • 22.2.3.4 Deleting a User
  • 22.2.4 Managing Privileges
    • 22.2.4.1 Granting a Profile Method or User Method
    • 22.2.4.2 Revoking a Profile Method or User Method
    • 22.2.4.3 Granting an Authorization by Object Instance
    • 22.2.4.4 Revoking an Authorization by Object Instance
    • 22.2.4.5 Cleaning up Unused Authorizations
• 22.3 Advanced Security
  • 22.3.1 Setting Up External Password Storage
    • 22.3.1.1 Setting the Password Storage
    • 22.3.1.2 Switching the Password Storage
    • 22.3.1.3 Recovering the Password Storage
  • 22.3.2 Setting Up External Authentication
    • 22.3.2.1 Configuring ODI Components for External Authentication
    • 22.3.2.2 Setting the Authentication Mode
    • 22.3.2.3 Switching the Authentication Mode
  • 22.3.3 Enforcing Password Policies

A Oracle Data Integrator Tools Reference

• A.1 Using the Oracle Data Integrator Tools
  • A.1.1 Using a Tool in a Package
  • A.1.2 Using a Tool in a Knowledge Module or a Procedure Command
  • A.1.3 Using a Tool from a Command Line
• A.2 Using Open Tools
  • A.2.1 Installing and Declaring an Open Tool
    • A.2.1.1 Installing an Open Tool
    • A.2.1.2 Declaring a New Open Tool
  • A.2.2 Using Open Tools in a Package or Procedure
• A.3 Developing Open Tools
  • A.3.1 Classes
  • A.3.2 Developing a New Open Tool
    • A.3.2.1 Implementing the Class
      • A.3.2.1.1 Declaration
      • A.3.2.1.2 Importing Packages
      • A.3.2.1.3 Defining the Parameters
      • A.3.2.1.4 Implementing Informational Functions
      • A.3.2.1.5 Execution
  • A.3.3 Open Tools at Run Time
• A.4 ODI Tools per Category
  • A.4.1 Metadata
  • A.4.2 Oracle Data Integrator Objects
  • A.4.3 Utilities
  • A.4.4 Internet Related Tasks
  • A.4.5 Files
  • A.4.6 SAP
  • A.4.7 XML
  • A.4.8 Event Detection
  • A.4.9 Changed Data Capture
• A.5 Alphabetic List of ODI Tools
  • A.5.1 OdiAnt
  • A.5.2 OdiBeep
  • A.5.3 OdiDataQuality
  • A.5.4 OdiDeleteScen
  • A.5.5 OdiExportAllScen
  • A.5.6 OdiExportEnvironmentInformation
  • A.5.7 OdiExportLog
  • A.5.8 OdiExportMaster
  • A.5.9 OdiExportObject
  • A.5.10 OdiExportScen
  • A.5.11 OdiExportWork
  • A.5.12 OdiFileAppend
  • A.5.13 OdiFileCopy
  • A.5.14 OdiFileDelete
  • A.5.15 OdiFileMove
  • A.5.16 OdiFileWait
  • A.5.17 OdiFtpGet
  • A.5.18 OdiFtpPut
  • A.5.19 OdiGenerateAllScen
  • A.5.20 OdiImportObject
  • A.5.21 OdiImportScen
  • A.5.22 OdiInvokeWebService
  • A.5.23 OdiKillAgent
  • A.5.24 OdiMkDir
  • A.5.25 OdiOSCommand
  • A.5.26 OdiOutFile
  • A.5.27 OdiPingAgent
  • A.5.28 OdiPurgeLog
  • A.5.29 OdiReadMail
  • A.5.30 OdiRefreshJournalCount
  • A.5.31 OdiReinitializeSeq
  • A.5.32 OdiReverseGetMetaData
  • A.5.33 OdiReverseResetTable
  • A.5.34 OdiReverseSetMetaData
  • A.5.35 OdiRetrieveJournalData
  • A.5.36 OdiSAPALEClient and OdiSAPALEClient3
  • A.5.37 OdiSAPALEServer and OdiSAPALEServer3
  • A.5.38 OdiScpGet
  • A.5.39 OdiScpPut
  • A.5.40 OdiSendMail
  • A.5.41 OdiSftpGet
  • A.5.42 OdiSftpPut
  • A.5.43 OdiSleep
  • A.5.44 OdiSqlUnload
  • A.5.45 OdiStartScen
  • A.5.46 OdiUnZip
  • A.5.47 OdiUpdateAgentSchedule
  • A.5.48 OdiWaitForChildSession
  • A.5.49 OdiWaitForData
  • A.5.50 OdiWaitForLogData
  • A.5.51 OdiWaitForTable
  • A.5.52 OdiXMLConcat
  • A.5.53 OdiXMLSplit
  • A.5.54 OdiZip

B User Parameters