SlideShare une entreprise Scribd logo
1  sur  7
Télécharger pour lire hors ligne
Failure Recovery in Informatica
Restartable ETL jobs are very crucial to job failure recovery, supportability and data quality of any
ETL system. In one of our prior articles we discussed different design techniques for ETL
restartability, independent of the ETL tool used. We can also implement restartability in an ETL job
using Informatica PowerCenter workflow recovery capabilities. In this article lets see what is required
to setup an informatica workflow for recovery.
What is Workflow Recovery
Workflow recovery allows you to continue processing the workflow and workflow tasks from the point
of interruption. During the workflow recovery process Integration Service access the workflow state,
which is stored in memory or on disk based on the recovery configuration. The workflow state
of operation includes the status of tasks in the workflow and workflow variable values. The
configuration includes.
1. Workflow Configuration for Recovery
2. Session and Tasks Configuration for Recovery
3. Recovering the Workflow from Failure
1. Workflow Configuration for Recovery
To configure a workflow for recovery, we must enable the workflow for recovery or configure the
workflow to suspend on task error.
Enable Recovery : When you enable a workflow for recovery, the Integration Service saves the
workflow state of operation in a shared location. You can recover the workflow if it terminates,
stops, or aborts. The workflow does not have to be running.
We can set up the automatic recovery in the workflow as shown in below image.
Note : An optional High Availability (HA) license is required for this check box to be available
for selection. Without the HA option, workflows must be recovered manually. That is, you must
locate the failed workflow in the Workflow Monitor client and manually tell PowerCenter to
recover the workflow or use the command line to recover the workflow.
Suspend : When you configure a workflow to suspend on error, the Integration Service stores
the workflow state of operation in memory. You can recover the suspended workflow if a task
fails. You can fix the task error and recover the workflow. If the workflow is not able to recover
automatically from failure with in the maximum allowed number of attempts, it goes to
'suspended' state.
We can set up the workflow to suspend on error as shown in below image.
2. Session and Tasks Configuration for Recovery
Each session or task in a workflow has its own recovery strategy. When the Integration Service
recovers a workflow, it recovers tasks based on the recovery strategy of each task or session
specified. Three different options are available.
 Restart task
 Fail task and continue workflow
 Resume from the last checkpoint
Restart task : This recovery strategy is available for all type of workflow tasks. When the Integration
Service recovers a workflow, it restarts each recoverable task that is configured with a restart
strategy. You can configure Session and Command tasks with a restart recovery strategy. All other
tasks have a restart recovery strategy by default.
Fail task and continue workflow : This recovery strategy is only available for session and
command tasks. When the Integration Service recovers a workflow, it does not recover the task. The
task status becomes failed, and the Integration Service continues running the workflow. Configure a
fail recovery strategy if you want to complete the workflow, but you do not want to recover the task.
Resume from the last checkpoint : This recovery strategy is only available for session tasks. The
Integration Service saves the session state of operation and maintains target recovery tables. If the
session aborts, stops, or terminates, the Integration Service uses the saved recovery information to
resume the session from the point of interruption.
When you configure the session recovery strategy to resume from the last checkpoint, Integration
Service stores the session state of operation in the shared location, $PMStorageDir. And also it is
written to the recovery tables (PM_RECOVERY, PM_TGT_RUN_ID, PM_REC_STATE) to
determine where to begin loading data to target tables, in case of a recovery.
You can see the available session recovery options as shown in below image.
You can see the available command task recovery options as shown in below image.
3. Recovering the Workflow from Failure
Workflow can be either recovered automatically or manually depending on the workflow recovery
strategy
Recovering Automatically
If you have High Availability (HA) licence and the workflow is configured to recover automatically as
described above, Integration service automatically attempts to recover the workflow based on the
recovery strategy set of each session or task in the workflow. If the workflow is not able to recover
automatically from failure with in the maximum allowed number of attempts, it goes to 'suspended'
state, which can be then manually recovered.
Recovering Manually
If you do not have High Availability (HA) licence, you can manually recover the workflow or individual
tasks with in a workflow separately. You can access the options as shown in below image from the
workflow manager or from the workflow monitor.
Recover workflow :- Continue processing the workflow from the point of interruption.
Recover Task :- Recover a session but not the rest of the workflow.
Recover workflow from a task :- Recover a session and continue processing a workflow.

Contenu connexe

Tendances

Ibm informatica interview question answers
Ibm informatica interview question answersIbm informatica interview question answers
Ibm informatica interview question answers
Sweta Singh
 

Tendances (20)

AWR reports-Measuring CPU
AWR reports-Measuring CPUAWR reports-Measuring CPU
AWR reports-Measuring CPU
 
Oracle DBA
Oracle DBAOracle DBA
Oracle DBA
 
VNX Overview
VNX Overview   VNX Overview
VNX Overview
 
ETL Process
ETL ProcessETL Process
ETL Process
 
Oracle ASM Training
Oracle ASM TrainingOracle ASM Training
Oracle ASM Training
 
MapR Tutorial Series
MapR Tutorial SeriesMapR Tutorial Series
MapR Tutorial Series
 
Ibm informatica interview question answers
Ibm informatica interview question answersIbm informatica interview question answers
Ibm informatica interview question answers
 
Les 12 fl_db
Les 12 fl_dbLes 12 fl_db
Les 12 fl_db
 
Oracle RAC features on Exadata
Oracle RAC features on ExadataOracle RAC features on Exadata
Oracle RAC features on Exadata
 
Improve PostgreSQL replication with Oracle GoldenGate
Improve PostgreSQL replication with Oracle GoldenGateImprove PostgreSQL replication with Oracle GoldenGate
Improve PostgreSQL replication with Oracle GoldenGate
 
Minor Project Progress Presentation
Minor Project Progress PresentationMinor Project Progress Presentation
Minor Project Progress Presentation
 
Automate data warehouse etl testing and migration testing the agile way
Automate data warehouse etl testing and migration testing the agile wayAutomate data warehouse etl testing and migration testing the agile way
Automate data warehouse etl testing and migration testing the agile way
 
Tanel Poder - Troubleshooting Complex Oracle Performance Issues - Part 2
Tanel Poder - Troubleshooting Complex Oracle Performance Issues - Part 2Tanel Poder - Troubleshooting Complex Oracle Performance Issues - Part 2
Tanel Poder - Troubleshooting Complex Oracle Performance Issues - Part 2
 
ODA Backup Restore Utility & ODA Rescue Live Disk
ODA Backup Restore Utility & ODA Rescue Live DiskODA Backup Restore Utility & ODA Rescue Live Disk
ODA Backup Restore Utility & ODA Rescue Live Disk
 
Oracle data guard for beginners
Oracle data guard for beginnersOracle data guard for beginners
Oracle data guard for beginners
 
High Availability for Oracle SE2
High Availability for Oracle SE2High Availability for Oracle SE2
High Availability for Oracle SE2
 
Oracle Database 12c with RAC High Availability Best Practices
Oracle Database 12c with RAC High Availability Best PracticesOracle Database 12c with RAC High Availability Best Practices
Oracle Database 12c with RAC High Availability Best Practices
 
Physical architecture of sql server
Physical architecture of sql serverPhysical architecture of sql server
Physical architecture of sql server
 
Step by Step Restore rman to different host
Step by Step Restore rman to different hostStep by Step Restore rman to different host
Step by Step Restore rman to different host
 
Oracle Extended Clusters for Oracle RAC
Oracle Extended Clusters for Oracle RACOracle Extended Clusters for Oracle RAC
Oracle Extended Clusters for Oracle RAC
 

En vedette

Informatica log files
Informatica log filesInformatica log files
Informatica log files
Amit Sharma
 
Accenture informatica interview question answers
Accenture informatica interview question answersAccenture informatica interview question answers
Accenture informatica interview question answers
Sweta Singh
 
Mastering informatica log files
Mastering informatica log filesMastering informatica log files
Mastering informatica log files
Amit Sharma
 
Administracion Informática
Administracion InformáticaAdministracion Informática
Administracion Informática
Fernanda
 
History background of allout
History background of alloutHistory background of allout
History background of allout
Komalsharma09
 
Subhiksha's Failure- A Case Study.
Subhiksha's Failure- A Case Study.Subhiksha's Failure- A Case Study.
Subhiksha's Failure- A Case Study.
Kaziranga University.
 
Business Continuity And Disaster Recovery Notes
Business Continuity And Disaster Recovery NotesBusiness Continuity And Disaster Recovery Notes
Business Continuity And Disaster Recovery Notes
Alan McSweeney
 

En vedette (20)

Informatica log files
Informatica log filesInformatica log files
Informatica log files
 
Accenture informatica interview question answers
Accenture informatica interview question answersAccenture informatica interview question answers
Accenture informatica interview question answers
 
Informatica PowerAnalyzer 4.0 1 of 3
Informatica PowerAnalyzer 4.0 1 of 3Informatica PowerAnalyzer 4.0 1 of 3
Informatica PowerAnalyzer 4.0 1 of 3
 
Mastering informatica log files
Mastering informatica log filesMastering informatica log files
Mastering informatica log files
 
Audi, trabajo de informatica.
Audi, trabajo de informatica.Audi, trabajo de informatica.
Audi, trabajo de informatica.
 
Informatica push down optimization implementation
Informatica push down optimization implementationInformatica push down optimization implementation
Informatica push down optimization implementation
 
Administracion Informática
Administracion InformáticaAdministracion Informática
Administracion Informática
 
Microsoft: A case study in corporate success (failure)
Microsoft: A case study in corporate success (failure)Microsoft: A case study in corporate success (failure)
Microsoft: A case study in corporate success (failure)
 
Financial Fundamentals That Every Entrepreneur Should Know
Financial Fundamentals That Every Entrepreneur Should KnowFinancial Fundamentals That Every Entrepreneur Should Know
Financial Fundamentals That Every Entrepreneur Should Know
 
Informatica Server Manager
Informatica Server ManagerInformatica Server Manager
Informatica Server Manager
 
Case Study of Subhiksha
Case Study of SubhikshaCase Study of Subhiksha
Case Study of Subhiksha
 
Key Risk Indicator Example in Business Process Outsourcing for Banking
Key Risk Indicator Example in Business Process Outsourcing for BankingKey Risk Indicator Example in Business Process Outsourcing for Banking
Key Risk Indicator Example in Business Process Outsourcing for Banking
 
History background of allout
History background of alloutHistory background of allout
History background of allout
 
All Out case study
All Out case studyAll Out case study
All Out case study
 
Nokia case study IIML
Nokia case study IIMLNokia case study IIML
Nokia case study IIML
 
Subhiksha's Failure- A Case Study.
Subhiksha's Failure- A Case Study.Subhiksha's Failure- A Case Study.
Subhiksha's Failure- A Case Study.
 
Air India - ERP Implementation Case Study
Air India - ERP Implementation Case StudyAir India - ERP Implementation Case Study
Air India - ERP Implementation Case Study
 
Success and Failure Examples of ERP Implementation
Success and Failure Examples of ERP ImplementationSuccess and Failure Examples of ERP Implementation
Success and Failure Examples of ERP Implementation
 
Business Continuity And Disaster Recovery Notes
Business Continuity And Disaster Recovery NotesBusiness Continuity And Disaster Recovery Notes
Business Continuity And Disaster Recovery Notes
 
Big Bazaar Case study 2009
Big Bazaar Case study 2009Big Bazaar Case study 2009
Big Bazaar Case study 2009
 

Similaire à Informatica Failure recovery strategy

Bisp hfm-task-automation
Bisp hfm-task-automationBisp hfm-task-automation
Bisp hfm-task-automation
Paul Yang Yang
 
Performing a power audit
Performing a power auditPerforming a power audit
Performing a power audit
SyAM Software
 
Oracle Flashback Query 3
Oracle Flashback Query 3Oracle Flashback Query 3
Oracle Flashback Query 3
grogers1124
 
Administration settings
Administration settingsAdministration settings
Administration settings
SyAM Software
 

Similaire à Informatica Failure recovery strategy (20)

R12 d49656 gc10-apps dba 15
R12 d49656 gc10-apps dba 15R12 d49656 gc10-apps dba 15
R12 d49656 gc10-apps dba 15
 
Bisp hfm-task-automation
Bisp hfm-task-automationBisp hfm-task-automation
Bisp hfm-task-automation
 
Performing a power audit
Performing a power auditPerforming a power audit
Performing a power audit
 
Oracle Flashback Query 3
Oracle Flashback Query 3Oracle Flashback Query 3
Oracle Flashback Query 3
 
Operation Level Costing - Part 1
Operation Level Costing - Part 1Operation Level Costing - Part 1
Operation Level Costing - Part 1
 
Document
DocumentDocument
Document
 
Administration settings
Administration settingsAdministration settings
Administration settings
 
SAP HANA SPS08 Administration & Monitoring
SAP HANA SPS08 Administration & MonitoringSAP HANA SPS08 Administration & Monitoring
SAP HANA SPS08 Administration & Monitoring
 
Clontab webpage
Clontab webpageClontab webpage
Clontab webpage
 
UEMB240: Managing Your User Profile Data at Scale
UEMB240: Managing Your User Profile Data at ScaleUEMB240: Managing Your User Profile Data at Scale
UEMB240: Managing Your User Profile Data at Scale
 
optimisation de sizing abaqus.pdf
optimisation de sizing abaqus.pdfoptimisation de sizing abaqus.pdf
optimisation de sizing abaqus.pdf
 
Quick guide to plan and execute a load test
Quick guide to plan and execute a load testQuick guide to plan and execute a load test
Quick guide to plan and execute a load test
 
SAP HANA SPS09 - Backup and Recovery
SAP HANA SPS09 - Backup and RecoverySAP HANA SPS09 - Backup and Recovery
SAP HANA SPS09 - Backup and Recovery
 
8 i ha_enhance
8 i ha_enhance8 i ha_enhance
8 i ha_enhance
 
Closingcockpit
ClosingcockpitClosingcockpit
Closingcockpit
 
Sap bpc Planning and consolidation
Sap bpc Planning and consolidationSap bpc Planning and consolidation
Sap bpc Planning and consolidation
 
Closing cockpit v 1.3
Closing cockpit v 1.3Closing cockpit v 1.3
Closing cockpit v 1.3
 
SAP ADMINISTRATION
SAP ADMINISTRATIONSAP ADMINISTRATION
SAP ADMINISTRATION
 
Operating System
Operating SystemOperating System
Operating System
 
Informatica interview questions by H2kInfosys
Informatica interview questions by H2kInfosysInformatica interview questions by H2kInfosys
Informatica interview questions by H2kInfosys
 

Dernier

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 

Dernier (20)

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of Brazil
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 

Informatica Failure recovery strategy

  • 1. Failure Recovery in Informatica Restartable ETL jobs are very crucial to job failure recovery, supportability and data quality of any ETL system. In one of our prior articles we discussed different design techniques for ETL restartability, independent of the ETL tool used. We can also implement restartability in an ETL job using Informatica PowerCenter workflow recovery capabilities. In this article lets see what is required to setup an informatica workflow for recovery. What is Workflow Recovery Workflow recovery allows you to continue processing the workflow and workflow tasks from the point of interruption. During the workflow recovery process Integration Service access the workflow state, which is stored in memory or on disk based on the recovery configuration. The workflow state of operation includes the status of tasks in the workflow and workflow variable values. The configuration includes. 1. Workflow Configuration for Recovery 2. Session and Tasks Configuration for Recovery 3. Recovering the Workflow from Failure 1. Workflow Configuration for Recovery To configure a workflow for recovery, we must enable the workflow for recovery or configure the workflow to suspend on task error. Enable Recovery : When you enable a workflow for recovery, the Integration Service saves the workflow state of operation in a shared location. You can recover the workflow if it terminates, stops, or aborts. The workflow does not have to be running. We can set up the automatic recovery in the workflow as shown in below image.
  • 2. Note : An optional High Availability (HA) license is required for this check box to be available for selection. Without the HA option, workflows must be recovered manually. That is, you must locate the failed workflow in the Workflow Monitor client and manually tell PowerCenter to recover the workflow or use the command line to recover the workflow. Suspend : When you configure a workflow to suspend on error, the Integration Service stores the workflow state of operation in memory. You can recover the suspended workflow if a task fails. You can fix the task error and recover the workflow. If the workflow is not able to recover automatically from failure with in the maximum allowed number of attempts, it goes to 'suspended' state.
  • 3. We can set up the workflow to suspend on error as shown in below image. 2. Session and Tasks Configuration for Recovery Each session or task in a workflow has its own recovery strategy. When the Integration Service recovers a workflow, it recovers tasks based on the recovery strategy of each task or session specified. Three different options are available.  Restart task  Fail task and continue workflow  Resume from the last checkpoint
  • 4. Restart task : This recovery strategy is available for all type of workflow tasks. When the Integration Service recovers a workflow, it restarts each recoverable task that is configured with a restart strategy. You can configure Session and Command tasks with a restart recovery strategy. All other tasks have a restart recovery strategy by default. Fail task and continue workflow : This recovery strategy is only available for session and command tasks. When the Integration Service recovers a workflow, it does not recover the task. The task status becomes failed, and the Integration Service continues running the workflow. Configure a fail recovery strategy if you want to complete the workflow, but you do not want to recover the task. Resume from the last checkpoint : This recovery strategy is only available for session tasks. The Integration Service saves the session state of operation and maintains target recovery tables. If the session aborts, stops, or terminates, the Integration Service uses the saved recovery information to resume the session from the point of interruption. When you configure the session recovery strategy to resume from the last checkpoint, Integration Service stores the session state of operation in the shared location, $PMStorageDir. And also it is written to the recovery tables (PM_RECOVERY, PM_TGT_RUN_ID, PM_REC_STATE) to determine where to begin loading data to target tables, in case of a recovery. You can see the available session recovery options as shown in below image.
  • 5. You can see the available command task recovery options as shown in below image.
  • 6. 3. Recovering the Workflow from Failure Workflow can be either recovered automatically or manually depending on the workflow recovery strategy Recovering Automatically If you have High Availability (HA) licence and the workflow is configured to recover automatically as described above, Integration service automatically attempts to recover the workflow based on the recovery strategy set of each session or task in the workflow. If the workflow is not able to recover automatically from failure with in the maximum allowed number of attempts, it goes to 'suspended' state, which can be then manually recovered. Recovering Manually
  • 7. If you do not have High Availability (HA) licence, you can manually recover the workflow or individual tasks with in a workflow separately. You can access the options as shown in below image from the workflow manager or from the workflow monitor. Recover workflow :- Continue processing the workflow from the point of interruption. Recover Task :- Recover a session but not the rest of the workflow. Recover workflow from a task :- Recover a session and continue processing a workflow.