Skip Ribbon Commands
Skip to main content
Navigate Up
Sign In

Quick Launch

Average Rating:

facebook Twitter
Email
Print Bookmark Alert me when this article is updated

Feedback

FAQ: Is it possible to use different YARN queues for running different jobs with Blaze Engine in Informatica BDM?
Answer
Informatica BDM supports execution of mappings in the Hadoop Environment. For running mappings in Hadoop Environments, one of the following execution engines can be chosen:

 

  1. Spark Engine
  2. Blaze Engine
  3. Hive Engine ('Map Reduce' or 'Tez' modes)  (Available in Pre-Informatica 10.2.2 versions and not available from Informatica 10.2.2 version onwards)

  

Informatica Blaze engine integrates with Apache Hadoop YARN to provide intelligent data pipelining, job partitioning, job recovery, and high-performance scaling. Blaze Engine consists of 'Blaze Grid Manager' and 'Blaze Job Monitor' applications, which would be running in one of the Hadoop Data Node machines.

 

It would be possible to configure the YARN queue that should be used for running Blaze Grid Manager application and hence, all the Blaze Engine jobs. All the Blaze Engine jobs would be using the same YARN queue, used by the Blaze Grid Manager application. For more information on configuring YARN Queue to be used with Blaze Engine, refer to KB 531589.

 

Informatica_connection_blaze_custom_yarn_queue.jpg

However, it would not be possible to use different queues for running different jobs with Blaze Engine, while it has been already started and using a specific YARN Queue.


More Information

Applies To
Product: Big Data Management; Big Data Quality; Enterprise Data Preparation
Problem Type: Configuration; Sizing
User Type: Administrator; Architect; Developer
Project Phase: Configure; Onboard
Product Version: Informatica 10.1.1; HotFix; Informatica 10.2; Informatica 10.2.1
Database:
Operating System:
Other Software:

Reference

Attachments

Last Modified Date:7/21/2019 7:28 AMID:532962
People who viewed this also viewed

Feedback

Did this KB document help you?



What can we do to improve this information (2000 or fewer characters)