Skip Ribbon Commands
Skip to main content
Navigate Up
Sign In

Quick Launch

Average Rating:

facebook Twitter
Email
Print Bookmark Alert me when this article is updated

Feedback

Data Preview on Hive/HDFS objects fails after enabling OS Profile
Problem Description
Data Preview for the Hadoop objects fails from Developer Client (It could happen at any downstream transformations when the source is Hadoop object - say Hive table).

Error Log Trace:

 

2019-06-19 05:06:04.522 <DTFPool-3-thread-10> FINEST: Encountered Read_CopyOf_event_info

2019-06-19 05:06:04.799 <DTFPool-3-thread-10> INFO: [CLUSTERCONF_10021] Exporting the cluster configuration [GCS_CDH_Multi_Node_Cluster_ths] to file [/home/ths/dis_osp_ths/disTemp/D_indthsbde_1011/dis_bdm_cdh_osp/gcs_cdh_multi_node_cluster_ths/infacco-site.xml].

2019-06-19 05:06:04.843 <DTFPool-3-thread-10> SEVERE: Data integration service failed to create DTM instance because of the following error:

com.informatica.sdk.dtm.InvalidMappingException: [CLUSTERCONF_10011] Failed to export the cluster configuration [GCS_CDH_Multi_Node_Cluster_ths] to file [/home/ths/dis_osp_ths/disTemp/D_indthsbde_1011/dis_bdm_cdh_osp/gcs_cdh_multi_node_cluster_ths/infacco-site.xml] because of the following error: [java.io.FileNotFoundException: /home/ths/dis_osp_ths/disTemp/D_indthsbde_1011/dis_bdm_cdh_osp/gcs_cdh_multi_node_cluster_ths/infacco-site.xml (Permission denied)].

[com.informatica.sdk.dtm.InvalidMappingException: [CLUSTERCONF_10011] Failed to export the cluster configuration [GCS_CDH_Multi_Node_Cluster_ths] to file [/home/ths/dis_osp_ths/disTemp/D_indthsbde_1011/dis_bdm_cdh_osp/gcs_cdh_multi_node_cluster_ths/infacco-site.xml] because of the following error: [java.io.FileNotFoundException: /home/ths/dis_osp_ths/disTemp/D_indthsbde_1011/dis_bdm_cdh_osp/gcs_cdh_multi_node_cluster_ths/infacco-site.xml (Permission denied)].

        at com.informatica.platform.ldtm.util.cco.CCOReferenceUtils.exportCCOToXML(CCOReferenceUtils.java:113)

        at com.informatica.platform.ldtm.util.cco.CCOReferenceUtils.exportClusterConfiguration(CCOReferenceUtils.java:88)

        at com.informatica.platform.ldtm.expansion.ExpansionDriver.visitInstance(ExpansionDriver.java:815)

        at com.informatica.platform.ldtm.expansion.DagOpTraversal.traverse(DagOpTraversal.java:65)

        at com.informatica.platform.ldtm.expansion.ExpansionDriver.expandTxs(ExpansionDriver.java:572)

        at com.informatica.platform.ldtm.expansion.ExpansionDriver.visitInstance(ExpansionDriver.java:862)

        at com.informatica.platform.ldtm.expansion.DagOpTraversal.traverse(DagOpTraversal.java:65)

        at com.informatica.platform.ldtm.expansion.ExpansionDriver.expandTxs(ExpansionDriver.java:572)

       at com.informatica.platform.ldtm.expansion.ExpansionDriver.visitInstance(ExpansionDriver.java:862)

        at com.informatica.platform.ldtm.expansion.DagOpTraversal.traverse(DagOpTraversal.java:65)

        at com.informatica.platform.ldtm.expansion.ExpansionDriver.expandTxs(ExpansionDriver.java:572)

        at com.informatica.platform.ldtm.expansion.ExpansionDriver.expandMapping(ExpansionDriver.java:489)

        at com.informatica.platform.ldtm.expansion.ExpansionDriver.expandMapping(ExpansionDriver.java:460)

        at com.informatica.platform.ldtm.compiler.Compiler.expand(Compiler.java:173)

        at com.informatica.platform.ldtm.compiler.Compiler.compile(Compiler.java:121)

        at com.informatica.platform.ldtm.compiler.Compiler.compile(Compiler.java:84)

        at com.informatica.platform.ldtm.impl.TransformationMachineImpl.compile(TransformationMachineImpl.java:3549)

        at com.informatica.platform.ldtm.impl.TransformationMachineImpl.<init>(TransformationMachineImpl.java:659)

        at com.informatica.platform.ldtm.TransformationMachineFactoryImpl.createInstance(TransformationMachineFactoryImpl.java:480)

        at com.informatica.ds.server.impl.TransformationMachineDISImpl.getLocalTxMachineInfo(TransformationMachineDISImpl.java:299)

        at com.informatica.ds.server.impl.TransformationMachineDISImpl.getLocalDtm(TransformationMachineDISImpl.java:988)

        at com.informatica.ds.server.impl.TransformationMachineDISImpl.markOutputStreamAsEncodedXML(TransformationMachineDISImpl.java:345)

        at com.informatica.ds.ms.service.MappingServiceUtils.createDtmOutputStreams(MappingServiceUtils.java:290)

        at com.informatica.ds.ms.service.MappingServiceImpl.asyncExecuteNow2(MappingServiceImpl.java:2428)

        at com.informatica.ds.ms.service.MappingServiceImpl.asyncExecuteNow(MappingServiceImpl.java:2364)

        at com.informatica.ds.ms.service.MappingServiceImpl.executeMappingUsingMultipleStreams(MappingServiceImpl.java:999)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:498)

        at com.informatica.pcsf.servicesframework.service.impl.ServiceRequestHandler$MethodInvokeRequestHandler.getMethodResult(ServiceRequestHandler.java:704)

        at com.informatica.pcsf.servicesframework.service.impl.ServiceRequestHandler$ResilientMethodInvokeRequestHandler.executeRequest(ServiceRequestHandler.java:917)

        at com.informatica.pcsf.servicesframework.service.impl.ServiceRequestHandler$ResilientMethodInvokeRequestHandler.handle(ServiceRequestHandler.java:828)

        at com.informatica.pcsf.servicesframework.service.impl.ServiceRequestHandler.handleMethodInvokeRequest(ServiceRequestHandler.java:214)

        at com.informatica.pcsf.servicesframework.service.impl.ServiceRequestHandler.onReceiveRequest(ServiceRequestHandler.java:133)

        at com.informatica.pcsf.datatransport.impl.RequestHandlerImpl.receiveMSG(RequestHandlerImpl.java:39)

        at org.beepcore.beep.core.ChannelImpl.run(ChannelImpl.java:386)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

        at java.lang.Thread.run(Thread.java:748)

Caused by: com.informatica.cluster.conf.biz.exception.ClusterConfException: [CLUSTERCONF_10011] Failed to export the cluster configuration [GCS_CDH_Multi_Node_Cluster_ths] to file [/home/ths/dis_osp_ths/disTemp/D_indthsbde_1011/dis_bdm_cdh_osp/gcs_cdh_multi_node_cluster_ths/infacco-site.xml] because of the following error: [java.io.FileNotFoundException: /home/ths/dis_osp_ths/disTemp/D_indthsbde_1011/dis_bdm_cdh_osp/gcs_cdh_multi_node_cluster_ths/infacco-site.xml (Permission denied)].

        at com.informatica.cluster.conf.biz.hadoop.HadoopClusterConfUtil.exportClusterConf(HadoopClusterConfUtil.java:165)

 

        at com.informatica.cluster.conf.biz.hadoop.HadoopClusterConfUtil.exportClusterConf(HadoopClusterConfUtil.java:130)

        at com.informatica.cluster.conf.biz.hadoop.HadoopClusterConfUtil.exportClusterConf(HadoopClusterConfUtil.java:98)

        at com.informatica.platform.ldtm.util.cco.CCOReferenceUtils.exportCCOToXML(CCOReferenceUtils.java:111)

        ... 36 more

]

Cause
​The error happened due to insufficient permissions to create infacco-site.xml under disTemp of OS Profile user.
Solution
​'disTemp' folder (associated with the OS Profile) must have 777 permissions. It also should have 'execute' permission for all users on 'disTemp' parent folder. 
More Information
Isolation steps carried out:

 

·       Created the folder mkdir -p /home/ths/dis_osp_ths/disTemp/D_indthsbde_1011/dis_bdm_cdh_osp/gcs_cdh_multi_node_cluster_ths/

·       Changed the disTemp permissions to '777'.

·       Tried creating file as 'infapc' user

 

[infapc@indthsbde002 bin]$ touch /home/ths/dis_osp_ths/disTemp/D_indthsbde_1011/dis_bdm_cdh_osp/gcs_cdh_multi_node_cluster_ths/infacco-site.xml

touch: cannot touch â/home/ths/dis_osp_ths/disTemp/D_indthsbde_1011/dis_bdm_cdh_osp/gcs_cdh_multi_node_cluster_ths/infacco-site.xmlâ: Permission denied

 

·       Later provided execute permission on the 'Home' folder '/home/ths' and then executed the 'touch' command. It got completed successfully and the file got created

 

touch /home/ths/dis_osp_ths/disTemp/D_indthsbde_1011/dis_bdm_cdh_osp/gcs_cdh_multi_node_cluster_ths/infacco-site.xml

 

·       Summary is that 'disTemp' should be outside the "OS Profile user' Home folder & it should have '777' permissions.

 

[ths@indthsbde002 gcs_cdh_multi_node_cluster_ths]$ ll

total 32

-rw-r--r-- 1 infapc infapc 31025 Jun 19 05:33 infacco-site.xml​

Applies To
Product: Data Engineering Integration(Big Data Management)
Problem Type: Configuration
User Type: Developer
Project Phase: Configure; Implement
Product Version:
Database:
Operating System:
Other Software:

Reference
Attachments
Last Modified Date:11/19/2019 1:27 AMID:604874
People who viewed this also viewed

Feedback

Did this KB document help you?



What can we do to improve this information (2000 or fewer characters)