Skip Ribbon Commands
Skip to main content
Navigate Up
Sign In

Quick Launch

Average Rating:

facebook Twitter
Email
Print Bookmark Alert me when this article is updated

Feedback

ERROR: "Failed to process data: ExcelToDataXml: java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)" when running an UDT in PowerCenter
Problem Description
Session using UDT transformation fails with the below error when processing huge files (greater than 1 GB):

[ERROR] Failed to process data: ExcelToDataXml: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at itemfield.main.ExcelToXmlDataOnly.process(ExcelToXmlDataOnly.java:137)
Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded
at java.util.zip.InflaterInputStream.<init>(InflaterInputStream.java:88)
at java.util.zip.ZipFile$ZipFileInflaterInputStream.<init>(ZipFile.java:413)
at java.util.zip.ZipFile.getInputStream(ZipFile.java:394)
at itemfield.excel2007.main.Excel2007ToDataXml_imp.unZipFile(Excel2007ToDataXml_imp.java:290)
at itemfield.excel2007.main.Excel2007ToDataXml_imp.process(Excel2007ToDataXml_imp.java:83)

The same session runs fine when the input is below 500 MB.

Cause
The issue was caused due to insufficient Java heap space. The Integration Service process was not able to allocate enough heap space to process the huge file.
Solution
Following changes need to be made to resolve the issue:
  • ​​Add the following custom properties to the Integration Service. Recycle the Integration service after making this change:
Name : JVMMaxMemory    Value : 8192M
Name : JVMMinMemory     Value : 1024M
Name : JVMOption1          Value : -XX:+UseConcMarkSweepGC
  • Make the below change to the CMConfig.xml file:
<JVMInitParamList><InitParam>-Xmx8192M</InitParam></JVMInitParamList>

More Information
Note

The heap space values depend on the environment as well as the amount of incoming data.
In case there are other java related sessions (web consumer/java transformation etc) running at the same time as this, then heap space needs to be calculated accordingly.

Applies To
Product: PowerCenter
Problem Type: Performance
User Type: Developer; Administrator
Project Phase: Implement; Configure
Product Version:
Database:
Operating System:
Other Software:

Reference
Attachments
Last Modified Date:8/8/2020 12:48 AMID:625994
People who viewed this also viewed

Feedback

Did this KB document help you?



What can we do to improve this information (2000 or fewer characters)