In PowerCenter 8.6, records rejected at Expression transformation are not shown in the rejected record count in the Workflow Monitor.
PowerCenter mapping reads 218 records from flat file source. There is an Expression transformation in the mapping that uses TO_DATE function to convert varchar data to DATE data type. Due to validation error 197 records failed to process. However, the Workflow Monitor does not show the correct statistics and the rejected records are missing in bad file.
The Workflow Monitor shows the following run statistics:
The Workflow Monitor displays the rejected record statistics, only if the record rejection happens at Source or Target table level. If the records fail during processing after Source level and before reaching Target level then the Workflow Monitor does not consider it for the Workflow Monitor statistics. Rejected records are not moved to bad file.
This behaviour is as designed and feature request 202690 has submitted for the same.
Use the following work around for this issue:
An error file PMError.log is created at <PowerCenter installation directory>\server\infa_shared\BadFiles. This file stores all the details about the run time rejection, like the Transformation name and why the record was rejected.
You can also store this information in a relational table instead of a flat file. In that case, select Error Log Type as Relational Database and provide relational connection details.
For more information on logging error information, see Row Error Logging in PowerCenter Advanced Workflow Guide.
What can we do to improve this information (2000 or fewer characters)