Skip Ribbon Commands
Skip to main content
Navigate Up
Sign In

Quick Launch

Average Rating:

facebook Twitter
Email
Print Bookmark Alert me when this article is updated

Feedback

ERROR: "shade.com.amazonaws.services.s3.model.AmazonS3Exception: Access Denied (Service: Amazon S3; Status Code: 403; Error Code: AccessDenied; Request ID: 74BA6EE467138486)" occurs during metadata scan in Amazon S3 scanner
Problem Description
During metadata scan the following error occurs:

com.infa.products.ldm.filescanner.file.group.api.GroupExecutionException: shade.com.amazonaws.services.s3.model.AmazonS3Exception: Access Denied (Service: Amazon S3; Status Code: 403; Error Code: AccessDenied; Request ID: 74BA6EE467138486), S3 Extended Request ID: z/9u9y8W/tfEFoepJta6qmI3xdE5iashFTWXZGaK5gqk6bKp6cGWGz4FJ+ocBBNWhdsnL5BXEY4=
at com.infa.products.ldm.filescanner.FileExecutor.execute(FileExecutor.java:118)
at com.infa.products.ldm.framework.scanner.execution.impl.ScannerTask.execute(ScannerTask.java:248)
at com.infa.products.ldm.framework.orchestration.taskexec.OrchestrationTask.call(OrchestrationTask.java:71)
at com.infa.products.ldm.framework.orchestration.taskexec.CustomFutureTask$Computation$1.call(CustomFutureTask.java:52)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at com.infa.products.ldm.framework.orchestration.taskexec.CustomFutureTask.run(CustomFutureTask.java:45)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)​
Cause
This issue occurs if S3 Certificates are missing in Informatica Truststore (infa_truststore.jks).
Solution
To resolve this issue, perform the following steps:

​Since S3 is SSL enabled, import s3 cert into domain infa_truststore.jks file

  1. Go to browser > on the top left click on the lock symbol in the browser, Certificate > Detail > Copy to file.

  2. Copy the s3 cert into the domain server (WinSCP).

  3. Navigate to <INFA_HOME>/services/shared/security.

  4. Command to import:

    ​keytool -import -noprompt -file <INFA_HOME>/certs3.cer -alias 'aws_s3' -keystore infa_truststore.jks -storepass pass2038@infaSSL

  5. Command to check/list the certs: 

     keytool -list -keystore infa_truststore.jks -storepass pass2038@infaSSL
    keytool -list -keystore infa_truststore.jks -storepass pass2038@infaSSL -alias aws_s3 -v

  6. Import cacert from <INFA_HOME>/java/jre/lib/security into infa_truststore.jks 

    keytool -importkeystore -srckeystore <INFA_HOME>/java/jre/lib/security/cacerts -srcstorepass changeit -destkeystore 
    <INFA_HOME>/services/shared/security/infa_truststore.jks -deststorepass pass2038@infa<INFA_HOME>​SSL

  7. Ensure https is included in the s3 Buck Url in ldm admin resource configuration.
More Information
Complete error from Scanner Log:

​2019-08-09 15:05:37,798 [ExecuteThread-{Task_DQM_Data_Environment_AmazonS3Scanner_CORE}] ERROR com.infa.products.ldm.filescanner.file.group.impl.FileGroupCreator- An error occurred during FileGroup Creator execution java.util.concurrent.ExecutionException: com.infa.products.ldm.filescanner.file.group.api.GroupExecutionException: shade.com.amazonaws.services.s3.model.AmazonS3Exception: Access Denied (Service: Amazon S3; Status Code: 403; Error Code: AccessDenied; Request ID: 74BA6EE467138486), S3 Extended Request ID: z/9u9y8W/tfEFoepJta6qmI3xdE5iashFTWXZGaK5gqk6bKp6cGWGz4FJ+ocBBNWhdsnL5BXEY4=
2019-08-09 15:05:37,798 [ExecuteThread-{Task_DQM_Data_Environment_AmazonS3Scanner_CORE}] ERROR com.infa.products.ldm.filescanner.FileExecutor- An error occurred during File Grouper execution: com.infa.products.ldm.filescanner.file.group.api.GroupExecutionException: java.util.concurrent.ExecutionException: com.infa.products.ldm.filescanner.file.group.api.GroupExecutionException: shade.com.amazonaws.services.s3.model.AmazonS3Exception: Access Denied (Service: Amazon S3; Status Code: 403; Error Code: AccessDenied; Request ID: 74BA6EE467138486), S3 Extended Request ID: z/9u9y8W/tfEFoepJta6qmI3xdE5iashFTWXZGaK5gqk6bKp6cGWGz4FJ+ocBBNWhdsnL5BXEY4=
2019-08-09 15:05:37,804 [ExecuteThread-{Task_DQM_Data_Environment_AmazonS3Scanner_CORE}] INFO  com.infa.products.ldm.common.ServiceabilityImpl- [AuditTrail [runId=8397e30c-3e97-49a1-89c9-4002775f3932, userId=AmazonS3Scanner, startTime=Fri Aug 09 15:05:34 EDT 2019, endTime=Fri Aug 09 15:05:37 EDT 2019, operationName=File Grouper, changes={}, outcome=FAILURE, context={TASK_ID=d618fb49-586e-465e-8c9e-5d951795c37e, MessageParameters=null}]]
2019-08-09 15:05:37,838 [DTF-ThreadGroup-2-thread-7] ERROR org.beepcore.beep.transport.tcp.TCPNonBlockingSession- Received an error in response to a start. code=451 diagnostic=Secure connection is required.
2019-08-09 15:05:38,120 [ExecuteThread-{Task_DQM_Data_Environment_AmazonS3Scanner_CORE}] INFO  com.infa.products.ldm.framework.orchestration.taskexec.OrchestrationTask- Task [Task_DQM_Data_Environment_AmazonS3Scanner_CORE] checkpoint updated. Checkpoint = {propertyName='FileProgressState', propertyValue='File Initialize'}
2019-08-09 15:05:38,120 [ExecuteThread-{Task_DQM_Data_Environment_AmazonS3Scanner_CORE}] ERROR com.infa.products.ldm.framework.scanner.execution.impl.ScannerTask- {RunId=8397e30c-3e97-49a1-89c9-4002775f3932}{Resource=DQM_Data_Environment}{ScannerId=AmazonS3Scanner} Error occured in scanner execution com.infa.products.ldm.filescanner.file.group.api.GroupExecutionException: java.util.concurrent.ExecutionException: com.infa.products.ldm.filescanner.file.group.api.GroupExecutionException: shade.com.amazonaws.services.s3.model.AmazonS3Exception: Access Denied (Service: Amazon S3; Status Code: 403; Error Code: AccessDenied; Request ID: 74BA6EE467138486), S3 Extended Request ID: z/9u9y8W/tfEFoepJta6qmI3xdE5iashFTWXZGaK5gqk6bKp6cGWGz4FJ+ocBBNWhdsnL5BXEY4=
com.infa.products.ldm.scanner.api.ScannerExecutionException: com.infa.products.ldm.filescanner.file.group.api.GroupExecutionException: java.util.concurrent.ExecutionException: com.infa.products.ldm.filescanner.file.group.api.GroupExecutionException: shade.com.amazonaws.services.s3.model.AmazonS3Exception: Access Denied (Service: Amazon S3; Status Code: 403; Error Code: AccessDenied; Request ID: 74BA6EE467138486), S3 Extended Request ID: z/9u9y8W/tfEFoepJta6qmI3xdE5iashFTWXZGaK5gqk6bKp6cGWGz4FJ+ocBBNWhdsnL5BXEY4=
at com.infa.products.ldm.filescanner.FileExecutor.execute(FileExecutor.java:118)
at com.infa.products.ldm.framework.scanner.execution.impl.ScannerTask.execute(ScannerTask.java:248)
at com.infa.products.ldm.framework.orchestration.taskexec.OrchestrationTask.call(OrchestrationTask.java:71)
at com.infa.products.ldm.framework.orchestration.taskexec.CustomFutureTask$Computation$1.call(CustomFutureTask.java:52)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at com.infa.products.ldm.framework.orchestration.taskexec.CustomFutureTask.run(CustomFutureTask.java:45)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: com.infa.products.ldm.filescanner.file.group.api.GroupExecutionException: java.util.concurrent.ExecutionException: com.infa.products.ldm.filescanner.file.group.api.GroupExecutionException: shade.com.amazonaws.services.s3.model.AmazonS3Exception: Access Denied (Service: Amazon S3; Status Code: 403; Error Code: AccessDenied; Request ID: 74BA6EE467138486), S3 Extended Request ID: z/9u9y8W/tfEFoepJta6qmI3xdE5iashFTWXZGaK5gqk6bKp6cGWGz4FJ+ocBBNWhdsnL5BXEY4=
at com.infa.products.ldm.filescanner.file.group.impl.FileGroupCreator.getFileGroups(FileGroupCreator.java:100)
at com.infa.products.ldm.filescanner.FileGrouper.execute(FileGrouper.java:47)
at com.infa.products.ldm.filescanner.FileExecutor.getFileGroups(FileExecutor.java:375)
at com.infa.products.ldm.filescanner.FileExecutor.execute(FileExecutor.java:114)
... 8 more
Applies To
Product: Enterprise Data Catalog
Problem Type: Product Feature; Configuration
User Type: Administrator; Business Analyst
Project Phase: Implement; Configure
Product Version:
Database:
Operating System:
Other Software:

Reference
Attachments
Last Modified Date:11/6/2019 3:33 AMID:587368
People who viewed this also viewed

Feedback

Did this KB document help you?



What can we do to improve this information (2000 or fewer characters)