You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
it is failing after a Circus Train run with an error like so
2018-02-01 08:14:19,097 ERROR com.hotels.bdp.circustrain.housekeeping.HousekeepingRunner:66 - Housekeeping at instant 2018-01-29T16:14:18.843Z has failed
java.lang.RuntimeException: Unable to execute housekeeping at instant 1517242458843
at com.hotels.housekeeping.service.impl.FileSystemHousekeepingService.cleanUp(FileSystemHousekeepingService.java:82)
at com.hotels.bdp.circustrain.housekeeping.HousekeepingRunner.run(HousekeepingRunner.java:62)
at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:791)
at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:781)
at org.springframework.boot.SpringApplication.afterRefresh(SpringApplication.java:771)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:307)
at com.hotels.bdp.circustrain.CircusTrain.main(CircusTrain.java:97)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Caused by: java.lang.IllegalArgumentException: AWS Access Key ID and Secret Access Key must be specified as the username or password (respectively) of a s3 URL, or by setting the fs.s3.awsAccessKeyId or fs.s3.awsSecretAccessKey properties (respectively).
which indicates that the credentials aren't being passed through. This is occurring with CT 11.0.0 with no other changes made to the job in question so is most likely related to the refactoring of the HK into a separate module.
The text was updated successfully, but these errors were encountered:
When HK module is configured with credentials like so
it is failing after a Circus Train run with an error like so
which indicates that the credentials aren't being passed through. This is occurring with CT 11.0.0 with no other changes made to the job in question so is most likely related to the refactoring of the HK into a separate module.
The text was updated successfully, but these errors were encountered: