File Transfer to Amazon S3 Bucket using SFTP

RE: File Transfer to Amazon S3 Bucket using SFTP

Carlos Santander — Fri, 15 Mar 2019 12:55:15 GMT

You need to give the plugin permissions to access those credentials: docs.appian.com/.../Appian_Administration_Console.html

RE: File Transfer to Amazon S3 Bucket using SFTP

Ankur V — Thu, 14 Mar 2019 19:45:41 GMT

karthikk640 how did you resolve the accesskey issue? i am trying to use the Amazon S3 Download Objects and i'm getting "This plug-in [com.appiancorp.ps.plugins.amazonS3Utils] is not registered to access secured values for the given external system key [AWS secret key]. Check the external system’s plug-ins list in the Administration Console"

RE: File Transfer to Amazon S3 Bucket using SFTP

karthikk640 — Tue, 26 Sep 2017 14:10:48 GMT

Carlos Santander
Hello,
I was able to execute the smart service without any issues and i have not changed the plugin. The issue is with accessKey Details :-). Now the Smart service shows success but file not visible in S3 bucket might be am missing few things here with folder path and all. Working on this.

RE: File Transfer to Amazon S3 Bucket using SFTP

Carlos Santander — Thu, 21 Sep 2017 13:59:31 GMT

Yes, but you'll still need to get the credentials correctly, as was describing.

RE: File Transfer to Amazon S3 Bucket using SFTP

karthikk640 — Thu, 21 Sep 2017 13:57:15 GMT

Carlos Santander If we update the code with with new Amazon s3 java library that would be fine right?

RE: File Transfer to Amazon S3 Bucket using SFTP

Carlos Santander — Thu, 21 Sep 2017 13:51:33 GMT

The good thing is that it's really straightforward. The wrapper code to make the library work as an Appian plugin doesn't need to change at all, so it should only take around 15 minutes of work.

RE: File Transfer to Amazon S3 Bucket using SFTP

PhilB — Thu, 21 Sep 2017 13:47:40 GMT

Carlos Santander Ah well that's a problem, bit of a shame. Sorry karthikk640 , I guess you'll either need to rebuild it as above or find a different way :(

RE: File Transfer to Amazon S3 Bucket using SFTP

karthikk640 — Thu, 21 Sep 2017 13:41:52 GMT

Yeah this is how i have entered the credentials:
accesskeyId: Given my apian user name
acccessKeySecret: Given my account password

am I correct with the above?
the third one kmscmkid I have not added.

RE: File Transfer to Amazon S3 Bucket using SFTP

Carlos Santander — Thu, 21 Sep 2017 13:40:57 GMT

The plugin just uses the Amazon S3 Java library. Notice that the plugin hasn't been updated in over a year, so it currently gives an error. You need to rebuild the plugin using the latest Amazon S3 library. Check out the Amazon documentation at aws.amazon.com/.../

RE: File Transfer to Amazon S3 Bucket using SFTP

PhilB — Thu, 21 Sep 2017 13:34:26 GMT

FYI - I think this is what your credentials should look like. In this example, the first field on the smart service would be the name of the credential - in this case amazons3

RE: File Transfer to Amazon S3 Bucket using SFTP

PhilB — Thu, 21 Sep 2017 13:23:14 GMT

So, I don't think the documentation is very clear for this, but it says the following:

The plugin leverages the Appian Secure Credential Store for the credentials to integrate with Amazon S3. Before executing the plugin, create an new secure credential store with the following 3 attributes:
- accesskeyid: this is the access key id for connecting to AWS S3
- accesskeysecret: this is the access key secret for connecting to AWS S3
- kmscmkid: this attribute is only required if using AWS Client Side Encryption

Looking at the code, it seems the credential field names MUST match the ones above -
so you should have a single Third Party Credential with three fields as above, each containing the appropriate values.

Once you've got that set, up the input on the smart service named Secure Credential Store Key should be the *name* of the third party credential you have set up that contains the three values as above.

I THINK that's right - give it a go and let me know if it works. Apologies if this is what you've already done...!

RE: File Transfer to Amazon S3 Bucket using SFTP

karthikk640 — Thu, 21 Sep 2017 13:09:03 GMT

Here

Secure Credential Store Key: I have set up a key in admin console under third party credentials , selected Amazon S3 Utilities and provided my user name and password of Appian and saved.

Amazon S3 Bucket Name: Given my AWS newly created bucket name

Files: I have given a csv file

AWS server side encryption: false

AWS client side encryption: false

when I execute this am receiving an alert "java.lang.IllegalArgumentException: Access key cannot be null."

Where to setup the access key? Also where can we provide the credentials to authenticate with AWS.any thoughts from your side?

RE: File Transfer to Amazon S3 Bucket using SFTP

PhilB — Thu, 21 Sep 2017 09:58:02 GMT

I've not used it, and don't know the exact methods it uses to transfer. Perhaps you could contact the original developer or decompile the .jar file to find out?

RE: File Transfer to Amazon S3 Bucket using SFTP

karthikk640 — Thu, 21 Sep 2017 09:45:56 GMT

Did u get a chance to work on this smart service? is it same like SFTP or any additional things to be considered?

RE: File Transfer to Amazon S3 Bucket using SFTP

PhilB — Wed, 20 Sep 2017 15:23:49 GMT

Have you looked at the Amazon S3 plugin?

forum.appian.com/.../summary

RE: File Transfer to Amazon S3 Bucket using SFTP

sureshg57 — Wed, 20 Sep 2017 14:19:28 GMT

I am not much aware about S3 bucket, is this publicly accessible end point? If not, we will have to make sure that you are able to make a secured connection to the end point and your request is not blocked by firewalls and if needed may needs VPN connection to establish a connection with your Appian instance and S3.