Loading documents from S3
Last updated
Last updated
To load documents from S3, you can create a pre-signed URL to access files inside your bucket. Use the following instructions (taken from the ).
Sign in to the AWS Management Console and open the Amazon S3 console at .
In the Buckets list, choose the name of the bucket that contains the object that you want as a pre-signed URL.
In the Objects list, select the object for which you want to create a pre-signed URL.
On the Actions menu, choose Share with a pre-signed URL.
Specify how long you want the pre-signed URL to be valid.
Choose 'Create pre-signed URL'.
When a confirmation appears, the URL is automatically copied to your clipboard. You will see a button to copy the pre-signed URL if you need to copy it again.
This will generate an URL with the following structure:
Pre-signed URLs have a maximum duration of 12 hours.
You can load the document with its signed URL to a URL data loader (see Data Loaders) which will load and parse the PDF to a vector database.
For more details on deployment see Deployer Guide.
You can try this flow in the .
Go to the section and you can call specify the signed URL in the inputs of the flow. In CuRL a simple flow works as: