Chef download file from s3 splitted

Cookbooks Cookbooks Tools. Advanced Options. Select Badges partner. I created this LWRP to solve the chicken-and-egg problem of fetching files from S3 on the first Chef run on a newly provisioned machine. Ruby libraries that are installed on that first run are not available to Chef during the run, so I couldn't use a library like Fog to get what I needed from S3. Create a free Team What is Teams?

Collectives on Stack Overflow. Learn more. Ask Question. Asked 3 years, 9 months ago. Active 3 years, 9 months ago. Viewed 2k times. Improve this question. However, if the file was uploaded to S3 via multi-part upload, then the ETag will be set to the MD5 hash of the first uploaded part.

In these cases, MD5 of the local file and remote object will never match. Note that this checksum is different from the one in S3 because the file you compare to is already decrypted so a SHA checksum is used instead of the MD5. It is not wise to check in your decryption key to your recipe. Paste that key into a file for later use. DO NOT include an endline in the file otherwise the encryption and decryption will fail.

This cookbook has Test Kitchen integration tests. To test, create a. If you're using the ChefDK then type chef exec kitchen test , otherwise kitchen test.

Adoptable Cookbooks List Looking for a cookbook to adopt? This approach works well in most instances, but what if the file is something not suited to version control such as a large binary file or perhaps a programmatically generated artifact of your system? In these cases you may prefer to store the file in an S3 bucket and automatically download a copy of the file as part of a custom recipe.