Bugfix for lambda module

Description

This release simply bumps the version of the lambda module to fix a bug in the underlying module.

Otherwise, all modules are now public - the demo may be run by anyone now.

Full Changelog: 1.0.0...1.0.1

Feedback

Submit suggestions for improvements to [email protected].

Initial release

Description

This is the initial release of a fully modularised data-drive Terraform demonstration repository.

It fully models, end-to-end, a simple extract, transform load (ETL) process as outlined in the below mermaid diagram:

---
title: Demo workflow
---
flowchart TD
    start((.ZIP uploaded to s3://raw/dogs/landing prefix))
    bucketNotification(Bucket notification)

    subgraph UnzipLambda
        lambdaStart(For each file in .ZIP)
        startPartition(Grabs year/month/day from filename)
        uploads(Uploads to s3://processed/dogs/daily/<partition>)

    end

    sns[\Send failure notification to topic/]
    endNode((Processed complete))

    start -- triggers --> bucketNotification
    bucketNotification -- triggers --> UnzipLambda

    lambdaStart --> startPartition
    startPartition --> uploads
    uploads -- If all succeed --> endNode
    uploads -- If fail --> sns
    sns --> endNode

Whilst also providing an instantiation of the most basic data-driven Terraform module - sudoblark.terraform.module.aws.s3_files - for reference in a conference/workshop setting.

Its counterpart may be considered sudoblark.terraform.github which fully models management of a SaaS product in an mono-repo setup.

What's Changed

• Initial bootstrap of repo with terraform modules by @benjaminlukeclark in #10
• Create S3 buckets by @benjaminlukeclark in #11
• Create failure SNS topic by @benjaminlukeclark in #12
• Create unzip lambda code and s3 bucket prefixes by @benjaminlukeclark in #13
• Removed un-needed state_machine and event_bridge_rule modules by @benjaminlukeclark in #14
• Create unzip S3 bucket notification by @benjaminlukeclark in #15
• Document infrastructure and workflow by @benjaminlukeclark in #18
• Fix bugs causing ETL to fail by @benjaminlukeclark in #19
• Populate dummy s3_files by @benjaminlukeclark in #20

New Contributors

• @benjaminlukeclark made their first contribution in #10

Full Changelog: https://github.com/sudoblark/sudoblark.terraform.modularised-demo/commits/1.0.0

Feedback

Submit suggestions for improvements to [email protected].