Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DOP-4242: Use release, not tag push for CI/CD #968

Merged
merged 160 commits into from
Jan 24, 2024
Merged
Show file tree
Hide file tree
Changes from 158 commits
Commits
Show all changes
160 commits
Select commit Hold shift + click to select a range
f4b5188
experiments, added nextGenParse call to jobHandler
mmeigs Nov 14, 2023
8f941ba
stage ecs - no makefiles
mmeigs Nov 14, 2023
706af67
alter snooty version
mmeigs Nov 14, 2023
1a63501
next gen html
mmeigs Nov 15, 2023
0be0b24
command key
mmeigs Nov 15, 2023
6c43e45
parse
mmeigs Nov 15, 2023
e733122
catch
mmeigs Nov 15, 2023
2442b6f
logger
mmeigs Nov 15, 2023
901a229
remove error
mmeigs Nov 15, 2023
9aa2fd2
more logging
mmeigs Nov 15, 2023
8bd6ade
cwd
mmeigs Nov 15, 2023
c11687b
repoDir correct
mmeigs Nov 15, 2023
68eed83
quotations
mmeigs Nov 15, 2023
e9d9b36
successful parse? odd address
mmeigs Nov 15, 2023
dc4c2a1
oas page build
mmeigs Nov 16, 2023
1873ce9
xlarge
mmeigs Nov 16, 2023
478ebf3
persistence module
mmeigs Nov 17, 2023
ab4f652
quote
mmeigs Nov 17, 2023
71751a4
no parse
mmeigs Nov 17, 2023
38c0f7d
try catch parse
mmeigs Nov 17, 2023
e313e5f
type error
mmeigs Nov 17, 2023
b97835c
no parse, use persistence and build
mmeigs Nov 20, 2023
97cbc8b
log errors
mmeigs Nov 20, 2023
2832b0e
localApp working
mmeigs Nov 20, 2023
1d45d72
remove /dist
mmeigs Nov 20, 2023
11bac2c
add build deps & nextgenhtml
mmeigs Nov 22, 2023
7aee7af
add logging to build deps
mmeigs Nov 22, 2023
afadedc
log html
mmeigs Nov 22, 2023
e320a67
remove build deps for envs
mmeigs Nov 22, 2023
178e680
env vars
mmeigs Nov 22, 2023
cf18066
build deps before executeBuild
mmeigs Nov 22, 2023
3bc4550
staging monorepo jobs
mmeigs Nov 27, 2023
781b7ab
comment
mmeigs Nov 27, 2023
bae5f35
localApp type cleanup
mmeigs Nov 27, 2023
53d68da
stage
mmeigs Nov 27, 2023
62a9747
deploy
mmeigs Nov 27, 2023
733211c
clean fs
mmeigs Nov 27, 2023
2f3bebd
status
mmeigs Nov 27, 2023
6b4dcbe
no event body
mmeigs Nov 27, 2023
56b11c7
throw new error
mmeigs Nov 27, 2023
9c97ae1
commented out all unnecessary steps
mmeigs Nov 28, 2023
4cb8bbb
explicitly call build steps
mmeigs Nov 28, 2023
f11e4b5
remove steps that should not be used
mmeigs Nov 28, 2023
c3ae28e
include job inqueue for error
mmeigs Nov 28, 2023
e352d0b
Merge branch 'master' into DOP-4127-no-makefiles
mmeigs Nov 28, 2023
b576633
log status
mmeigs Nov 28, 2023
c099d3b
Empty-Commit
mmeigs Nov 29, 2023
a2e9a64
comment
mmeigs Nov 29, 2023
02aba79
used process.env to find URL and BUCKET
mmeigs Nov 29, 2023
7a10135
save localApp
mmeigs Nov 29, 2023
9e36e45
uncomment prepNextGenBuild
mmeigs Nov 29, 2023
504cb84
remove throw error
mmeigs Nov 29, 2023
0c8de69
not build on preprd
mmeigs Nov 29, 2023
62adea1
Merge branch 'master' into DOP-4127-no-makefiles
mmeigs Nov 29, 2023
86dbf92
buildCommands array
mmeigs Nov 29, 2023
857a1db
log publish
mmeigs Nov 29, 2023
d87b56e
use normal deploy
mmeigs Nov 29, 2023
cb8080e
deploy
mmeigs Nov 29, 2023
01463ff
add cp commands
mmeigs Nov 29, 2023
0a2c7b5
cd snooty
mmeigs Nov 29, 2023
c0717cf
log outputs
mmeigs Nov 29, 2023
02b61af
ref repoDir rather than cwd
mmeigs Nov 29, 2023
a3cbc72
correct reposDir vs repoDir
mmeigs Nov 29, 2023
7d0ba08
add slash
mmeigs Nov 29, 2023
375a97d
add repos to prodFileName
mmeigs Nov 29, 2023
482f841
log build deps
mmeigs Nov 30, 2023
9f82e55
change prodFIleName to cwd/snooty
mmeigs Nov 30, 2023
93fbc40
run parse
mmeigs Nov 30, 2023
68137c4
remove deploy
mmeigs Nov 30, 2023
be0d0a0
merged latest master
mmeigs Nov 30, 2023
c386506
override build in stagingJobHandler
mmeigs Nov 30, 2023
6534d77
override build, set up debugger
mmeigs Nov 30, 2023
d86040f
vscode launch
mmeigs Nov 30, 2023
fe4ddca
remove dist
mmeigs Dec 1, 2023
8d7182f
remove dist
mmeigs Dec 1, 2023
312ba00
use project
mmeigs Dec 4, 2023
3c7156d
readd build deps
mmeigs Dec 4, 2023
22d75fd
add cp and cd commands to nextGenHtml
mmeigs Dec 4, 2023
6ae841f
cp correct paths
mmeigs Dec 4, 2023
21207c7
remove first cp and cd
mmeigs Dec 4, 2023
e494c7f
remove cp
mmeigs Dec 4, 2023
8f48f51
ref snooty filepath correctly
mmeigs Dec 4, 2023
b87d85c
dockerfile snooty branch mm-log
mmeigs Dec 4, 2023
f1b6e57
remove first cp
mmeigs Dec 4, 2023
f48ac30
cd ..
mmeigs Dec 5, 2023
f24ef53
commands
mmeigs Dec 5, 2023
76a0677
stringify, logs
mmeigs Dec 5, 2023
901792c
use chdir
mmeigs Dec 5, 2023
5254b44
cp second
mmeigs Dec 5, 2023
09cc84a
log in clicommand
mmeigs Dec 5, 2023
94312e8
pass logger to mut publish
mmeigs Dec 5, 2023
f502182
dotcomstg -> stg
mmeigs Dec 5, 2023
52590c4
checkout and pull branch
mmeigs Dec 5, 2023
243ac89
add pull repo and change clone
mmeigs Dec 5, 2023
32496d4
commented out incorrect code
mmeigs Dec 5, 2023
b770001
local run works for both cloud-docs and monorepo/cloud-docs
mmeigs Dec 7, 2023
3667b5d
log event and boyd
mmeigs Dec 7, 2023
2650e8f
log out trigger build
mmeigs Dec 7, 2023
0108bc4
log repo name and feat flag
mmeigs Dec 7, 2023
150b11f
feature flag
mmeigs Dec 7, 2023
39d84b8
ssmprefix
mmeigs Dec 7, 2023
a249c26
env
mmeigs Dec 7, 2023
178a527
dist
mmeigs Dec 7, 2023
a6f3261
remove feature flag for feature branch build
mmeigs Dec 7, 2023
f0b535c
log why no paths
mmeigs Dec 7, 2023
045180b
change slash of path
mmeigs Dec 7, 2023
1d69643
clean
mmeigs Dec 7, 2023
7713c19
organize code
mmeigs Dec 8, 2023
c6c5c69
clean
mmeigs Dec 8, 2023
f796c4a
redoc
mmeigs Dec 8, 2023
ffbc331
Co-authored-by: Brandon Ly <[email protected]>
mmeigs Dec 8, 2023
39837b4
fixes from merge
mmeigs Dec 8, 2023
c3313a3
comment out builddeps, use redoc rc
mmeigs Dec 11, 2023
40e5c26
duplicate clone
mmeigs Dec 11, 2023
c25b533
clean, get bucket and url
mmeigs Dec 11, 2023
248df20
log env vars
mmeigs Dec 11, 2023
d23da3c
pass logger to getEnvVar
mmeigs Dec 11, 2023
c0c4c57
takeover preprd
mmeigs Dec 11, 2023
2adf502
add to v1?
mmeigs Dec 11, 2023
4c8d4c3
log which build
mmeigs Dec 11, 2023
64cf314
force directory
mmeigs Dec 11, 2023
07967fb
add directory to debug command and local build
mmeigs Dec 12, 2023
2a8386b
remove from preprd
mmeigs Dec 12, 2023
f5dbead
clean up
mmeigs Dec 12, 2023
07caee9
keep conditionals for buildCommands in normal build
mmeigs Dec 12, 2023
e45fce2
further cleaning
mmeigs Dec 12, 2023
5c558da
remove logs
mmeigs Dec 12, 2023
4ac7b01
number of logs
mmeigs Dec 12, 2023
b57f0ac
curl into repoDir/targetDir
mmeigs Dec 12, 2023
493edaa
try new flow of logging
mmeigs Dec 13, 2023
52b2f15
remove comments
mmeigs Dec 13, 2023
492d7c5
allow output and error text to be returned from nextGenStage
mmeigs Dec 13, 2023
7f3299d
clean logs
mmeigs Dec 14, 2023
b8dec8c
revert targetDir for downloadBuildDependencies
mmeigs Dec 14, 2023
bfe3cbd
clean, wrapWithBenchmark
mmeigs Dec 14, 2023
93d2642
Merge branch 'master' into DOP-4127-no-makefiles
mmeigs Dec 14, 2023
038337f
PR feedback
mmeigs Dec 15, 2023
211d1c2
[DOP-4127]: Update dockerfile.local to have redoc installed properly
branberry Dec 18, 2023
841e6f4
[DOP-4127]: Use new SQS queue URL
branberry Dec 18, 2023
033d58a
[DOP-4127]: Install redoc bundle
branberry Dec 18, 2023
1eaf867
[DOP-4127]: Revert how redoc is installed
branberry Dec 18, 2023
c4052bb
PR feedback, second round
mmeigs Dec 19, 2023
64e6af4
Merge branch 'master' into DOP-4127-no-makefiles
mmeigs Dec 19, 2023
d1367a7
replace useWithBenchmarks with isNextGen
mmeigs Dec 19, 2023
e16a789
source patchId from getBuildAndGetDependencies
mmeigs Dec 20, 2023
ffe258c
Merge branch 'master' into DOP-4127-no-makefiles
mmeigs Dec 20, 2023
58b7c14
[DOP-4204]: Update README for local Autobuilder (#954)
branberry Jan 2, 2024
f7d968f
added logging and error throwing in wrapWithBenchmark
mmeigs Jan 3, 2024
8e5e756
conditionally write patchId and commitHash env vars
mmeigs Jan 3, 2024
61e3609
merge conflicts
mayaraman19 Jan 19, 2024
818b20b
changed instances of tag to release
mayaraman19 Jan 19, 2024
6001f07
merge conflixts again
mayaraman19 Jan 19, 2024
e6bf21a
and once more
mayaraman19 Jan 19, 2024
e4c7030
Merge branch 'master' into DOP-4242
mayaraman19 Jan 19, 2024
1cf4dbc
Merge branch 'master' into DOP-4242
mayaraman19 Jan 22, 2024
bea5ca8
Updating workflows README
mayaraman19 Jan 23, 2024
57b0316
Updating base README
mayaraman19 Jan 23, 2024
27c21ee
updating readme
mayaraman19 Jan 23, 2024
57abc63
removing space, adding clarification
mayaraman19 Jan 24, 2024
76300a9
Merge branch 'master' into DOP-4242
mayaraman19 Jan 24, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 8 additions & 0 deletions .github/workflows/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,14 @@

This README describes the various workflows defined for the docs-worker-pool repository.

## Releases

The release process occurs whenever someone releases a specific tag via the GitHub UI. Three separate workflows are run upon release:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

minor nitpick. not specific to the Github UI


1. `deploy-prd-ecs.yml` - Builds and deploys the old Autobuilder to prd
2. `deploy-prd-enhanced-webhooks.yml` - Builds and deploys webhooks (GitHub and Slack handlers) for the enhanced Autobuilder
3. `deploy-prd-enhanced-worker.yml` - Builds and deploys the Autobuilder worker to prd

## Feature Branch Deploys

The feature branch deploy process occurs whenever a developer opens a pull request. It consists of three separate workflows:
Expand Down
5 changes: 2 additions & 3 deletions .github/workflows/deploy-prd-ecs.yml
Original file line number Diff line number Diff line change
@@ -1,7 +1,6 @@
on:
push:
tags:
- 'v*'
release:
types: [released]
seungpark marked this conversation as resolved.
Show resolved Hide resolved
concurrency:
group: environment-prd-${{ github.ref }}
cancel-in-progress: true
Expand Down
6 changes: 2 additions & 4 deletions .github/workflows/deploy-prd-enhanced-webhooks.yml
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
on:
push:
tags:
- 'v*'

release:
types: [released]
concurrency:
group: environment-prd-enhanced-webhooks-${{ github.ref }}
cancel-in-progress: true
Expand Down
6 changes: 2 additions & 4 deletions .github/workflows/deploy-prd-enhanced-worker.yml
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
on:
push:
tags:
- 'v*'

release:
types: [released]
concurrency:
group: environment-prd-enhanced-worker-${{ github.ref }}
cancel-in-progress: true
Expand Down
3 changes: 2 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -157,7 +157,8 @@ docs-worker-pool contains various triggers for release to higher environments. C

- Create release tags. We currently follow [semver](https://semver.org/) standards.
- If you don't have push access, open an issue or otherwise contact a contributor with administrator privileges.
- Verify that the deploy-production-ec2 workflow executed successfully for both job runs across both production instances.
- Create a release associated with the tag using the GitHub UI or by running `gh release create`.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

might be an extra space at end of line, based on error

- Verify that the deploy-production-ec2 workflow executed successfully for both job runs across both production instances. The workflow should only run when a release is published.

### Serverless Development

Expand Down
Loading