Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Switch to ICU tokenizer #939

Open
wants to merge 6 commits into
base: main
Choose a base branch
from

Use ICU system package

d585a63
Select commit
Loading
Failed to load commit list.
Open

Switch to ICU tokenizer #939

Use ICU system package
d585a63
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / Decision Task (pull-request) succeeded Nov 22, 2024 in 2m 13s

FirefoxCI (pull_request)

The task that creates all of the other tasks in the task graph

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2024-11-22T22:50:04.260Z
Resolved: 2024-11-22T22:50:35.102Z
Task Execution Time: 30 seconds, 842 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0

Artifacts

- public/actions.json
- public/docker-contexts/base.tar.gz
- public/docker-contexts/inference.tar.gz
- public/docker-contexts/test.tar.gz
- public/docker-contexts/toolchain-build.tar.gz
- public/docker-contexts/train.tar.gz
- public/fetch-content
- public/full-task-graph.json
- public/label-to-taskid.json
- public/logs/live_backing.log
- public/logs/live.log
- public/optimizations.log
- public/parameters.yml
- public/runnable-jobs.json
- public/run-task
- public/target-tasks.json
- public/task-graph.json


[taskcluster 2024-11-22 22:50:04.324Z] Task ID: KygK5rmiQQSbJCq_hTsFbQ
[taskcluster 2024-11-22 22:50:04.325Z] Worker ID: 2784719848518497444
[taskcluster 2024-11-22 22:50:04.325Z] Worker Group: us-central1-b
[taskcluster 2024-11-22 22:50:04.325Z] Worker Node Type: projects/887720501152/machineTypes/n2-standard-2
[taskcluster 2024-11-22 22:50:04.325Z] Worker Pool: translations-1/decision-gcp
[taskcluster 2024-11-22 22:50:04.325Z] Worker Version: 38.0.5
[taskcluster 2024-11-22 22:50:04.325Z] Public IP: 34.68.83.136
[taskcluster 2024-11-22 22:50:04.325Z] Hostname: translations-1-decision-gcp-aeky2ncrrfqkz7rcxqidhg
[taskcluster 2024-11-22 22:50:04.325Z] using cache "translations-level-1-checkouts-sparse-v2" -> /builds/worker/checkouts

b57ab501a8f4 - Started downloading
3bb7dd3accd0 - Started downloading
559df9a599c4 - Started downloading
559df9a599c4 - Downloaded in 0.158 seconds
b57ab501a8f4 - Downloaded in 0.291 seconds
fad8d951cdaf - Started downloading
fad8d951cdaf - Downloaded in 0.001 seconds
3bb7dd3accd0 - Downloaded in 0.928 seconds
Digest: sha256:8c57e30214c85625856479812e63212dc2873b1ffcd97467a7c93508cbb3075a
Status: Downloaded newer image for mozillareleases/taskgraph@sha256:8c57e30214c85625856479812e63212dc2873b1ffcd97467a7c93508cbb3075a

...(5 lines hidden)...

[vcs 2024-11-22T22:50:16.337Z] WARNING: vcs checkout path (/builds/worker/checkouts/src) not in cache or volume; performance will likely suffer
[setup 2024-11-22T22:50:16.337Z] running as worker:worker
[vcs 2024-11-22T22:50:16.338Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/src']
[vcs 2024-11-22T22:50:16.340Z] executing ['git', 'clone', 'https://github.com/mozilla/translations', '/builds/worker/checkouts/src']
[vcs 2024-11-22T22:50:16.342Z] Cloning into '/builds/worker/checkouts/src'...
[vcs 2024-11-22T22:50:17.540Z] executing ['git', 'fetch', 'origin', 'main']
[vcs 2024-11-22T22:50:17.766Z] From https://github.com/mozilla/translations
[vcs 2024-11-22T22:50:17.767Z]  * branch            main       -> FETCH_HEAD
[vcs 2024-11-22T22:50:17.774Z] executing ['git', 'checkout', 'main']
[vcs 2024-11-22T22:50:17.826Z] Already on 'main'
[vcs 2024-11-22T22:50:17.827Z] Your branch is up to date with 'origin/main'.
[vcs 2024-11-22T22:50:17.827Z] executing ['git', 'fetch', 'origin', '3598c784dedd8ccf73e9c21a368fab46bcaa12c8']
[vcs 2024-11-22T22:50:18.047Z] From https://github.com/mozilla/translations
[vcs 2024-11-22T22:50:18.047Z]  * branch            3598c784dedd8ccf73e9c21a368fab46bcaa12c8 -> FETCH_HEAD
[vcs 2024-11-22T22:50:18.055Z] executing ['git', 'fetch', '--tags', '--force', 'https://github.com/mozilla/translations', 'icu_tokenizer']
[vcs 2024-11-22T22:50:18.238Z] From https://github.com/mozilla/translations
[vcs 2024-11-22T22:50:18.238Z]  * branch            icu_tokenizer -> FETCH_HEAD
[vcs 2024-11-22T22:50:18.245Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/mozilla/translations', 'icu_tokenizer']
[vcs 2024-11-22T22:50:18.425Z] From https://github.com/mozilla/translations
[vcs 2024-11-22T22:50:18.425Z]  * branch            icu_tokenizer -> FETCH_HEAD
[vcs 2024-11-22T22:50:18.433Z] executing ['git', 'checkout', '-f', '-B', 'icu_tokenizer', 'd585a63a6abc04ece83e26ce51a0caa2f7fa21e6']
[vcs 2024-11-22T22:50:18.537Z] Switched to a new branch 'icu_tokenizer'
[vcs 2024-11-22T22:50:18.537Z] executing ['git', 'submodule', 'init']
[vcs 2024-11-22T22:50:18.557Z] Submodule '3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path '3rd_party/browsermt-marian-dev'
[vcs 2024-11-22T22:50:18.558Z] Submodule 'extract-lex' (https://github.com/marian-nmt/extract-lex) registered for path '3rd_party/extract-lex'
[vcs 2024-11-22T22:50:18.558Z] Submodule 'fast_align' (https://github.com/clab/fast_align) registered for path '3rd_party/fast_align'
[vcs 2024-11-22T22:50:18.559Z] Submodule '3rd_party/kenlm' (https://github.com/kpu/kenlm) registered for path '3rd_party/kenlm'
[vcs 2024-11-22T22:50:18.560Z] Submodule '3rd_party/marian-dev' (https://github.com/marian-nmt/marian-dev) registered for path '3rd_party/marian-dev'
[vcs 2024-11-22T22:50:18.560Z] Submodule '3rd_party/preprocess' (https://github.com/kpu/preprocess.git) registered for path '3rd_party/preprocess'
[vcs 2024-11-22T22:50:18.561Z] Submodule 'inference/3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path 'inference/3rd_party/browsermt-marian-dev'
[vcs 2024-11-22T22:50:18.562Z] Submodule 'inference/3rd_party/emsdk' (https://github.com/emscripten-core/emsdk.git) registered for path 'inference/3rd_party/emsdk'
[vcs 2024-11-22T22:50:18.562Z] Submodule 'inference/3rd_party/ssplit-cpp' (https://github.com/browsermt/ssplit-cpp) registered for path 'inference/3rd_party/ssplit-cpp'
[vcs 2024-11-22T22:50:18.563Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-11-22T22:50:18.583Z] Cloning into '/builds/worker/checkouts/src/3rd_party/browsermt-marian-dev'...
[vcs 2024-11-22T22:50:20.675Z] Cloning into '/builds/worker/checkouts/src/3rd_party/extract-lex'...
[vcs 2024-11-22T22:50:20.929Z] Cloning into '/builds/worker/checkouts/src/3rd_party/fast_align'...
[vcs 2024-11-22T22:50:21.210Z] Cloning into '/builds/worker/checkouts/src/3rd_party/kenlm'...
[vcs 2024-11-22T22:50:22.011Z] Cloning into '/builds/worker/checkouts/src/3rd_party/marian-dev'...
[vcs 2024-11-22T22:50:24.530Z] Cloning into '/builds/worker/checkouts/src/3rd_party/preprocess'...
[vcs 2024-11-22T22:50:25.001Z] Cloning into '/builds/worker/checkouts/src/inference/3rd_party/browsermt-marian-dev'...
[vcs 2024-11-22T22:50:27.071Z] Cloning into '/builds/worker/checkouts/src/inference/3rd_party/emsdk'...
[vcs 2024-11-22T22:50:27.781Z] Cloning into '/builds/worker/checkouts/src/inference/3rd_party/ssplit-cpp'...
[vcs 2024-11-22T22:50:28.179Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-11-22T22:50:28.185Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-11-22T22:50:28.193Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-11-22T22:50:28.214Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-11-22T22:50:28.316Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-11-22T22:50:28.332Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-11-22T22:50:28.397Z] Submodule path 'inference/3rd_party/browsermt-marian-dev': checked out '2781d735d4a10dca876d61be587afdab2726293c'
[vcs 2024-11-22T22:50:28.410Z] Submodule path 'inference/3rd_party/emsdk': checked out '2346baa7bb44a4a0571cc75f1986ab9aaa35aa03'
[vcs 2024-11-22T22:50:28.421Z] Submodule path 'inference/3rd_party/ssplit-cpp': checked out 'a311f9865ade34db1e8e080e6cc146f55dafb067'
[vcs 2024-11-22T22:50:28.422Z] cleaning git checkout...
[vcs 2024-11-22T22:50:28.422Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-11-22T22:50:28.425Z] removing []
[vcs 2024-11-22T22:50:28.425Z] successfully cleaned git checkout!
[vcs 2024-11-22T22:50:28.428Z] TinderboxPrint:<a href='https://github.com/mozilla/translations/commit/d585a63a6abc04ece83e26ce51a0caa2f7fa21e6' title='Built from translations commit d585a63a6abc04ece83e26ce51a0caa2f7fa21e6'>d585a63a6abc04ece83e26ce51a0caa2f7fa21e6</a>
[task 2024-11-22T22:50:28.428Z] executing ['bash', '-cx', "cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && taskgraph decision --pushlog-id='0' --pushdate='0' --project='translations' --owner='[email protected]' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla/translations' --base-ref='main' --base-rev='3598c784dedd8ccf73e9c21a368fab46bcaa12c8' --head-repository='https://github.com/mozilla/translations' --head-ref='icu_tokenizer' --head-rev='d585a63a6abc04ece83e26ce51a0caa2f7fa21e6' \n"]
[task 2024-11-22T22:50:28.430Z] + cd /builds/worker/checkouts/src
[task 2024-11-22T22:50:28.430Z] + ln -s /builds/worker/artifacts artifacts
[task 2024-11-22T22:50:28.432Z] + taskgraph decision --pushlog-id=0 --pushdate=0 --project=translations [email protected] --level=1 --repository-type=git --tasks-for=github-pull-request --base-repository=https://github.com/mozilla/translations --base-ref=main --base-rev=3598c784dedd8ccf73e9c21a368fab46bcaa12c8 --head-repository=https://github.com/mozilla/translations --head-ref=icu_tokenizer --head-rev=d585a63a6abc04ece83e26ce51a0caa2f7fa21e6
[task 2024-11-22T22:50:28.685Z] 2024-11-22 22:50:28,685 - INFO - Loading graph configuration.
[task 2024-11-22T22:50:28.708Z] 2024-11-22 22:50:28,708 - WARNING - using default project parameters; add translations to PER_PROJECT_PARAMETERS in /usr/local/lib/python3.11/dist-packages/taskgraph/decision.py to customize behavior for this project
[task 2024-11-22T22:50:28.716Z] 2024-11-22 22:50:28,716 - INFO - Using Parameters(id=0d01cb26f4f7) (from defaults)
[task 2024-11-22T22:50:28.718Z] 2024-11-22 22:50:28,718 - INFO - writing artifact file `parameters.yml`
[task 2024-11-22T22:50:28.727Z] 2024-11-22 22:50:28,727 - INFO - writing artifact file `actions.json`
[task 2024-11-22T22:50:28.730Z] 2024-11-22 22:50:28,730 - INFO - Loading kinds
[task 2024-11-22T22:50:28.760Z] 2024-11-22 22:50:28,760 - INFO - Generating full task set
[task 2024-11-22T22:50:28.788Z] 2024-11-22 22:50:28,788 - INFO - Generated 12 tasks for kind dataset
[task 2024-11-22T22:50:28.790Z] 2024-11-22 22:50:28,789 - INFO - Writing docker-contexts/base.tar.gz for docker image base
[task 2024-11-22T22:50:28.806Z] 2024-11-22 22:50:28,806 - INFO - Writing docker-contexts/inference.tar.gz for docker image inference
[task 2024-11-22T22:50:28.807Z] 2024-11-22 22:50:28,807 - INFO - Writing docker-contexts/test.tar.gz for docker image test
[task 2024-11-22T22:50:28.808Z] 2024-11-22 22:50:28,808 - INFO - Writing docker-contexts/train.tar.gz for docker image train
[task 2024-11-22T22:50:28.808Z] 2024-11-22 22:50:28,808 - INFO - Writing docker-contexts/toolchain-build.tar.gz for docker image toolchain-build
[task 2024-11-22T22:50:28.826Z] 2024-11-22 22:50:28,826 - INFO - Generated 5 tasks for kind docker-image
[task 2024-11-22T22:50:28.835Z] 2024-11-22 22:50:28,835 - INFO - Generated 9 tasks for kind fetch
[task 2024-11-22T22:50:28.917Z] 2024-11-22 22:50:28,917 - INFO - Generated 10 tasks for kind toolchain
[task 2024-11-22T22:50:28.922Z] 2024-11-22 22:50:28,922 - INFO - Generated 4 tasks for kind analyze-corpus
[task 2024-11-22T22:50:28.926Z] 2024-11-22 22:50:28,926 - INFO - Generated 4 tasks for kind analyze-mono
[task 2024-11-22T22:50:28.929Z] 2024-11-22 22:50:28,929 - INFO - Generated 1 tasks for kind bicleaner-model
[task 2024-11-22T22:50:28.934Z] 2024-11-22 22:50:28,934 - INFO - Generated 4 tasks for kind clean-corpus
[task 2024-11-22T22:50:28.939Z] 2024-11-22 22:50:28,939 - INFO - Generated 4 tasks for kind bicleaner
[task 2024-11-22T22:50:28.944Z] 2024-11-22 22:50:28,944 - INFO - Generated 4 tasks for kind clean-mono
[task 2024-11-22T22:50:28.949Z] 2024-11-22 22:50:28,949 - INFO - Generated 1 tasks for kind merge-corpus
[task 2024-11-22T22:50:28.953Z] 2024-11-22 22:50:28,953 - INFO - Generated 2 tasks for kind merge-mono
[task 2024-11-22T22:50:28.956Z] 2024-11-22 22:50:28,956 - INFO - Generated 1 tasks for kind train-vocab
[task 2024-11-22T22:50:28.958Z] 2024-11-22 22:50:28,958 - INFO - Generated 1 tasks for kind split-corpus
[task 2024-11-22T22:50:28.961Z] 2024-11-22 22:50:28,961 - INFO - Generated 1 tasks for kind merge-devset
[task 2024-11-22T22:50:28.965Z] 2024-11-22 22:50:28,965 - INFO - Generated 4 tasks for kind inference
[task 2024-11-22T22:50:28.969Z] 2024-11-22 22:50:28,969 - INFO - Generated 1 tasks for kind train-backwards
[task 2024-11-22T22:50:28.972Z] 2024-11-22 22:50:28,972 - INFO - Generated 1 tasks for kind split-mono-src
[task 2024-11-22T22:50:28.974Z] 2024-11-22 22:50:28,974 - INFO - Generated 1 tasks for kind split-mono-trg
[task 2024-11-22T22:50:28.978Z] 2024-11-22 22:50:28,978 - INFO - Generated 6 tasks for kind tests
[task 2024-11-22T22:50:28.984Z] 2024-11-22 22:50:28,983 - INFO - Generated 2 tasks for kind translate-mono-trg
[task 2024-11-22T22:50:28.987Z] 2024-11-22 22:50:28,987 - INFO - Generated 1 tasks for kind collect-mono-trg
[task 2024-11-22T22:50:28.990Z] 2024-11-22 22:50:28,990 - INFO - Generated 1 tasks for kind alignments-original
[task 2024-11-22T22:50:28.992Z] 2024-11-22 22:50:28,992 - INFO - Generated 1 tasks for kind alignments-backtranslated
[task 2024-11-22T22:50:28.996Z] 2024-11-22 22:50:28,995 - INFO - Generated 1 tasks for kind train-teacher
[task 2024-11-22T22:50:28.998Z] 2024-11-22 22:50:28,998 - INFO - Generated 1 tasks for kind evaluate-teacher-ensemble
[task 2024-11-22T22:50:29.003Z] 2024-11-22 22:50:29,003 - INFO - Generated 2 tasks for kind translate-corpus
[task 2024-11-22T22:50:29.006Z] 2024-11-22 22:50:29,006 - INFO - Generated 2 tasks for kind extract-best
[task 2024-11-22T22:50:29.008Z] 2024-11-22 22:50:29,008 - INFO - Generated 1 tasks for kind collect-corpus
[task 2024-11-22T22:50:29.012Z] 2024-11-22 22:50:29,012 - INFO - Generated 2 tasks for kind translate-mono-src
[task 2024-11-22T22:50:29.015Z] 2024-11-22 22:50:29,014 - INFO - Generated 1 tasks for kind collect-mono-src
[task 2024-11-22T22:50:29.017Z] 2024-11-22 22:50:29,017 - INFO - Generated 1 tasks for kind merge-translated
[task 2024-11-22T22:50:29.020Z] 2024-11-22 22:50:29,020 - INFO - Generated 1 tasks for kind score
[task 2024-11-22T22:50:29.022Z] 2024-11-22 22:50:29,022 - INFO - Generated 1 tasks for kind cefilter
[task 2024-11-22T22:50:29.025Z] 2024-11-22 22:50:29,025 - INFO - Generated 1 tasks for kind shortlist
[task 2024-11-22T22:50:29.027Z] 2024-11-22 22:50:29,027 - INFO - Generated 1 tasks for kind alignments-student
[task 2024-11-22T22:50:29.030Z] 2024-11-22 22:50:29,030 - INFO - Generated 1 tasks for kind train-student
[task 2024-11-22T22:50:29.033Z] 2024-11-22 22:50:29,033 - INFO - Generated 1 tasks for kind finetune-student
[task 2024-11-22T22:50:29.035Z] 2024-11-22 22:50:29,035 - INFO - Generated 1 tasks for kind quantize
[task 2024-11-22T22:50:29.038Z] 2024-11-22 22:50:29,038 - INFO - Generated 1 tasks for kind export
[task 2024-11-22T22:50:29.044Z] 2024-11-22 22:50:29,044 - INFO - Generated 4 tasks for kind evaluate
[task 2024-11-22T22:50:29.047Z] 2024-11-22 22:50:29,046 - INFO - Generated 1 tasks for kind evaluate-quantized
[task 2024-11-22T22:50:29.048Z] 2024-11-22 22:50:29,048 - INFO - Generated 1 tasks for kind all-pipeline
[task 2024-11-22T22:50:29.050Z] 2024-11-22 22:50:29,050 - INFO - Generated 1 tasks for kind all-pr-pipeline
[task 2024-11-22T22:50:29.050Z] 2024-11-22 22:50:29,050 - INFO - Generating full task graph
[task 2024-11-22T22:50:29.050Z] 2024-11-22 22:50:29,050 - INFO - Full task graph contains 107 tasks and 300 dependencies
[task 2024-11-22T22:50:29.055Z] 2024-11-22 22:50:29,055 - INFO - writing artifact file `full-task-graph.json`
[task 2024-11-22T22:50:29.076Z] 2024-11-22 22:50:29,076 - INFO - writing artifact file `runnable-jobs.json`
[task 2024-11-22T22:50:29.078Z] 2024-11-22 22:50:29,077 - INFO - Generating target task set
[task 2024-11-22T22:50:29.078Z] 2024-11-22 22:50:29,078 - INFO - Filter filter_target_tasks pruned 86 tasks (21 remain)
[task 2024-11-22T22:50:29.078Z] 2024-11-22 22:50:29,078 - INFO - writing artifact file `target-tasks.json`
[task 2024-11-22T22:50:29.078Z] 2024-11-22 22:50:29,078 - INFO - Generating target task graph
[task 2024-11-22T22:50:29.078Z] 2024-11-22 22:50:29,078 - INFO - Adding 5 tasks with `always_target` attribute
[task 2024-11-22T22:50:29.080Z] 2024-11-22 22:50:29,079 - INFO - Generating optimized task graph
[task 2024-11-22T22:50:29.084Z] 2024-11-22 22:50:29,084 - INFO - Removed 4 tasks by skip-unless-changed (skip-unless-changed) during optimization.
[task 2024-11-22T22:50:29.326Z] 2024-11-22 22:50:29,326 - INFO - Replaced 34 tasks by index-search (index-search) during optimization.
[task 2024-11-22T22:50:29.332Z] 2024-11-22 22:50:29,332 - INFO - writing artifact file `task-graph.json`
[task 2024-11-22T22:50:29.345Z] 2024-11-22 22:50:29,345 - INFO - writing artifact file `label-to-taskid.json`
[task 2024-11-22T22:50:29.347Z] 2024-11-22 22:50:29,347 - INFO - Creating task with taskId KnyIE1GvSz67R9mjL97Now for build-docker-image-train
[task 2024-11-22T22:50:29.349Z] 2024-11-22 22:50:29,349 - INFO - Creating task with taskId Hh9E_87oSLuDxLEPHh2idA for tests-lint-eslint
[task 2024-11-22T22:50:29.353Z] 2024-11-22 22:50:29,352 - INFO - Creating task with taskId R1EFkifFQeGwp4XnSTV8UQ for build-docker-image-test
[task 2024-11-22T22:50:29.467Z] 2024-11-22 22:50:29,467 - INFO - Creating task with taskId GMJxZvHISCeHTsADp_sZ5g for tests-lint-black
[task 2024-11-22T22:50:29.468Z] 2024-11-22 22:50:29,467 - INFO - Creating task with taskId DjwgLZhwSZaJu9EGEsuXrA for tests-taskgraph-definition
[task 2024-11-22T22:50:29.473Z] 2024-11-22 22:50:29,472 - INFO - Creating task with taskId Y7TH1Hm1TSOpW4jryeQWYg for tests-lint-ruff
[task 2024-11-22T22:50:29.476Z] 2024-11-22 22:50:29,475 - INFO - Creating task with taskId ePBOek4iRz6IACB3cq10Zg for tests-test
[task 2024-11-22T22:50:29.479Z] 2024-11-22 22:50:29,478 - INFO - Creating task with taskId YfFsVHFfSteN79KWL7W9pA for merge-devset-ru-en
[task 2024-11-22T22:50:29.480Z] 2024-11-22 22:50:29,480 - INFO - Creating task with taskId LJ7J2aXTSPei1Ws45etnXw for tests-taskgraph-diff
[task 2024-11-22T22:50:29.483Z] 2024-11-22 22:50:29,482 - INFO - Creating task with taskId OBONr18VQ9SHFhHjY4htrA for clean-mono-opus-en-tldr-pages_v2023-08-29-mono-trg
[task 2024-11-22T22:50:29.562Z] 2024-11-22 22:50:29,562 - INFO - Creating task with taskId Oz4GkgELTkSm1v8u0UYYdQ for clean-mono-news-crawl-ru-news_2008-mono-src
[task 2024-11-22T22:50:29.564Z] 2024-11-22 22:50:29,564 - INFO - Creating task with taskId OyDG8CnrRoK5XMk0SzQT8g for clean-mono-opus-ru-tldr-pages_v2023-08-29-mono-src
[task 2024-11-22T22:50:29.567Z] 2024-11-22 22:50:29,567 - INFO - Creating task with taskId Rx0wTHe6RYak9CaIWZYEfw for analyze-corpus-opus-ada83_v1-ru-en
[task 2024-11-22T22:50:29.570Z] 2024-11-22 22:50:29,568 - INFO - Creating task with taskId VfXCBJlxTkKlBWzbDw53qQ for clean-corpus-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2024-11-22T22:50:29.572Z] 2024-11-22 22:50:29,571 - INFO - Creating task with taskId afKheyZzSgaRL4-WiKSQ7A for clean-corpus-mtdata-ELRC-web_acquired_data_related_to_scientific_resea_78c4de-ru-en
[task 2024-11-22T22:50:29.574Z] 2024-11-22 22:50:29,572 - INFO - Creating task with taskId dVDYmS_ZRO2FvIX099r4mA for analyze-mono-opus-ru-tldr-pages_v2023-08-29
[task 2024-11-22T22:50:29.580Z] 2024-11-22 22:50:29,573 - INFO - Creating task with taskId TZlubEB9SwCm6SlUze7g4Q for clean-corpus-url-gcp_pytest-dataset_a0017e-ru-en
[task 2024-11-22T22:50:29.580Z] 2024-11-22 22:50:29,575 - INFO - Creating task with taskId YgHPpWXiQ1GZN_fLFdNjQw for clean-mono-news-crawl-en-news_2007-mono-trg
[task 2024-11-22T22:50:29.584Z] 2024-11-22 22:50:29,583 - INFO - Creating task with taskId BHcC5QHIT7yALQGtOAVkww for analyze-corpus-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2024-11-22T22:50:29.585Z] 2024-11-22 22:50:29,585 - INFO - Creating task with taskId GuyCeEWQTX64h_tUBwVocw for analyze-mono-news-crawl-en-news_2007
[task 2024-11-22T22:50:29.585Z] 2024-11-22 22:50:29,585 - INFO - Creating task with taskId Dg8HYrpoTfuxN0lFDdzSMw for analyze-corpus-mtdata-ELRC-web_acquired_data_related_to_scientific_resea_78c4de-ru-en
[task 2024-11-22T22:50:29.589Z] 2024-11-22 22:50:29,589 - INFO - Creating task with taskId ZH93qGhIQiynuLMw8y6eew for analyze-mono-opus-en-tldr-pages_v2023-08-29
[task 2024-11-22T22:50:29.591Z] 2024-11-22 22:50:29,591 - INFO - Creating task with taskId LMHnSwTdSOCbmnrKR1Kx3w for analyze-mono-news-crawl-ru-news_2008
[task 2024-11-22T22:50:29.593Z] 2024-11-22 22:50:29,593 - INFO - Creating task with taskId JohgkEzQRhyi3hO4HUN2Tw for analyze-corpus-url-gcp_pytest-dataset_a0017e-ru-en
[task 2024-11-22T22:50:29.599Z] 2024-11-22 22:50:29,598 - INFO - Creating task with taskId R12XdGPpRoCqwNhtpLocRw for clean-corpus-opus-ada83_v1-ru-en
[task 2024-11-22T22:50:29.689Z] 2024-11-22 22:50:29,689 - INFO - Creating task with taskId Kd3wDfigT_-rzZx25C5y0A for bicleaner-ai-url-gcp_pytest-dataset_a0017e-ru-en
[task 2024-11-22T22:50:29.813Z] 2024-11-22 22:50:29,812 - INFO - Creating task with taskId e1usRcXfTzCAagS0_21b9A for bicleaner-ai-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2024-11-22T22:50:29.815Z] 2024-11-22 22:50:29,815 - INFO - Creating task with taskId E6OGzex0TUuRpJ9kzAhVyg for bicleaner-ai-opus-ada83_v1-ru-en
[task 2024-11-22T22:50:29.816Z] 2024-11-22 22:50:29,816 - INFO - Creating task with taskId AIY73J0JRXanRkyp5XJp2A for bicleaner-ai-mtdata-ELRC-web_acquired_data_related_to_scientific_resea_78c4de-ru-en
[task 2024-11-22T22:50:29.973Z] 2024-11-22 22:50:29,972 - INFO - Creating task with taskId CMk3dMWqQrOhiX5_lJExuQ for merge-corpus-ru-en
[task 2024-11-22T22:50:30.074Z] 2024-11-22 22:50:30,074 - INFO - Creating task with taskId Np_OPTT1TWOABShQNn9lUg for alignments-original-ru-en
[task 2024-11-22T22:50:30.075Z] 2024-11-22 22:50:30,074 - INFO - Creating task with taskId WcppjhYBQfyubIQHtK6hMQ for split-corpus-ru-en
[task 2024-11-22T22:50:30.077Z] 2024-11-22 22:50:30,077 - INFO - Creating task with taskId QRGwRMMlR2Chi_A4GizTMQ for merge-mono-src-ru
[task 2024-11-22T22:50:30.079Z] 2024-11-22 22:50:30,078 - INFO - Creating task with taskId QbzA4AsxRWu2LJDlSoyBgA for train-vocab-ru-en
[task 2024-11-22T22:50:30.081Z] 2024-11-22 22:50:30,080 - INFO - Creating task with taskId Cz9fCCvAT3-ivThmX5E9Vw for merge-mono-trg-en
[task 2024-11-22T22:50:30.167Z] 2024-11-22 22:50:30,167 - INFO - Creating task with taskId ScoIWjpTQnO6dK_RhGlJ9A for split-mono-src-ru
[task 2024-11-22T22:50:30.251Z] 2024-11-22 22:50:30,251 - INFO - Creating task with taskId eoiSr17VQ6G18HkfZOYSXQ for split-mono-trg-en
[task 2024-11-22T22:50:30.253Z] 2024-11-22 22:50:30,253 - INFO - Creating task with taskId QxvDNmX3TNWsYrH4IlhFzw for train-backwards-ru-en
[task 2024-11-22T22:50:30.350Z] 2024-11-22 22:50:30,350 - INFO - Creating task with taskId V4BF0x3kRHeb4EPRdU7SNw for translate-mono-trg-ru-en-2/2
[task 2024-11-22T22:50:30.351Z] 2024-11-22 22:50:30,351 - INFO - Creating task with taskId Ab4mBddyQbGHJBTQvK-Gqg for evaluate-backward-flores-devtest-ru-en
[task 2024-11-22T22:50:30.356Z] 2024-11-22 22:50:30,351 - INFO - Creating task with taskId IwGvLXKdQ3G_1ZcVU19tLw for translate-mono-trg-ru-en-1/2
[task 2024-11-22T22:50:30.526Z] 2024-11-22 22:50:30,526 - INFO - Creating task with taskId Ag8vBkagQfO8vGs7iaVTnw for collect-mono-trg-ru-en
[task 2024-11-22T22:50:30.619Z] 2024-11-22 22:50:30,618 - INFO - Creating task with taskId foPd1kEZQIWlMWClhV5UDQ for alignments-backtranslated-ru-en
[task 2024-11-22T22:50:30.704Z] 2024-11-22 22:50:30,704 - INFO - Creating task with taskId KlDVnRvDSHuQP-1N8oPpXA for train-teacher-ru-en-1
[task 2024-11-22T22:50:30.791Z] 2024-11-22 22:50:30,791 - INFO - Creating task with taskId RyJ61H6TRGqTQPiMv5I8mQ for translate-mono-src-ru-en-2/2
[task 2024-11-22T22:50:30.793Z] 2024-11-22 22:50:30,792 - INFO - Creating task with taskId awv3hIhNSTKgbxp-oplK1w for translate-corpus-ru-en-1/2
[task 2024-11-22T22:50:30.795Z] 2024-11-22 22:50:30,795 - INFO - Creating task with taskId Jyya-gYASDqEwKUXANUksg for translate-corpus-ru-en-2/2
[task 2024-11-22T22:50:30.797Z] 2024-11-22 22:50:30,797 - INFO - Creating task with taskId fZG2Un_KQsa3Q1xtadbAaA for evaluate-teacher-ensemble-flores-devtest-ru-en
[task 2024-11-22T22:50:30.799Z] 2024-11-22 22:50:30,799 - INFO - Creating task with taskId eCe1yYBKRyiF3jsBgwVfsA for evaluate-teacher-flores-devtest-ru-en-1
[task 2024-11-22T22:50:30.801Z] 2024-11-22 22:50:30,799 - INFO - Creating task with taskId Lru4vMdrTYCuM3-_YDBaLw for translate-mono-src-ru-en-1/2
[task 2024-11-22T22:50:30.886Z] 2024-11-22 22:50:30,886 - INFO - Creating task with taskId cqLN7OrnTraqCASsqGWIgw for extract-best-ru-en-2/2
[task 2024-11-22T22:50:30.980Z] 2024-11-22 22:50:30,980 - INFO - Creating task with taskId Xt1emcAkQJOYWTQ4C5sr3Q for collect-mono-src-ru-en
[task 2024-11-22T22:50:30.983Z] 2024-11-22 22:50:30,982 - INFO - Creating task with taskId QrnbAhQ4RAeQdw5nd09BpQ for extract-best-ru-en-1/2
[task 2024-11-22T22:50:31.074Z] 2024-11-22 22:50:31,073 - INFO - Creating task with taskId dH4MpUKGRhu5pycJq0qwcg for collect-corpus-ru-en
[task 2024-11-22T22:50:31.175Z] 2024-11-22 22:50:31,175 - INFO - Creating task with taskId BwuOgMajTouEsRWUZXlouA for merge-translated-ru-en
[task 2024-11-22T22:50:31.264Z] 2024-11-22 22:50:31,264 - INFO - Creating task with taskId azCrexE4Sl2u-R4legGokA for score-ru-en
[task 2024-11-22T22:50:31.347Z] 2024-11-22 22:50:31,347 - INFO - Creating task with taskId RQJUIBz7T7qFf49_tmaYvQ for cefilter-ru-en
[task 2024-11-22T22:50:31.458Z] 2024-11-22 22:50:31,458 - INFO - Creating task with taskId Fyo0WEe_TaKHXjVYcCkDBQ for alignments-student-ru-en
[task 2024-11-22T22:50:31.459Z] 2024-11-22 22:50:31,459 - INFO - Creating task with taskId VYX7OmYwSMiSBM4cWKRsoQ for shortlist-ru-en
[task 2024-11-22T22:50:31.553Z] 2024-11-22 22:50:31,553 - INFO - Creating task with taskId A7cuyTW5QzalhM7bME9HLQ for train-student-ru-en
[task 2024-11-22T22:50:31.648Z] 2024-11-22 22:50:31,648 - INFO - Creating task with taskId MT05JjTrRUisfT6grGQ2FA for evaluate-student-flores-devtest-ru-en
[task 2024-11-22T22:50:31.650Z] 2024-11-22 22:50:31,650 - INFO - Creating task with taskId BnXlBoVdTf-7zYLfYV_MPA for finetune-student-ru-en
[task 2024-11-22T22:50:31.750Z] 2024-11-22 22:50:31,750 - INFO - Creating task with taskId Wpo-eEIHTkOA2EtL2MgwMw for evaluate-finetuned-student-flores-devtest-ru-en
[task 2024-11-22T22:50:31.752Z] 2024-11-22 22:50:31,752 - INFO - Creating task with taskId SfKub3XmQoaP6QnvStUlVg for quantize-ru-en
[task 2024-11-22T22:50:31.855Z] 2024-11-22 22:50:31,855 - INFO - Creating task with taskId Wq2TEElKTBaWfuKRBHQKig for evaluate-quantized-flores-devtest-ru-en
[task 2024-11-22T22:50:31.856Z] 2024-11-22 22:50:31,855 - INFO - Creating task with taskId bGCHD8mnQJSIDtSUHnTb-w for export-ru-en
[task 2024-11-22T22:50:31.947Z] 2024-11-22 22:50:31,947 - INFO - Creating task with taskId TnJ0aX9sR6qCw3LFDVyxYg for all-pr-pipeline-ru-en-1
[taskcluster 2024-11-22 22:50:32.385Z] === Task Finished ===
[taskcluster 2024-11-22 22:50:34.602Z] Successful task run with exit code: 0 completed in 30.279 seconds