Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New session #353

Open
wants to merge 99 commits into
base: main
Choose a base branch
from
Open
Changes from 1 commit
Commits
Show all changes
99 commits
Select commit Hold shift + click to select a range
003f950
Cluster base table by stream_id to save cost
JumboDVDH0 Apr 18, 2024
02cb8d9
Added client_id to staging table
JumboDVDH0 Apr 18, 2024
fa1b0d0
Fixed type-o
JumboDVDH0 Apr 18, 2024
c970c6a
Forgot one reference
JumboDVDH0 Apr 18, 2024
ca16d32
Fixed grouping issue:
JumboDVDH0 Apr 18, 2024
ac57735
Added Client ID to user_id_mapping
JumboDVDH0 Apr 19, 2024
22901a3
Fixed grouping
JumboDVDH0 Apr 19, 2024
bb3c341
Merge pull request #1 from Springbok-Agency/stream-id-stg_ga4__user_i…
DVDH-000 Apr 23, 2024
a0adf6e
Added Client ID to Derived User Properties
JumboDVDH0 Apr 23, 2024
e9f37e6
Merge pull request #2 from Springbok-Agency/client-id-user-derived-pr…
DVDH-000 Apr 23, 2024
aaf9563
Added stream id
JumboDVDH0 Apr 24, 2024
9811f8f
Added stream_id
JumboDVDH0 Apr 26, 2024
bbf50d9
date range
tessa-beijloos May 6, 2024
f209e0b
Merge pull request #5 from Springbok-Agency/date-filter
tessa-beijloos May 6, 2024
715339c
Update base_ga4__events.sql
tessa-beijloos May 6, 2024
9c80574
Merge pull request #6 from Springbok-Agency/fix-for-base
DVDH-000 May 6, 2024
6e5c212
Update base_ga4__events.sql
tessa-beijloos May 6, 2024
391a432
Merge pull request #7 from Springbok-Agency/base-fix-v2
DVDH-000 May 6, 2024
a7f9885
Update base_ga4__events.sql
tessa-beijloos May 6, 2024
0ee8419
Merge pull request #8 from Springbok-Agency/fix-3-base-table
DVDH-000 May 6, 2024
33f1f2c
Update schema.yml
tessa-beijloos May 6, 2024
190e86e
Merge pull request #9 from Springbok-Agency/change-macro-name
DVDH-000 May 6, 2024
3ba4ed7
Added logging
JumboDVDH0 May 6, 2024
9ddf47e
Merge pull request #10 from Springbok-Agency/add-logging
DVDH-000 May 6, 2024
5c7af5d
Update base_ga4__events.sql
tessa-beijloos May 6, 2024
abc95be
Merge pull request #11 from Springbok-Agency/fix-base-4
DVDH-000 May 6, 2024
07ece65
Update select_date_range.sql
tessa-beijloos May 6, 2024
1df0d35
Merge pull request #12 from Springbok-Agency/change-date-range-function
DVDH-000 May 6, 2024
317e12d
Changed Macro
JumboDVDH0 May 30, 2024
92dc5b0
Merge pull request #13 from Springbok-Agency/fix-macro
DVDH-000 May 30, 2024
43ca797
Moved macro to our own project
JumboDVDH0 May 30, 2024
9b39c73
Merge pull request #14 from Springbok-Agency/move-macro-to-main-project
DVDH-000 May 30, 2024
43684c9
Generate partitions to replace on start and end date
JumboDVDH0 May 31, 2024
c71e5ea
Merge pull request #15 from Springbok-Agency/generate-partitions-to-r…
DVDH-000 May 31, 2024
ac46229
Generate partitions to replace based on start and end date
JumboDVDH0 May 31, 2024
7aa7d28
Generate partitions to replace based on start and end date
JumboDVDH0 May 31, 2024
36aa9d8
Merge pull request #16 from Springbok-Agency/generate-partitions-to-r…
DVDH-000 May 31, 2024
b2930f5
Added stream_id
JumboDVDH0 Jun 3, 2024
fda0221
Added clustering
JumboDVDH0 Jun 3, 2024
98920b6
Merge pull request #17 from Springbok-Agency/add-stream-id-trafffic-s…
DVDH-000 Jun 3, 2024
abd6d75
Fixed Type-O
JumboDVDH0 Jun 3, 2024
9c551cf
Merge pull request #18 from Springbok-Agency/add-stream-id-trafffic-s…
DVDH-000 Jun 3, 2024
49ea67a
Added stream ID
JumboDVDH0 Jun 3, 2024
d491683
JumboDVDH0 Jun 3, 2024
5729b6c
JumboDVDH0 Jun 3, 2024
a86e0a2
Merge pull request #19 from Springbok-Agency/add-stream-id-session-co…
DVDH-000 Jun 3, 2024
a57e8c4
Updated
JumboDVDH0 Jun 3, 2024
f3a363d
Merge pull request #20 from Springbok-Agency/fix-partitions-to-replace
DVDH-000 Jun 3, 2024
ba6f44d
Fixed partitions to replace
JumboDVDH0 Jun 10, 2024
30d8925
Merge pull request #21 from Springbok-Agency/fix-partitions-to-replace
DVDH-000 Jun 10, 2024
6636136
Added test
JumboDVDH0 Jun 10, 2024
548a209
Added test to model
JumboDVDH0 Jun 10, 2024
f4584a7
Backfill is var
JumboDVDH0 Jun 10, 2024
488c0a4
Merge pull request #22 from Springbok-Agency/MAV-7352-add-10-weeks-test
DVDH-000 Jun 10, 2024
50e38bf
Changed var reference
JumboDVDH0 Jun 10, 2024
f9c5740
Merge pull request #23 from Springbok-Agency/MAV-7352-add-10-weeks-test
DVDH-000 Jun 10, 2024
583e3c5
Merge branch 'Velir:main' into master
DVDH-000 Jun 10, 2024
73796ef
Fixed 10 week test so it works better with Airflow
JumboDVDH0 Jun 19, 2024
c7d1d28
Merge pull request #24 from Springbok-Agency/fix-10-week-test
DVDH-000 Jun 19, 2024
82f8e20
Made stg_ga4__sessions_traffic_sources_daily compatible with start an…
JumboDVDH0 Jun 26, 2024
10e2363
Merge pull request #25 from Springbok-Agency/start-end-sessions
DVDH-000 Jun 26, 2024
de1cdb3
Added backfill compatibility start and end date
JumboDVDH0 Jun 26, 2024
09549a1
Merge pull request #26 from Springbok-Agency/start-end-sessions
DVDH-000 Jun 26, 2024
a731e1e
Remove 10 weeks dates
JumboDVDH0 Jul 23, 2024
e00ca7a
Added custom test to save cost
JumboDVDH0 Jul 23, 2024
231003f
Custom name
JumboDVDH0 Jul 23, 2024
a9ecd8f
Macro causes issues, skip for now
JumboDVDH0 Jul 23, 2024
41258db
Actually give the good name
JumboDVDH0 Jul 23, 2024
7e4106d
Working too fast
JumboDVDH0 Jul 23, 2024
41d3702
Proper naming
JumboDVDH0 Jul 23, 2024
4a64671
Renamed
JumboDVDH0 Jul 23, 2024
550e656
Removed tests
JumboDVDH0 Jul 23, 2024
bf2af62
no test
JumboDVDH0 Jul 24, 2024
5f9cc1f
Removed test
JumboDVDH0 Jul 24, 2024
031e67e
Removed test, we do this in our own project now
JumboDVDH0 Jul 24, 2024
429e7cb
Disabled test
JumboDVDH0 Jul 24, 2024
f478206
Dummy test
JumboDVDH0 Jul 24, 2024
7057b3a
Property ID filter
DVDH-000 Dec 12, 2024
55fcd38
Select all selected brands
DVDH-000 Dec 12, 2024
bb108eb
Update base_select.sql
tessa-beijloos Dec 16, 2024
f437c3d
Merge pull request #27 from Springbok-Agency/tessa-beijloos-patch-1
tessa-beijloos Dec 16, 2024
e514ebc
Update base_select.sql
tessa-beijloos Dec 16, 2024
1d4f76b
Merge pull request #28 from Springbok-Agency/tessa-beijloos-patch-2
tessa-beijloos Dec 16, 2024
decf8b0
Update base_select.sql
tessa-beijloos Dec 16, 2024
e51739e
Merge pull request #29 from Springbok-Agency/tessa-beijloos-patch-3
tessa-beijloos Dec 16, 2024
e55eea3
Update base_select.sql
tessa-beijloos Dec 16, 2024
200e0c5
Merge pull request #30 from Springbok-Agency/tessa-beijloos-patch-4
tessa-beijloos Dec 16, 2024
36a4fd8
Update base_select.sql
tessa-beijloos Dec 16, 2024
17f16e3
Merge pull request #31 from Springbok-Agency/tessa-beijloos-patch-5
tessa-beijloos Dec 16, 2024
99c3f97
Update base_select.sql
tessa-beijloos Dec 16, 2024
06207b6
Merge pull request #33 from Springbok-Agency/tessa-beijloos-patch-8
tessa-beijloos Dec 16, 2024
1dfb82e
Update base_select.sql
tessa-beijloos Dec 16, 2024
22a3381
Merge pull request #34 from Springbok-Agency/tessa-beijloos-patch-9
tessa-beijloos Dec 16, 2024
739b47b
Update base_select.sql
tessa-beijloos Dec 16, 2024
e8a3564
Merge pull request #35 from Springbok-Agency/tessa-beijloos-patch-10
tessa-beijloos Dec 16, 2024
1442e39
base select
tessa-beijloos-jumbo Dec 16, 2024
6ba69ee
Merge branch 'master' into new-session-id
tessa-beijloos Dec 16, 2024
4d49df0
new sessionid
tessa-beijloos-jumbo Dec 16, 2024
c2e957f
ga4-package into new-session-id
tessa-beijloos-jumbo Dec 16, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Update base_select.sql
  • Loading branch information
tessa-beijloos authored Dec 16, 2024
commit 739b47bf76e7a8902c785853529e54e58241b9ec
3 changes: 2 additions & 1 deletion macros/base_select.sql
Original file line number Diff line number Diff line change
Expand Up @@ -140,7 +140,8 @@
)) from unnest(items) as unnested_items
) items
, property_id
, {{ ga4.unnest_key('event_params', 'ga_session_id', 'int_value', 'session_id') }}
, COALESCE({{ ga4.unnest_key('event_params', 'ga_session_id', 'int_value', 'session_id') }},
CAST(REGEXP_EXTRACT(COALESCE((select value.string_value from unnest(event_params) where key = 'ga_session_id') , ""), r'^GS\d\.\d\.(\d+)') AS INT64)) as session_id
, {{ ga4.unnest_key('event_params', 'page_location') }}
, {{ ga4.unnest_key('event_params', 'ga_session_number', 'int_value', 'session_number') }}
, COALESCE(
Expand Down