25 Commits

Author SHA1 Message Date
db85eb865f added k_anonymity_job_s3
All checks were successful
Check Deleted Workflows / check-deleted-workflows (pull_request) Successful in 1m31s
2026-06-17 08:19:35 +00:00
1dd776a410 added example removed two jobs
Some checks failed
Check Deleted Workflows / check-deleted-workflows (pull_request) Failing after 1m37s
2026-06-17 08:16:31 +00:00
cfdeef41cb add price_band 2026-06-17 08:15:40 +00:00
7e743c1157 Merge branch 'main' into develop
All checks were successful
Check Deleted Workflows / check-deleted-workflows (pull_request) Successful in 1m5s
2026-06-17 06:01:57 +00:00
7c028ef02f revert for demo
All checks were successful
Check Deleted Workflows / check-deleted-workflows (pull_request) Successful in 1m5s
2026-06-17 05:58:20 +00:00
e0ba120da4 revert for demo 2026-06-17 05:57:58 +00:00
5a7f568ba6 Merge pull request 'develop' (#10) from develop into main
All checks were successful
Build and Push Docker Image / build-and-push (push) Successful in 2m17s
Reviewed-on: #10
Reviewed-by: Jessica Roberts <j.r@email.com>
2026-06-16 12:51:20 +00:00
229f6953aa readd k-anon
All checks were successful
Check Deleted Workflows / check-deleted-workflows (pull_request) Successful in 1m2s
2026-06-16 12:49:51 +00:00
a814fbf4dc add example job delete two more
Some checks failed
Check Deleted Workflows / check-deleted-workflows (pull_request) Failing after 1m9s
2026-06-16 12:46:50 +00:00
2e7bf4a0d5 update with price band 2026-06-16 12:46:10 +00:00
1354b30863 test
All checks were successful
Check Deleted Workflows / check-deleted-workflows (pull_request) Successful in 1m8s
2026-06-16 08:20:11 +00:00
f5c7236767 Merge pull request 'develop' (#8) from develop into main
All checks were successful
Build and Push Docker Image / build-and-push (push) Successful in 2m22s
Reviewed-on: #8
Reviewed-by: Jessica Roberts <j.r@email.com>
2026-06-15 13:52:09 +00:00
7e15258536 Merge branch 'main' into develop
All checks were successful
Check Deleted Workflows / check-deleted-workflows (pull_request) Successful in 1m3s
2026-06-15 13:47:47 +00:00
a868085ce3 revert for demo
All checks were successful
Check Deleted Workflows / check-deleted-workflows (pull_request) Successful in 59s
2026-06-15 13:47:24 +00:00
6afb2523e3 revert for demo 2026-06-15 13:47:05 +00:00
7ec7e97801 Merge pull request 'develop' (#7) from develop into main
All checks were successful
Build and Push Docker Image / build-and-push (push) Successful in 2m37s
Reviewed-on: #7
2026-06-15 13:32:22 +00:00
17369559fe add k_anonymity back
All checks were successful
Check Deleted Workflows / check-deleted-workflows (pull_request) Successful in 1m3s
2026-06-15 13:30:04 +00:00
c89bb8a389 add example job, remove two other jobs
Some checks failed
Check Deleted Workflows / check-deleted-workflows (pull_request) Failing after 1m0s
2026-06-15 13:27:07 +00:00
2fadac0176 Add price band 2026-06-15 13:26:26 +00:00
84ae56368b revert 2026-06-15 13:24:36 +00:00
e338459f66 Add price band
Some checks failed
Check Deleted Workflows / check-deleted-workflows (pull_request) Has been cancelled
2026-06-15 13:22:21 +00:00
18bd8f039a calculate total price as quantity * unit_price
All checks were successful
Build and Push Docker Image / build-and-push (push) Successful in 2m47s
Check Deleted Workflows / check-deleted-workflows (pull_request) Successful in 59s
2026-06-15 13:07:59 +00:00
e46c826c01 Merge pull request 'added example for schedule, reset for demo' (#5) from develop into main
All checks were successful
Build and Push Docker Image / build-and-push (push) Successful in 2m46s
Reviewed-on: #5
2026-06-12 11:41:02 +00:00
ae83ac8a99 Merge pull request 'develop' (#4) from develop into main
All checks were successful
Build and Push Docker Image / build-and-push (push) Successful in 2m59s
Reviewed-on: #4
2026-06-12 09:58:55 +00:00
88d4b9e883 Merge pull request 'added deletion check, and added workflows' (#2) from develop into main
All checks were successful
Build and Push Docker Image / build-and-push (push) Successful in 2m43s
Reviewed-on: #2
2026-06-12 08:28:12 +00:00
2 changed files with 5 additions and 2 deletions

View File

@@ -31,8 +31,10 @@ def generate_example_dataset() -> pd.DataFrame:
def transform_example_dataset(df: pd.DataFrame) -> pd.DataFrame:
"""Applies a simple transformation to the example dataset."""
df["total_price"] = df["quantity"] * df["unit_price"]
df["price_band"] = df["total_price"].apply(
lambda value: "high" if value >= 25 else "standard"
)
return df

View File

@@ -9,10 +9,11 @@ from template_code_location.jobs.jobs import (data_processing_job,
from util_services.custom_json_logger import simpl_json_logger
from util_services.resources import s3_resource
defs = Definitions(
jobs=[
example_job,
data_processing_job,
example_dataframe_demo_job,
k_anonymity_job_s3,
l_diversity_job_s3,
t_closeness_job_s3,