feat: enable health_score_v2_sink scheduled export (IN-1221) - #4475
Conversation
Signed-off-by: Gašper Grom <gasper.grom@gmail.com>
PR SummaryLow Risk Overview That timing runs five minutes after Reviewed by Cursor Bugbot for commit b6f1321. Bugbot is set up for automated code reviews on this repo. Configure here. |
There was a problem hiding this comment.
Pull request overview
Activates the Health Score v2 Tinybird sink for daily Kafka exports.
Changes:
- Replaces on-demand execution with a 00:35 UTC schedule.
💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.
| EXPORT_SERVICE kafka | ||
| EXPORT_CONNECTION_NAME lfx-oracle-kafka-streaming | ||
| EXPORT_SCHEDULE @on-demand | ||
| EXPORT_SCHEDULE 35 0 * * * |
There was a problem hiding this comment.
Pull request overview
Copilot reviewed 1 out of 1 changed files in this pull request and generated no new comments.
Suppressed comments (1)
services/libs/tinybird/pipes/health_score_v2_sink.pipe:45
- This runs before both datasets read by the sink are refreshed:
project_insights_impact_breakdown_copy.piperuns at 02:40 UTC andproject_insights_copy.pipeat 03:00 UTC. The 00:35 job therefore exports the previous refresh while stamping rows with the new day's date. Schedule it after 03:00 with a buffer, as the dependency documentation recommends.
EXPORT_SCHEDULE 35 0 * * *
Summary
health_score_v2_sink's recurring export, replacing@on-demand(disabled pending product go-ahead) with35 0 * * *(00:35 UTC), 5 minutes afterhealth_score_sink's 00:30 UTC run.mainin sync with what's deployed (main previously reflected the@on-demandversion merged via feat: add separate v2 health score sink to snowflake (IN-1212) #4432).overall_score_v2.