Skip to content

direct: add DATABRICKS_BUNDLE_RESOURCE_MAX_WAIT to cap resource waits - #6263

Open
denik wants to merge 4 commits into
mainfrom
denik/resource-max-wait
Open

direct: add DATABRICKS_BUNDLE_RESOURCE_MAX_WAIT to cap resource waits#6263
denik wants to merge 4 commits into
mainfrom
denik/resource-max-wait

Conversation

@denik

@denik denik commented Aug 13, 2026

Copy link
Copy Markdown
Contributor

Changes

DATABRICKS_BUNDLE_RESOURCE_MAX_WAIT (in seconds) caps how long deploy and destroy wait for a resource to reach its target state. On expiry the wait is abandoned with a warning rather than failing the deploy: state is saved before the wait, so the resource stays tracked and the next deploy reconciles it.

Resources that others depend on keep their full wait, since a dependent must not act on a resource that is not ready. Deletes are capped regardless of dependents, except the delete inside recreate, which has to release the name for the create that follows. Direct engine only.

Why

Vector Search index tests time out in the nightly cloud job. The indexes are DIRECT_ACCESS with no rows, so nothing is actually indexed — the wall clock goes into the backend provisioning a per-index embedding pipeline that the tests never need to observe.

Tests

Unit tests for parsing, the per-resource decision and the wait semantics, including that a genuine failure still fails the deploy and that cancelling the deployment is not swallowed. Acceptance test for the malformed-value error.

@github-actions

github-actions Bot commented Aug 13, 2026

Copy link
Copy Markdown
Contributor

Approval status: pending

/acceptance/bundle/ - needs approval

10 files changed
Suggested: @janniklasrose
Also eligible: @pietern, @andrewnester, @shreyas-goenka, @lennartkats-db, @anton-107

/bundle/ - needs approval

6 files changed
Suggested: @janniklasrose
Also eligible: @pietern, @andrewnester, @shreyas-goenka, @lennartkats-db, @anton-107

General files (require maintainer)

Files: .nextchanges/bundles/resource-max-wait.md
Based on git history:

  • @janniklasrose -- recent work in bundle/direct/, .nextchanges/bundles/, acceptance/bundle/resources/vector_search_indexes/

Any maintainer (@andrewnester, @anton-107, @pietern, @shreyas-goenka, @simonfaltum, @renaudhartert-db, @janniklasrose, @lennartkats-db, @rugpanov, @rclarey) can approve all areas.
See OWNERS for ownership rules.

@eng-dev-ecosystem-bot

eng-dev-ecosystem-bot commented Aug 13, 2026

Copy link
Copy Markdown
Collaborator

Integration test report

Commit: e8c1e0e

Run: 31786814905

Env ❌​FAIL 🟨​KNOWN 🔄​flaky 💚​RECOVERED 🙈​SKIP ✅​pass 🙈​skip Time
❌​ aws linux 2 3 2 1 3 288 1143 92:28
❌​ aws windows 2 3 2 1 3 290 1141 99:50
❌​ azure linux 2 6 3 287 1143 78:53
❌​ azure windows 2 6 3 289 1141 81:22
❌​ gcp linux 2 3 4 288 1143 56:17
❌​ gcp windows 2 3 4 290 1141 62:19
11 interesting tests: 6 KNOWN, 3 SKIP, 2 FAIL
Test Name aws linux aws windows azure linux azure windows gcp linux gcp windows
🟨​ TestAccept 🟨​K 🟨​K 🟨​K 🟨​K 🟨​K 🟨​K
🙈​ TestAccept/bundle/invariant/no_drift 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/vector_search_endpoints/drift/recreated_same_name 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
❌​ TestAccept/bundle/resources/vector_search_indexes/basic ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/vector_search_indexes/basic/DATABRICKS_BUNDLE_ENGINE=direct ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
🟨​ TestAccept/bundle/resources/vector_search_indexes/recreate/embedding_dimension 🟨​K 🟨​K 🟨​K 🟨​K 🟨​K 🟨​K
🟨​ TestAccept/bundle/resources/vector_search_indexes/recreate/embedding_dimension/DATABRICKS_BUNDLE_ENGINE=direct 🟨​K 🟨​K 🟨​K 🟨​K 🟨​K 🟨​K
🙈​ TestAccept/ssh/connection 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🟨​ TestFetchRepositoryInfoAPI_FromRepo 💚​R 💚​R 🟨​K 🟨​K 🙈​S 🙈​S
🟨​ TestFetchRepositoryInfoAPI_FromRepo/root 🔄​f 🔄​f 🟨​K 🟨​K
🟨​ TestFetchRepositoryInfoAPI_FromRepo/subdir 🔄​f 🔄​f 🟨​K 🟨​K
Top 6 slowest tests (at least 2 minutes):
duration env testname
32:36 aws windows TestAccept/bundle/resources/vector_search_indexes/grants/select/DATABRICKS_BUNDLE_ENGINE=direct
29:00 aws linux TestAccept/bundle/resources/vector_search_indexes/grants/select/DATABRICKS_BUNDLE_ENGINE=direct
18:29 azure linux TestAccept/bundle/resources/vector_search_indexes/grants/select/DATABRICKS_BUNDLE_ENGINE=direct
17:55 azure windows TestAccept/bundle/resources/vector_search_indexes/grants/select/DATABRICKS_BUNDLE_ENGINE=direct
17:07 gcp linux TestAccept/bundle/resources/vector_search_indexes/grants/select/DATABRICKS_BUNDLE_ENGINE=direct
16:44 gcp windows TestAccept/bundle/resources/vector_search_indexes/grants/select/DATABRICKS_BUNDLE_ENGINE=direct

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants