feat(bigquery): support MetadataCacheMode for ExternalDataConfig #11803
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
product-auto-label
bot
added
the
api: bigquery
shollyman
approved these changes
Mar 11, 2025
alvarowolfx
added
the
automerge
gcf-merge-on-green
bot
removed
the
automerge
ron-gal
pushed a commit
to ron-gal/google-cloud-go
that referenced
this pull request
Mar 12, 2025
…gleapis#11803) I skipped integration tests, as this configuration is only supported for BigLake formats. ``` integration_test.go:1761: table.Create: googleapi: Error 400: metadataCacheMode provided for non BigLake external table., invalid ``` Solves googleapis#11802
bhshkh
pushed a commit
that referenced
this pull request
Mar 13, 2025
) * feat(bigtable): Add support for logical views * feat(bigtable): Add support for Materialized Views to admin client * feat(bigtable) add support for data APIs for Materialized Views * fix(spanner): revert the ALTS bound token enablement (#11799) This is to revert #11674. * docs(datacatalog): Mark DataCatalog v1beta1 service and corresponding methods as deprecated (#11800) - [ ] Regenerate this pull request now. Please use Dataplex Catalog instead. PiperOrigin-RevId: 735695315 Source-Link: https://togithub.com/googleapis/googleapis/commit/8c2b9c99a6dc958a31dbe35d83d3bc9dbc9e3004 Source-Link: https://togithub.com/googleapis/googleapis-gen/commit/ebee1544504ead65b3ab52894d5867a132238274 Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiZWJlZTE1NDQ1MDRlYWQ2NWIzYWI1Mjg5NGQ1ODY3YTEzMjIzODI3NCJ9 BEGIN_NESTED_COMMIT feat(dataplex): Add custom BigQuery dataset location support in Auto Discovery docs(dataplex): update the Dataplex Catalog proto to remove the info about schema changes feat(dataplex): DataTaxonomyService is now deprecated PiperOrigin-RevId: 735645981 Source-Link: https://togithub.com/googleapis/googleapis/commit/2415cfc65c4a5eb495117d5577ff5637a36436ed Source-Link: https://togithub.com/googleapis/googleapis-gen/commit/ba22722d2f7d165ed7254d0b269338bbc13dc1fc Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiYmEyMjcyMmQyZjdkMTY1ZWQ3MjU0ZDBiMjY5MzM4YmJjMTNkYzFmYyJ9 END_NESTED_COMMIT BEGIN_NESTED_COMMIT feat(storage/control): Add Anywhere cache control APIs docs(storage/control): Added comments for Anywhere cache messages PiperOrigin-RevId: 735570925 Source-Link: https://togithub.com/googleapis/googleapis/commit/66ab6ceb69178f5368b130949eaf518b7c28352f Source-Link: https://togithub.com/googleapis/googleapis-gen/commit/8f7d5dba0f0418d1f03ce56a767f251b8b69ca3e Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiOGY3ZDVkYmEwZjA0MThkMWYwM2NlNTZhNzY3ZjI1MWI4YjY5Y2EzZSJ9 END_NESTED_COMMIT * feat(storage): Add Flush for appendable writes (#11791) * feat(storage): Add Flush for appendable writes Adds Writer.Flush, which flushes any data in the internal buffer to GCS. Only supported for appendable writes. Preview feature. * test and error fixes * fix open writer test * return non-EOF error. * Update storage/client_test.go Co-authored-by: Ashmeen Kaur <57195160+ashmeenkaur@users.noreply.github.com> * fix Flush after Close error * fix data race * add flush at close test * fix conditions test * fix other test issues --------- Co-authored-by: Ashmeen Kaur <57195160+ashmeenkaur@users.noreply.github.com> * chore(main): release 0.119.0 (#11783) * feat(bigquery): support MetadataCacheMode for ExternalDataConfig (#11803) I skipped integration tests, as this configuration is only supported for BigLake formats. ``` integration_test.go:1761: table.Create: googleapi: Error 400: metadataCacheMode provided for non BigLake external table., invalid ``` Solves #11802 * chore(pubsub): bump cloud.google.com/go version (#11806) * chore(pubsub): bump cloud.google.com/go version * run go mod tidy * docs(cloudquotas): improved comment clarity (#11805) - [ ] Regenerate this pull request now. PiperOrigin-RevId: 735843146 Source-Link: https://togithub.com/googleapis/googleapis/commit/984bf3328ad91408a0c543a89ae6caefec92f31d Source-Link: https://togithub.com/googleapis/googleapis-gen/commit/a82f5ccc591afe58dfa75916672413142f713377 Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiYTgyZjVjY2M1OTFhZmU1OGRmYTc1OTE2NjcyNDEzMTQyZjcxMzM3NyJ9 BEGIN_NESTED_COMMIT feat(recaptchaenterprise): A new field `ja4` is added to message `Event` docs(recaptchaenterprise): update documentation PiperOrigin-RevId: 735783078 Source-Link: https://togithub.com/googleapis/googleapis/commit/5b8c54e53d8d05f5a75e3f21ac5518b23878b696 Source-Link: https://togithub.com/googleapis/googleapis-gen/commit/f8ebdceb9846f9634c66b8ea02d3a7e7ad9d3c7c Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiZjhlYmRjZWI5ODQ2Zjk2MzRjNjZiOGVhMDJkM2E3ZTdhZDlkM2M3YyJ9 END_NESTED_COMMIT * feat(pubsub/pstest): support listening on custom address (#11606) Co-authored-by: Alex Hong <9397363+hongalex@users.noreply.github.com> * chore(main): release storage 1.51.0 (#11445) * chore(main): release storage 1.51.0 * remove reverted change --------- Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com> Co-authored-by: Chris Cotter <cjcotter@google.com> * chore(all): update deps (#11788) This PR contains the following updates: | Package | Change | Age | Adoption | Passing | Confidence | Type | Update | |---|---|---|---|---|---|---|---| | [cloud.google.com/go/accesscontextmanager](https://redirect.github.com/googleapis/google-cloud-go) | `v1.9.3` -> `v1.9.4` | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | require | patch | | [cloud.google.com/go/aiplatform](https://redirect.github.com/googleapis/google-cloud-go) | `v1.74.0` -> `v1.75.0` | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | require | minor | | [cloud.google.com/go/grafeas](https://redirect.github.com/googleapis/google-cloud-go) | `v0.3.13` -> `v0.3.14` | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | require | patch | | [cloud.google.com/go/iam](https://redirect.github.com/googleapis/google-cloud-go) | `v1.4.0` -> `v1.4.1` | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | require | patch | | [cloud.google.com/go/longrunning](https://redirect.github.com/googleapis/google-cloud-go) | `v0.6.4` -> `v0.6.5` | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | require | patch | | [cloud.google.com/go/spanner](https://redirect.github.com/googleapis/google-cloud-go) | `v1.76.1` -> `v1.77.0` | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | require | minor | | [github.com/GoogleCloudPlatform/opentelemetry-operations-go/exporter/metric](https://redirect.github.com/GoogleCloudPlatform/opentelemetry-operations-go) | `v0.50.0` -> `v0.51.0` | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | require | minor | | [github.com/GoogleCloudPlatform/opentelemetry-operations-go/exporter/trace](https://redirect.github.com/GoogleCloudPlatform/opentelemetry-operations-go) | `v1.26.0` -> `v1.27.0` | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | require | minor | | [github.com/go-git/go-git/v5](https://redirect.github.com/go-git/go-git) | `v5.13.2` -> `v5.14.0` | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | require | minor | | [github.com/google/pprof](https://redirect.github.com/google/pprof) | `d0013a5` -> `9094ed2` | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | require | digest | | [go](https://go.dev/) ([source](https://redirect.github.com/golang/go)) | `1.23.6` -> `1.24.1` | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | toolchain | minor | | golang.org/x/mod | `v0.23.0` -> `v0.24.0` | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | require | minor | | golang.org/x/net | `v0.35.0` -> `v0.37.0` | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | require | minor | | golang.org/x/oauth2 | `v0.27.0` -> `v0.28.0` | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | require | minor | | golang.org/x/sync | `v0.11.0` -> `v0.12.0` | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | require | minor | | golang.org/x/sys | `v0.30.0` -> `v0.31.0` | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | require | minor | | golang.org/x/text | `v0.22.0` -> `v0.23.0` | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | require | minor | | golang.org/x/time | `v0.10.0` -> `v0.11.0` | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | require | minor | | golang.org/x/tools | `v0.30.0` -> `v0.31.0` | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | require | minor | | [google.golang.org/genproto/googleapis/rpc](https://redirect.github.com/googleapis/go-genproto) | `55c9018` -> `a0af3ef` | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | [](https://docs.renovatebot.com/merge-confidence/) | require | digest | --- ### Release Notes <details> <summary>GoogleCloudPlatform/opentelemetry-operations-go (github.com/GoogleCloudPlatform/opentelemetry-operations-go/exporter/metric)</summary> ### [`v0.51.0`](https://redirect.github.com/GoogleCloudPlatform/opentelemetry-operations-go/releases/tag/v0.51.0): v1.27.0/v0.51.0 [Compare Source](https://redirect.github.com/GoogleCloudPlatform/opentelemetry-operations-go/compare/v0.50.0...v0.51.0) #### What's Changed - Update example.go documentation by [@​psx95](https://redirect.github.com/psx95) in [https://togithub.com/GoogleCloudPlatform/opentelemetry-operations-go/pull/1013](https://redirect.github.com/GoogleCloudPlatform/opentelemetry-operations-go/pull/1013) - Update some go dependencies to v1.23.6 by [@​dashpole](https://redirect.github.com/dashpole) in [https://togithub.com/GoogleCloudPlatform/opentelemetry-operations-go/pull/1014](https://redirect.github.com/GoogleCloudPlatform/opentelemetry-operations-go/pull/1014) - Update go.opentelemetry.io/collector by [@​dashpole](https://redirect.github.com/dashpole) in [https://togithub.com/GoogleCloudPlatform/opentelemetry-operations-go/pull/1019](https://redirect.github.com/GoogleCloudPlatform/opentelemetry-operations-go/pull/1019) - collector: use buildinfo to make user agent by [@​braydonk](https://redirect.github.com/braydonk) in [https://togithub.com/GoogleCloudPlatform/opentelemetry-operations-go/pull/1022](https://redirect.github.com/GoogleCloudPlatform/opentelemetry-operations-go/pull/1022) - Prepare for v1.27.0/v0.51.0 by [@​ridwanmsharif](https://redirect.github.com/ridwanmsharif) in [https://togithub.com/GoogleCloudPlatform/opentelemetry-operations-go/pull/1023](https://redirect.github.com/GoogleCloudPlatform/opentelemetry-operations-go/pull/1023) **Full Changelog**: https://togithub.com/GoogleCloudPlatform/opentelemetry-operations-go/compare/v0.50.0...v0.51.0 </details> <details> <summary>go-git/go-git (github.com/go-git/go-git/v5)</summary> ### [`v5.14.0`](https://redirect.github.com/go-git/go-git/releases/tag/v5.14.0) [Compare Source](https://redirect.github.com/go-git/go-git/compare/v5.13.2...v5.14.0) #### What's Changed - v5: Bump Go and dependencies to mitigate [GO-2025-3487](https://pkg.go.dev/vuln/GO-2025-3487) by [@​pjbgf](https://redirect.github.com/pjbgf) in [https://togithub.com/go-git/go-git/pull/1436](https://redirect.github.com/go-git/go-git/pull/1436)⚠️ Note that this version requires Go 1.23, due to the bump to `golang.org/x/crypto@v0.35.0` which mitigates the CVE above. User's that can't bump to Go 1.23 will need to remain on the previous v5.13.x release. **Full Changelog**: https://togithub.com/go-git/go-git/compare/v5.13.2...v5.14.0 </details> <details> <summary>golang/go (go)</summary> ### [`v1.24.1`](https://redirect.github.com/golang/go/compare/go1.24.0...go1.24.1) ### [`v1.24.0`](https://redirect.github.com/golang/go/compare/go1.23.6...go1.24.0) ### [`v1.23.7`](https://redirect.github.com/golang/go/compare/go1.23.6...go1.23.7) </details> --- ### Configuration 📅 **Schedule**: Branch creation - "* 0-3 * * 1" (UTC), Automerge - At any time (no schedule defined). 🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied. ♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox. 👻 **Immortal**: This PR will be recreated if closed unmerged. Get [config help](https://redirect.github.com/renovatebot/renovate/discussions) if that's undesired. --- - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box --- This PR was generated by [Mend Renovate](https://mend.io/renovate/). View the [repository job log](https://developer.mend.io/github/googleapis/google-cloud-go). <!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzOS4xODUuNCIsInVwZGF0ZWRJblZlciI6IjM5LjE4NS40IiwidGFyZ2V0QnJhbmNoIjoibWFpbiIsImxhYmVscyI6W119--> * chore: skip benchmark for all env (#11811) Fixes #11669 * fix(bigquery): Increase timeout for storage api test and remove usage of deprecated pkg (#11810) Fixes #11801 * feat(bigtable): Add support for logical views (#11792) * feat(bigtable): Add support for logical views * fix build * fixed according to PR comments * feat(storage/control): Add Anywhere cache control APIs (#11807) - [ ] Regenerate this pull request now. docs(storage/control): Added comments for Anywhere cache messages PiperOrigin-RevId: 736168602 Source-Link: https://togithub.com/googleapis/googleapis/commit/1f01eefb40000d70b0c58314709af1d4f8222cc0 Source-Link: https://togithub.com/googleapis/googleapis-gen/commit/e687c8953cf088e4b39397e33af6e2238e1720aa Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiZTY4N2M4OTUzY2YwODhlNGIzOTM5N2UzM2FmNmUyMjM4ZTE3MjBhYSJ9 BEGIN_NESTED_COMMIT feat(aiplatform): add reranker config to RAG v1 API PiperOrigin-RevId: 735952331 Source-Link: https://togithub.com/googleapis/googleapis/commit/4ce00b00904a7ce1df8c157e54fcbf96fda0dc49 Source-Link: https://togithub.com/googleapis/googleapis-gen/commit/28a0272577f679ec339a0561ad7fca3d4f6220cf Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiMjhhMDI3MjU3N2Y2NzllYzMzOWEwNTYxYWQ3ZmNhM2Q0ZjYyMjBjZiJ9 END_NESTED_COMMIT BEGIN_NESTED_COMMIT docs(eventarc/publishing): Minor documentation improvements PiperOrigin-RevId: 735932756 Source-Link: https://togithub.com/googleapis/googleapis/commit/5d0c7bf00477b653d4c79718b38e95e5a90768d8 Source-Link: https://togithub.com/googleapis/googleapis-gen/commit/66de535b0bb8c88683f64c5d00ec89b2481250bb Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiNjZkZTUzNWIwYmI4Yzg4NjgzZjY0YzVkMDBlYzg5YjI0ODEyNTBiYiJ9 END_NESTED_COMMIT BEGIN_NESTED_COMMIT docs(orchestration/airflow/service): fix Composer 3 image version format in API docs PiperOrigin-RevId: 735893970 Source-Link: https://togithub.com/googleapis/googleapis/commit/aafb43c2088fae86421aa8e98d19869c4159737d Source-Link: https://togithub.com/googleapis/googleapis-gen/commit/0dd13a81a4e3fe5492b13f91d4c38e4205c7a5be Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiMGRkMTNhODFhNGUzZmU1NDkyYjEzZjkxZDRjMzhlNDIwNWM3YTViZSJ9 END_NESTED_COMMIT BEGIN_NESTED_COMMIT fix(managedkafka): An existing google.api.http annotation `http_uri` is changed for method `GetConsumerGroup` in service `ManagedKafka` fix(managedkafka): An existing google.api.http annotation `http_uri` is changed for method `UpdateConsumerGroup` in service `ManagedKafka` fix(managedkafka): An existing google.api.http annotation `http_uri` is changed for method `DeleteConsumerGroup` in service `ManagedKafka` docs(managedkafka): A comment for field `subnet` in message `.google.cloud.managedkafka.v1.NetworkConfig` is changed PiperOrigin-RevId: 735883333 Source-Link: https://togithub.com/googleapis/googleapis/commit/8f7e301d346ba792a9bd282f8d62db7fad87cb8a Source-Link: https://togithub.com/googleapis/googleapis-gen/commit/b88fd376a83cb2b445523c0d9ba9dd964d4e078a Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiYjg4ZmQzNzZhODNjYjJiNDQ1NTIzYzBkOWJhOWRkOTY0ZDRlMDc4YSJ9 END_NESTED_COMMIT * chore: release main (#11782) * feat(bigtable): Add support for materialized views for admin client (#11793) * feat(bigtable): Add support for logical views * feat(bigtable): Add support for Materialized Views to admin client * fix build * fix build * fixed according to PR comments * PR fixes * fix merge * fix PR * wait for create mv\lv operations to complete before returning * oops --------- Co-authored-by: Luwei Ge <lwge@google.com> Co-authored-by: gcf-owl-bot[bot] <78513119+gcf-owl-bot[bot]@users.noreply.github.com> Co-authored-by: Chris Cotter <cjcotter@google.com> Co-authored-by: Ashmeen Kaur <57195160+ashmeenkaur@users.noreply.github.com> Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com> Co-authored-by: Alvaro Viebrantz <aviebrantz@google.com> Co-authored-by: Alex Hong <9397363+hongalex@users.noreply.github.com> Co-authored-by: Kien D <kientrung.dinh@anz.com> Co-authored-by: Mend Renovate <bot@renovateapp.com>
This was referenced Mar 25, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
I skipped integration tests, as this configuration is only supported for BigLake formats.
Solves #11802