fix(hermetic-build): use public maven metadata for latest version inference #3853

diegomarquezp · 2025-06-30T20:11:28Z

Currently, the get_latest_released_version() function returns 2.59.0 for gapic-generator-java. This is not correct and is due to an ongoing issue with Maven.
This PR uses the alternative maven-metadata.xml files instead, which contains a metadata/versioning/latest entry always pointing to the latest version.

[hi on] diegomarquezp:~$ function get_latest_released_version() {
    local group_id=$1
    local artifact_id=$2
    group_id_url_path="$(sed 's|\.|/|g' <<< "${group_id}")"
    url="https://repo1.maven.org/maven2/${group_id_url_path}/${artifact_id}/maven-metadata.xml"
    xml_content=$(curl -s --fail "${url}")
    latest=$(xmllint --xpath 'metadata/versioning/latest/text()' - <<< "${xml_content}")
    if [[ -z "${latest}" ]]; then
        echo "The latest version of ${group_id}:${artifact_id} is empty."
        echo "The returned json from maven.org is invalid: ${json_content}"
        exit 1
    else
        echo "${latest}"
    fi
}
[hi on] diegomarquezp:~$ get_latest_released_version com.google.api gapic-generator-java
2.60.0

…erence

diegomarquezp · 2025-06-30T20:13:46Z

Follow up: HW libraries without hermetic build (e.g. java-bigquery).

suztomo

Can you check xmllint is available in the container before merging this?

diegomarquezp · 2025-06-30T20:27:52Z

Can you check xmllint is available in the container before merging this?

Confirming manually in java-storage: googleapis/java-storage#3181
The action resulted in xmllint: command not found

Installing using sudo apt install -y libxml2-utils solves the problem.

I modified the template.

Thanks a lot for the catch, @suztomo!

suztomo · 2025-06-30T20:32:28Z

Thank you.

sonarqubecloud · 2025-06-30T20:39:30Z

Quality Gate passed for 'gapic-generator-java-root'

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud

sonarqubecloud · 2025-06-30T20:43:17Z

Quality Gate passed for 'java_showcase_integration_tests'

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud

🤖 I have created a release *beep* *boop* --- <details><summary>2.60.1</summary> ## [2.60.1](v2.60.0...v2.60.1) (2025-07-08) ### Bug Fixes * **hermetic-build:** use public maven metadata for latest version inference ([#3853](#3853)) ([0be1e96](0be1e96)) </details> --- This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please). Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>

Unfortunately, googleapis/sdk-platform-java#3853 cannot be automatically propagated. This PR manually updates this script with the latest.

* chore: manual update of update_generation_config.sh Unfortunately, googleapis/sdk-platform-java#3853 cannot be automatically propagated. This PR manually updates this script with the latest. * chore: generate libraries at Thu Jul 24 16:12:02 UTC 2025 * chore: update yaml as well * chore: bring back the script * chore: generate libraries at Thu Jul 24 16:17:24 UTC 2025 * chore: include yaml changes as well * chore: generate libraries at Thu Jul 24 17:52:43 UTC 2025 * Revert "chore: generate libraries at Thu Jul 24 17:52:43 UTC 2025" This reverts commit 3322513. * chore: generate libraries at Thu Jul 24 18:50:37 UTC 2025 * Revert "chore: generate libraries at Thu Jul 24 18:50:37 UTC 2025" This reverts commit a1c5956. * chore: generate libraries at Thu Jul 24 18:54:36 UTC 2025 * Revert "chore: generate libraries at Thu Jul 24 18:54:36 UTC 2025" This reverts commit 53c4dd7. --------- Co-authored-by: cloud-java-bot <cloud-java-bot@google.com>

Unfortunately, googleapis/sdk-platform-java#3853 cannot be automatically propagated. This PR manually updates this script with the latest.

…erence (#3853) Currently, the `get_latest_released_version()` function returns `2.59.0` for gapic-generator-java. This is not correct and is due to an ongoing issue with Maven. This PR uses the alternative `maven-metadata.xml` files instead, which contains a `metadata/versioning/latest` entry always pointing to the latest version. ```bash [hi on] diegomarquezp:~$ function get_latest_released_version() { local group_id=$1 local artifact_id=$2 group_id_url_path="$(sed 's|\.|/|g' <<< "${group_id}")" url="https://repo1.maven.org/maven2/${group_id_url_path}/${artifact_id}/maven-metadata.xml" xml_content=$(curl -s --fail "${url}") latest=$(xmllint --xpath 'metadata/versioning/latest/text()' - <<< "${xml_content}") if [[ -z "${latest}" ]]; then echo "The latest version of ${group_id}:${artifact_id} is empty." echo "The returned json from maven.org is invalid: ${json_content}" exit 1 else echo "${latest}" fi } [hi on] diegomarquezp:~$ get_latest_released_version com.google.api gapic-generator-java 2.60.0 ```

🤖 I have created a release *beep* *boop* --- <details><summary>2.60.1</summary> ## [2.60.1](v2.60.0...v2.60.1) (2025-07-08) ### Bug Fixes * **hermetic-build:** use public maven metadata for latest version inference ([#3853](#3853)) ([0be1e96](0be1e96)) </details> --- This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please). Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>

| Package | Type | Package file | Manager | Update | Change | |---|---|---|---|---|---| | [com.google.api.grpc:proto-google-common-protos](https://github.com/googleapis/sdk-platform-java) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.61.0` -> `2.61.1` | | [com.google.cloud:google-cloud-core-http](https://github.com/googleapis/sdk-platform-java) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.60.0` -> `2.60.1` | | [com.google.cloud:google-cloud-core](https://github.com/googleapis/sdk-platform-java) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.60.0` -> `2.60.1` | | [com.google.api:gax](https://github.com/googleapis/sdk-platform-java) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.70.0` -> `2.70.1` | | [software.amazon.awssdk:sdk-core](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.33.3` -> `2.33.4` | | [software.amazon.awssdk:sqs](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.33.3` -> `2.33.4` | | [software.amazon.awssdk:s3](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.33.3` -> `2.33.4` | | [software.amazon.awssdk:regions](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.33.3` -> `2.33.4` | | [software.amazon.awssdk:dynamodb-enhanced](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.33.3` -> `2.33.4` | | [software.amazon.awssdk:dynamodb](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.33.3` -> `2.33.4` | | [software.amazon.awssdk:aws-core](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.33.3` -> `2.33.4` | | [software.amazon.awssdk:bom](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.33.3` -> `2.33.4` | | [software.amazon.awssdk:auth](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.33.3` -> `2.33.4` | | [com.amazonaws:aws-java-sdk-sqs](https://aws.amazon.com/sdkforjava) ([source](https://github.com/aws/aws-sdk-java)) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `1.12.790` -> `1.12.791` | | [com.amazonaws:aws-java-sdk-s3](https://aws.amazon.com/sdkforjava) ([source](https://github.com/aws/aws-sdk-java)) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `1.12.790` -> `1.12.791` | | [com.amazonaws:aws-java-sdk-dynamodb](https://aws.amazon.com/sdkforjava) ([source](https://github.com/aws/aws-sdk-java)) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `1.12.790` -> `1.12.791` | | [com.amazonaws:aws-java-sdk-core](https://aws.amazon.com/sdkforjava) ([source](https://github.com/aws/aws-sdk-java)) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `1.12.790` -> `1.12.791` | --- ### Release Notes <details> <summary>googleapis/sdk-platform-java (com.google.cloud:google-cloud-core-http)</summary> ### [`v2.60.1`](https://github.com/googleapis/sdk-platform-java/blob/HEAD/CHANGELOG.md#2601-2025-07-08) ##### Bug Fixes - **hermetic-build:** use public maven metadata for latest version inference ([#3853](googleapis/sdk-platform-java#3853)) ([0be1e96](googleapis/sdk-platform-java@0be1e96)) </details> <details> <summary>aws/aws-sdk-java (com.amazonaws:aws-java-sdk-sqs)</summary> ### [`v1.12.791`](https://github.com/aws/aws-sdk-java/blob/HEAD/CHANGELOG.md#112791-2025-09-05) [Compare Source](aws/aws-sdk-java@1.12.790...1.12.791) #### **AWS Kinesis Video** - ### Features - Update Netty to `4.1.126.Final` </details> --- ### Configuration 📅 **Schedule**: Branch creation - "after 6pm every weekday,before 2am every weekday" in timezone Australia/Melbourne, Automerge - At any time (no schedule defined). 🚦 **Automerge**: Enabled. ♻ **Rebasing**: Never, or you tick the rebase/retry checkbox. 👻 **Immortal**: This PR will be recreated if closed unmerged. Get [config help](https://github.com/renovatebot/renovate/discussions) if that's undesired. --- - [ ] If you want to rebase/retry this PR, check this box --- This PR has been generated by [Renovate Bot](https://github.com/renovatebot/renovate). GitOrigin-RevId: c0ebffa6f441074f7a7a961e7d32f903bbbb7c27

fix(hermetic-build): use public maven metadata for latest version inf…

73df39f

…erence

product-auto-label bot added the size: xs Pull request size is extra small. label Jun 30, 2025

JoeWang1127 previously approved these changes Jun 30, 2025

View reviewed changes

suztomo previously approved these changes Jun 30, 2025

View reviewed changes

chore: add xmllint dependency installation to templates

5e51016

diegomarquezp dismissed stale reviews from suztomo and JoeWang1127 via 5e51016 June 30, 2025 20:27

diegomarquezp requested review from JoeWang1127 and suztomo June 30, 2025 20:28

chore: update dep upstream beforehand

f9c9981

suztomo approved these changes Jun 30, 2025

View reviewed changes

diegomarquezp enabled auto-merge (squash) June 30, 2025 20:36

diegomarquezp merged commit 0be1e96 into main Jun 30, 2025
57 of 60 checks passed

diegomarquezp deleted the fix-maven-search-template branch June 30, 2025 20:51

release-please bot mentioned this pull request Jun 30, 2025

chore(main): release 2.60.1 #3854

Merged

diegomarquezp mentioned this pull request Jul 24, 2025

chore: manual update of update_generation_config.sh googleapis/java-spanner#4001

Merged

diegomarquezp mentioned this pull request Jul 24, 2025

chore: manual update of update_generation_config.sh googleapis/java-storage#3205

Merged

This was referenced Jul 24, 2025

chore: manual update of update_generation_config.sh googleapis/java-pubsub#2496

Merged

chore: manual update of update_generation_config.sh googleapis/java-pubsublite#1897

Merged

This was referenced Jul 24, 2025

chore: manual update of update_generation_config.sh googleapis/java-datastore#1925

Merged

[Hermetic Build] Changes to helper scripts (e.g. update_generation_config.sh) cannot be automatically updated #3871

Open

diegomarquezp mentioned this pull request Jul 28, 2025

chore: manual update of update_generation_config.sh googleapis/google-cloud-java#11684

Merged

diegomarquezp mentioned this pull request Aug 19, 2025

Hermetic Build config update script not finding the latest gapic-generator version googleapis/google-cloud-java#11649

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

fix(hermetic-build): use public maven metadata for latest version inference #3853

fix(hermetic-build): use public maven metadata for latest version inference #3853

diegomarquezp commented Jun 30, 2025

Uh oh!

diegomarquezp commented Jun 30, 2025

Uh oh!

suztomo left a comment

Uh oh!

diegomarquezp commented Jun 30, 2025

Uh oh!

suztomo commented Jun 30, 2025

Uh oh!

sonarqubecloud bot commented Jun 30, 2025

Uh oh!

sonarqubecloud bot commented Jun 30, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

fix(hermetic-build): use public maven metadata for latest version inference #3853

fix(hermetic-build): use public maven metadata for latest version inference #3853

Conversation

diegomarquezp commented Jun 30, 2025

Uh oh!

diegomarquezp commented Jun 30, 2025

Uh oh!

suztomo left a comment

Choose a reason for hiding this comment

Uh oh!

diegomarquezp commented Jun 30, 2025

Uh oh!

suztomo commented Jun 30, 2025

Uh oh!

sonarqubecloud bot commented Jun 30, 2025

Quality Gate passed for 'gapic-generator-java-root'

Uh oh!

sonarqubecloud bot commented Jun 30, 2025

Quality Gate passed for 'java_showcase_integration_tests'

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants