unbottled dependencies error when attempting to build bottle using test-bot via github ci #4856

ipatch · 2023-10-23T12:15:57Z

ipatch
Oct 23, 2023

Output of `brew config`

HOMEBREW_VERSION: 4.1.16-24-g35746e0
ORIGIN: https://github.com/Homebrew/brew
HEAD: 35746e0a6ba6c3c5cfe56d99f79d9ec9f52ee15f
Last commit: 27 hours ago
Core tap origin: https://github.com/ipatch/homebrew-core-mojave
Core tap HEAD: c3dcecf96a4ecd59c13c56cd000156db6bef7e3a
Core tap last commit: 13 hours ago
Core tap branch: master
Core tap JSON: 23 Oct 01:35 UTC
HOMEBREW_PREFIX: /usr/local
HOMEBREW_CASK_OPTS: []
HOMEBREW_CORE_GIT_REMOTE: https://github.com/ipatch/homebrew-core-mojave
HOMEBREW_DEVELOPER: set
HOMEBREW_EDITOR: nvim
HOMEBREW_MAKE_JOBS: 8
HOMEBREW_NO_ANALYTICS: set
HOMEBREW_NO_AUTO_UPDATE: set
HOMEBREW_NO_GITHUB_API: set
HOMEBREW_NO_INSTALL_CLEANUP: set
HOMEBREW_NO_INSTALL_UPGRADE: set
HOMEBREW_NO_INSTALLED_DEPENDENTS_CHECK: set
HOMEBREW_SORBET_RUNTIME: set
Homebrew Ruby: 2.6.10 => /usr/local/Homebrew/Library/Homebrew/vendor/portable-ruby/2.6.10_1/bin/ruby
CPU: octa-core 64-bit penryn
Clang: 11.0.0 build 1100
Git: 2.21.1 => /Applications/Xcode.app/Contents/Developer/usr/bin/git
Curl: 7.54.0 => /usr/bin/curl
macOS: 10.14.6-x86_64
CLT: 11.3.1.0.1.1576735732
Xcode: 11.3.1

Output of `brew doctor`

Warning: Using `--insecure` with curl to download formula.jws.json because we need it to run `brew install ca-certificates` in order to download securely from now on. Checksums will still be verified.
Your system is ready to brew.

Description of issue

i'm attempting to rebuild a bottle for freecad/freecad/[email protected] using one of our self-hosted runners specifically the vmmojave self-hosted runner. the build fails at the below step using the github ci.

https://github.com/FreeCAD/homebrew-freecad/actions/runs/6607669151/job/17945356992#step:17:48

not sure why test-bot thinks there are unbottled dependencies because the only dependency [email protected] has is pcre2, and my fork / tap of homebrew-core-mojave has a bottle for pcre2.

i tried running the below that test-bot command locally on the mojave machine that is used as the self-hosted runner.

brew deps --tree --annotate --include-build --include-test freecad/freecad/[email protected]

output

Warning: Using `--insecure` with curl to download cask.jws.json because we need it to run `brew install ca-certificates` in order to download securely from now on. Checksums will still be verified.
freecad/freecad/[email protected]
└── pcre2
Warning: Using `--insecure` with curl to download formula.jws.json because we need it to run `brew install ca-certificates` in order to download securely from now on. Checksums will still be verified.

i took a look at the test-bot source code, but couldn't figure out exactly why I'm getting this error unfortunately.

Answered by Bo98

Oct 23, 2023

Ahh right yeah I think setup-homebrew unsets it because we had to work around some problematic behaviour on the default GitHub runners. If you set it as an env for just that step in the workflow it should work.

e.g.

- name: build bottle using test-bot for current formula
  id: build_bottle
  env:
    HOMEBREW_NO_INSTALL_FROM_API: 1

The setup-homebrew change has not been a problem for most people as custom homebrew-core forks are extremely rare. You don't need to set HOMEBREW_NO_INSTALL_FROM_API anywhere that doesn't use a forked homebrew-core.

View full answer

ipatch · 2023-10-23T12:51:31Z

ipatch
Oct 23, 2023
Author

decided to run test-bot locally with the same user that has brew installed in /usr/local, using test-bot with the below command,

brew test-bot -v --keep-old --only-json-tab --skip-recursive-dependents --root-url https://ghcr.io/v2/freecad/homebrew-freecad  --tap=freecad/freecad [email protected] -d

i added the -d debug flag and it seems that brew is probably not finding the appropriate bottle for the [email protected] dependency, because it's using using the brew API?

output

==> Using Homebrew/homebrew-test-bot bc9e503 (revert brew doctor changes in setup.rb)
==> Using Homebrew/brew 4.1.16-24-g35746e0a6 (Merge pull request #16129 from apainintheneck/rescue-formula-spec-errors-in-parser)
==> Using Homebrew/homebrew-core c3dcecf96 (pcre2: update 10.40 bottle.)
==> Testing freecad/homebrew-freecad ( 23676ab (Merge 4214cf566cb391f52e3f969700ed19f9b044ee84 into 381aa3bef75e190690f421532941403a395b8249):

==> Running Setup#run!
==> brew install-bundler-gems --add-groups=style,formula_test,livecheck
/usr/bin/env brew install-bundler-gems --add-groups=style,formula_test,livecheck

==> brew config
/usr/bin/env brew config
HOMEBREW_VERSION: 4.1.16-24-g35746e0
ORIGIN: https://github.com/Homebrew/brew
HEAD: 35746e0a6ba6c3c5cfe56d99f79d9ec9f52ee15f
Last commit: 27 hours ago
Core tap origin: https://github.com/ipatch/homebrew-core-mojave
Core tap HEAD: c3dcecf96a4ecd59c13c56cd000156db6bef7e3a
Core tap last commit: 14 hours ago
Core tap branch: master
Core tap JSON: 23 Oct 01:35 UTC
HOMEBREW_PREFIX: /usr/local
HOMEBREW_BOOTSNAP: set
HOMEBREW_CASK_OPTS: []
HOMEBREW_CORE_GIT_REMOTE: https://github.com/ipatch/homebrew-core-mojave
HOMEBREW_CURL_PATH: /usr/bin/curl
HOMEBREW_DEVELOPER: set
HOMEBREW_EDITOR: nvim
HOMEBREW_FAIL_LOG_LINES: 150
HOMEBREW_GIT_EMAIL: [email protected]
HOMEBREW_GIT_NAME: BrewTestBot
HOMEBREW_GIT_PATH: /usr/bin/git
HOMEBREW_MAKE_JOBS: 8
HOMEBREW_NO_ANALYTICS: set
HOMEBREW_NO_AUTO_UPDATE: set
HOMEBREW_NO_EMOJI: set
HOMEBREW_NO_ENV_HINTS: set
HOMEBREW_NO_GITHUB_API: set
HOMEBREW_NO_INSTALL_CLEANUP: set
HOMEBREW_NO_INSTALL_UPGRADE: set
HOMEBREW_NO_INSTALLED_DEPENDENTS_CHECK: set
HOMEBREW_SORBET_RUNTIME: set
Homebrew Ruby: 2.6.10 => /usr/local/Homebrew/Library/Homebrew/vendor/portable-ruby/2.6.10_1/bin/ruby
CPU: octa-core 64-bit penryn
Clang: 11.0.0 build 1100
Git: 2.21.1 => /usr/bin/git
Curl: 7.54.0 => /usr/bin/curl
macOS: 10.14.6-x86_64
CLT: 11.3.1.0.1.1576735732
Xcode: 11.3.1

==> Running TapSyntax#run!
==> brew style freecad/freecad
/usr/bin/env brew style freecad/freecad
Inspecting 17 files
.................

17 files inspected, no offenses detected
==> brew readall --aliases --os=all --arch=all freecad/freecad
/usr/bin/env brew readall --aliases --os=all --arch=all freecad/freecad

==> brew audit --except=installed --tap=freecad/freecad
/usr/bin/env brew audit --except=installed --tap=freecad/freecad


==> Running FormulaeDetect#detect_formulae!
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::FormulaLoader): loading /usr/local/Homebrew/Library/Taps/freecad/homebrew-freecad/Formula/[email protected]
    url               (blank)
    tap origin/master 381aa3b (overhaul tests.yml for building formula [no ci])
    HEAD              23676ab (Merge 4214cf566cb391f52e3f969700ed19f9b044ee84 into 381aa3bef75e190690f421532941403a395b8249)
    diff_start_sha1   23676ab54520b4ae545e627ce7b4d3d042666d1c
    diff_end_sha1     23676ab54520b4ae545e627ce7b4d3d042666d1c

    testing_formulae  freecad/freecad/[email protected]
    added_formulae    (none)
    modified_formulae (none)
    deleted_formulae  (none)

==> Running Formulae#run!
/usr/bin/env PATH=/usr/local/opt/gh/bin:/usr/local/bin:/usr/local/sbin:/usr/local/Homebrew/Library/Homebrew/shims/shared:/Users/brewer/.local/bin:/usr/sbin:/sbin:/usr/bin:/bin:/opt/X11/bin:/usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/cmd:/usr/local/Homebrew/Library/Taps/homebrew/homebrew-test-bot/cmd gh auth token --hostname github.com
/usr/bin/env git credential-osxkeychain get

==> Running Formulae#formula!(freecad/freecad/[email protected])
==> brew deps --tree --annotate --include-build --include-test freecad/freecad/[email protected]
/usr/bin/env brew deps --tree --annotate --include-build --include-test freecad/freecad/[email protected]
freecad/freecad/[email protected]
└── pcre2

/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::FormulaAPILoader): loading pcre2 from API
Error: Not building a bottle for [email protected] because it has unbottled dependencies.
==> SKIPPED freecad/freecad/[email protected]
Warning: No bottle built.

==> Skipped or failed formulae:
freecad/freecad/[email protected]
/usr/bin/env PATH=/usr/local/opt/gh/bin:/usr/local/bin:/usr/local/sbin:/usr/local/Homebrew/Library/Homebrew/shims/shared:/Users/brewer/.local/bin:/usr/sbin:/sbin:/usr/bin:/bin:/opt/X11/bin:/usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/cmd:/usr/local/Homebrew/Library/Taps/homebrew/homebrew-test-bot/cmd gh auth token --hostname github.com
/usr/bin/env git credential-osxkeychain get
All steps passed!

0 replies

Bo98 · 2023-10-23T13:12:16Z

Bo98
Oct 23, 2023
Maintainer

my fork / tap of homebrew-core-mojave has a bottle for pcre2.

How do you implement this? If it's just a custom git remote, you'll need to specify HOMEBREW_NO_INSTALL_FROM_API=1 on Mojave (and Catalina I guess).

0 replies

ipatch · 2023-10-23T15:40:51Z

ipatch
Oct 23, 2023
Author

thanks bo. 🙏 i had specified that in my tests.yml but i guess it couldnt hurt if i added that for the user running test-bot. ill give that a go when im not AFK

1 reply

Bo98 Oct 23, 2023
Maintainer

Ahh right yeah I think setup-homebrew unsets it because we had to work around some problematic behaviour on the default GitHub runners. If you set it as an env for just that step in the workflow it should work.

e.g.

- name: build bottle using test-bot for current formula
  id: build_bottle
  env:
    HOMEBREW_NO_INSTALL_FROM_API: 1

The setup-homebrew change has not been a problem for most people as custom homebrew-core forks are extremely rare. You don't need to set HOMEBREW_NO_INSTALL_FROM_API anywhere that doesn't use a forked homebrew-core.

Answer selected by ipatch

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Homebrew

unbottled dependencies error when attempting to build bottle using test-bot via github ci #4856

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 3 comments 1 reply

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Select a reply

Homebrew

unbottled dependencies error when attempting to build bottle using test-bot via github ci #4856

ipatch Oct 23, 2023

Output of brew config

Output of brew doctor

Description of issue

Replies: 3 comments · 1 reply

ipatch Oct 23, 2023 Author

Bo98 Oct 23, 2023 Maintainer

ipatch Oct 23, 2023 Author

Bo98 Oct 23, 2023 Maintainer

ipatch
Oct 23, 2023

Output of `brew config`

Output of `brew doctor`

Replies: 3 comments 1 reply

ipatch
Oct 23, 2023
Author

Bo98
Oct 23, 2023
Maintainer

ipatch
Oct 23, 2023
Author

Bo98 Oct 23, 2023
Maintainer