Skip to content

android.yml: speed up CI (about 3 min) - #16675

Open
oech3 wants to merge 1 commit into
uutils:mainfrom
oech3:android-fast-ci
Open

oech3 wants to merge 1 commit into
uutils:mainfrom
oech3:android-fast-ci

Conversation

@oech3

@oech3 oech3 commented Nov 18, 2026 •

Copy link
Copy Markdown
Contributor

Closes #16669 Closes #16619 Closes #16663

Comment thread .github/workflows/android.yml Resolved
Comment thread .github/workflows/android.yml Resolved
Comment thread .cargo/config.toml Resolved
Comment thread .github/workflows/android.yml Resolved
Comment thread .github/workflows/android.yml Resolved
Comment thread .github/workflows/android.yml Resolved
@oech3
oech3 force-pushed the android-fast-ci branch 4 times, most recently from 236d89a to f4323f8 Compare November 18, 2026 14:07
@oech3

oech3 commented Nov 18, 2026

Copy link
Copy Markdown
Contributor Author

*ftl was fixed, but many tests are failing.

@oech3
oech3 marked this pull request as draft November 18, 2026 14:10
@oech3

This comment was marked as resolved.

@oech3
oech3 force-pushed the android-fast-ci branch 2 times, most recently from cf9ba27 to a6f3000 Compare November 18, 2026 15:27
@oech3
oech3 marked this pull request as ready for review November 18, 2026 15:28
@oech3

oech3 commented Nov 18, 2026

Copy link
Copy Markdown
Contributor Author

I was needed to ignore some tests. Some tests might cross-build specific. But I think that cross-build for Android is important more than native build for most developers and better to catch those issues more that passing at native build.

Comment thread tests/by-util/test_od.rs Resolved
Comment thread tests/by-util/test_ls.rs Resolved
Comment thread tests/by-util/test_cp.rs Outdated
#[uutests::wasi_ignore(NoPermissionBits)]
#[test]
#[cfg(not(windows))]
#[cfg_attr(target_os = "android", ignore = "sandbox?")]

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"sandbox?" isn't a reason. Please find the real one, or move the ignores to a separate PR

Comment thread .github/workflows/android.yml Resolved
Comment thread .github/workflows/android.yml Resolved
Comment thread .github/workflows/android.yml Outdated
[ .[] | select(.executable != null) | .executable | select(test("/coreutils$") | not) ]
| unique
| .[]
' | sed 's#^.*$#adb push & /data/local/tmp/tester\nadb shell "cd /data/local/tmp \&\& UUTESTS_BINARY_PATH=/data/local/tmp/coreutils /data/local/tmp/tester"#' > tests.sh

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

generating shell with sed is hard to read. Could tests.sh be a simple loop over the list?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No. script: section rejected any loop syntax.

Comment thread .github/workflows/android.yml Resolved
@oech3
oech3 force-pushed the android-fast-ci branch 2 times, most recently from 6c90098 to 7f948fa Compare November 19, 2026 00:07
@github-actions

Copy link
Copy Markdown

Binary size comparison:

Individual binary size comparison VS main (threshold: >=5% AND >=4 KB).

Total size of compared binaries: 155.48 MB (+100 KB, +0.06%)

Significant per-binary changes:
  env     1.20 MB ->    1.28 MB  (+80 KB, +6.51%)

@oech3
oech3 force-pushed the android-fast-ci branch 9 times, most recently from 193a835 to b769eb0 Compare November 19, 2026 03:27
@oech3

oech3 commented Nov 19, 2026

Copy link
Copy Markdown
Contributor Author

I updated ignored comment, or adjusted tests except for od.

@codspeed

codspeed Bot commented Nov 19, 2026 •

Copy link
Copy Markdown
Contributor

Merging this PR will degrade performance by 38.07%

3 warnings, 1 note

⚠️ 113 benchmarks are dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

⚠️ 39 benchmarks with a significant change ran on different hardware

Their base and head results were measured on machines with a different CPU, core count or memory, so the changes might not come from the code. Run base and head on the same runner type.

Learn more about Macro Runners

See affected benchmarks

⚠️ 44 benchmarks with a significant change ran on a different major version of their CodSpeed integration

Their head results were measured with codspeed-rust 6.1.0, a different major version than their base results. A major version can change how benchmarks are measured, so the changes might come from this version difference rather than from the code. Comparisons between runs on the same major version are not affected.

See affected benchmarks

ℹ️ This run is excluded from the branch history

This commit was force-pushed, so this run no longer appears in the branch's performance history.

⚡ 5 improved benchmarks
❌ 39 regressed benchmarks
✅ 146 untouched benchmarks
⏩ 293 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Benchmark BASE HEAD Efficiency
❌ single_date_now 169.2 µs 2,550.7 µs -93.37%
❌ complex_relative_date 259.3 µs 2,643.2 µs -90.19%
❌ join_unicode_locale 1.8 ms 8.1 ms -77.46%
❌ b64_encode_synthetic 111.8 µs 457.2 µs -75.54%
❌ hostname_ip_lookup[100000] 155.6 µs 544.2 µs -71.4%
❌ factor_large_u64_prime 136.1 µs 474 µs -71.29%
❌ factor_64bit_semiprime 159.9 µs 498.8 µs -67.94%
❌ cut_fields_newline_delim 172 µs 516.4 µs -66.7%
❌ timeout_quick_exit 159 µs 416.9 µs -61.86%
❌ timer_expiry_latency[0.02] 170.5 µs 427.4 µs -60.09%
❌ timeout_enforced 169 µs 422 µs -59.96%
❌ cat_default[10000000] 170.3 µs 425.3 µs -59.96%
❌ timer_expiry_latency[0.005] 171.7 µs 427.1 µs -59.8%
❌ join_french_locale 18.3 ms 44.7 ms -59.2%
❌ merge_pre_sorted_files_utf8_locale 239.8 ms 581.4 ms -58.75%
❌ split_number_chunks 258.4 µs 594.8 µs -56.56%
❌ factor_a_prime_to_the_seventh 480.2 µs 819.1 µs -41.37%
❌ dd_copy_partial 743.8 µs 1,220.8 µs -39.07%
❌ dd_copy_64k_blocks 909.2 µs 1,393.8 µs -34.77%
❌ ls_recursive_long_all_mixed_tree 4.5 ms 6.9 ms -34.12%
... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing oech3:android-fast-ci (2a524f8) with main (12953e7)2

Open in CodSpeed

Footnotes

  1. 293 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

  2. No successful run was found on main (c71d716) during the generation of this report, so 12953e7 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report. ↩

@github-actions

Copy link
Copy Markdown

GNU testsuite comparison:

Congrats! The gnu test tests/tail/follow-name is no longer failing!
Congrats! The gnu test tests/tail/pid-pipe is no longer failing!

@oech3
oech3 requested a review from sylvestre November 20, 2026 03:36
@oech3
oech3 force-pushed the android-fast-ci branch 3 times, most recently from b0f8cb8 to 2a524f8 Compare November 21, 2026 14:30

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

android.yml: build binaries on Ubuntu, not at Android for speed Drop legacy API from Android CI

2 participants