Commit graph

80816 commits

Author SHA1 Message Date
Islam Elbanna
8503760df9 Zip apex system server and standalone system server jars into system_server.zip.
Currently, the Art benchmark service is depending on the boot.zip file
to filter out boot image profiles based on the existing jars in this zip
file, and to expand profiling to apex system server jars and standalone
jars we need to export these jars in another zip file.

Bug: 241823638
Test: Check the generated `system_server.zip` using `m droidcore dist`
Change-Id: Ief2c92588b5e4f6ccd5163ece8d241bc473b22ad
2022-11-02 12:34:22 +00:00
Treehugger Robot
b50b6850b7 Merge "sbom_test - use UTC" 2022-11-02 05:20:06 +00:00
Treehugger Robot
1ff5e0e34f Merge "Concatenate cl hashes so that git revert can revert multiple commits." 2022-11-02 04:22:05 +00:00
Maciej Żenczykowski
458f90272c sbom_test - use UTC
Test: TreeHugger, m compliance_sbom
Signed-off-by: Maciej Żenczykowski <maze@google.com>
Change-Id: Id2abec8537a1dfa32d6816da4c34c86f46313086
2022-11-01 19:49:05 -07:00
Treehugger Robot
324ad55c0a Merge "Hack aosp_riscv64 config to fix m droid dist" 2022-11-02 02:18:05 +00:00
Alex Buynytskyy
07bc317c45 Concatenate cl hashes so that git revert can revert multiple commits.
Bug: 243966946
Test: run locally
Change-Id: I59bd588f5368f8e47fd9272b561b63d940e1072d
2022-11-01 18:45:51 -07:00
Treehugger Robot
99d607c0ad Merge "Unconditionally generate build_manifest.pb" 2022-11-01 23:50:05 +00:00
Ibrahim Kanouche
1bb27903e8 Merge "Added SBOM generator module to implement the spdx utility bill of material" 2022-11-01 23:36:22 +00:00
Colin Cross
aef92033bc Hack aosp_riscv64 config to fix m droid dist
`m droid dist` fails on hiddenapi rules missing bootclasspath classes,
add default_art_config.mk to set PRODUCT_BOOT_JARS, and then override
PRODUCT_USES_DEFAULT_ART_CONFIG back to false to avoid a dependency
from the boot.zip dist artifact to dex2oat, which doesn't work for
riscv64 yet.

Test: lunch aosp_riscv64-userdebug && m droid dist
Change-Id: Icc332ee9132568251386ec742932f6708312bb92
2022-11-01 16:12:27 -07:00
Treehugger Robot
b9b754e19b Merge "HACK: disable most of the build for riscv64" 2022-11-01 22:52:08 +00:00
Ibrahim Kanouche
bedf1a8a86 Added SBOM generator module to implement the spdx
utility bill of material

Added methods to graph.go to extract the annotation types

Test: m compliance_sbom

Test: tested against real targets, see go/paste/4932131502424064

Bug: 241591242
Change-Id: I344c15d64cd034d72076f9d9a677e593e288e3a6
2022-11-01 20:42:01 +00:00
Jihoon Kang
eb35b48df7 Merge "Create custom diff tool to compare stub contents" 2022-11-01 20:32:20 +00:00
Colin Cross
f310841384 HACK: disable most of the build for riscv64
Disable most of the inherited product makefiles so that `m droid`
passes, and then add back a few working packages to PRODUCT_PACKAGES.

Test: lunch aosp_riscv64-userdebug && m droid
Change-Id: Ifbc4758735ec29876cbdd5a2ec97dd99aaebc210
2022-11-01 12:08:05 -07:00
Victor Hsieh
921d3b0f11 Unconditionally generate build_manifest.pb
Previously, the file is generated only if there's interesting files. The
condition isn't really desirable in build rule evaluation, and makes it
a bit harder to handle in the consuming code.

Bug: 256793394
Test: atest ComposHostTestCases odsign_e2e_tests
Change-Id: I87b257b6ce6ab0ba565378c885adf35c1d25235b
2022-11-01 11:08:31 -07:00
Sam Delmerico
9fac7000ec Merge "move logtags rule from //build/make to //build/bazel" 2022-11-01 13:50:10 +00:00
Treehugger Robot
2b392dd8ed Merge "Check packages/modules before packing otatools keys" 2022-11-01 05:59:52 +00:00
Hongguang
07babe080a Check packages/modules before packing otatools keys
Fix build error when packages/modules is not existed.

Bug: 256565230
Test: make dist, check otatools.zip
Change-Id: I4153b143e677e35f95a3d47663cb8efcde7abdbf
2022-11-01 00:33:25 +00:00
Treehugger Robot
5667fe0a74 Merge "Allow RO build only for readonly mount points" 2022-10-31 22:58:32 +00:00
Treehugger Robot
fb5f2de383 Merge "Pack the mainline modules test keys into the otatools.zip" 2022-10-31 20:21:11 +00:00
Treehugger Robot
83ac0bf9c4 Merge changes I381ee79e,Ie30edbb2
* changes:
  Replace nil-able *sync.Waitgroup with sync.Once
  Fix top-down resolve re-walking graph too much.
2022-10-31 19:58:35 +00:00
Hongguang
547812d318 Pack the mainline modules test keys into the otatools.zip
Bug: 256565230
Test: make dist, check otatools.zip
Change-Id: I7c386ee8f8e3ec6f3d5c767504e23cb1f1bacad2
2022-10-31 10:25:29 -07:00
Anton Hansson
0cd509a08a Merge "Revert^2 "Update naming of platforms subdir"" 2022-10-31 12:57:30 +00:00
Martin Stjernholm
e279ae7226 Merge "Add allowlist patterns for dexpreopted files." 2022-10-31 11:52:10 +00:00
Dennis Song
70bcc91169 Merge "Add the path of GSI document in gsi_release.mk" 2022-10-31 01:35:03 +00:00
Bob Badour
5c12c66769 Replace nil-able *sync.Waitgroup with sync.Once
Simplifies synchronization and eliminates lock for nil waitroup.

Test: m droid

Test: m out/soong/.intermediates/packages/modules/StatsD/apex/com.android.os.statsd/android_common_com.android.os.statsd_image/NOTICE.html.gz

Change-Id: I381ee79e142214e7331241071f076db2f7960ba6
2022-10-29 22:48:13 -07:00
Bob Badour
d2c28ba897 Fix top-down resolve re-walking graph too much.
Firing off multiple concurrent walks of the same sub-tree with the same
conditions. Data race meant every walk would proceed. Move the logic to
entry of walk function and compare under lock.

Bug: 255526010

Test: m droid

Test: m out/soong/.intermediates/packages/modules/StatsD/apex/com.android.os.statsd/android_common_com.android.os.statsd_image/NOTICE.html.gz

Change-Id: Ie30edbb2ac9eaa9aa55badfc518d51eaadbb6be6
2022-10-29 22:27:49 -07:00
Treehugger Robot
aff9f3a77c Merge "Add some documentation and simplify data model." 2022-10-29 06:57:52 +00:00
Jihoon Kang
3d38b6d9c8 Create custom diff tool to compare stub contents
Context:
- Create a tool to analyze loose equivalence of the stubs in two
  directories
- The tool can analyze strict equivalence of the directories of the
  stubs in two directories
- Analyze text to compare loose equivalence of the stub contents; Add a
  functionality to pass `skip_words` as arguments, which are optional
  list of words used to signal the tool which words are not considered
  diff
- The tool can be locally used to compare stub contents, and does not
  contribute to build process

Test: m
Change-Id: I74563a9a24ecdde939be2ce37b9096a9aeb4920a
2022-10-28 22:45:08 +00:00
Treehugger Robot
a56bce6ef1 Merge "Speed up m command autocompletion" 2022-10-28 20:40:32 +00:00
Bob Badour
43daade15f Add some documentation and simplify data model.
Bug: 245562496

Test: m droid
Change-Id: Iae757a5767522e0734abbe3840ea0939620197e7
2022-10-28 12:06:08 -07:00
Cole Faust
5d825b7a68 Speed up m command autocompletion
Generate a all_modules.txt file on every build that
can be used for autocompleting.

Because this adds time to every non-incremental build,
I profiled it by using `$(shell date +"%s.%3N")` before
and after, and disovered it only adds about 0.01 seconds
to the build. And of course it won't be rerun if there
weren't build changes.

Bug: 255867758
Test: Manually
Change-Id: I1d3f1008611fd542884322b27b19ea2fa1d341fe
2022-10-28 10:44:02 -07:00
Anton Hansson
874dbe7b1b Revert^2 "Update naming of platforms subdir"
This reverts commit 6137ffa5de.

Reason for revert: Roll-forward with fix for codename SDKs (PS2)

Test: m sdk dist in all 3 variants of branches
Change-Id: Iffdf650a43aa050d70e01f73d78cf622cb206fc6
2022-10-28 09:03:33 +00:00
Treehugger Robot
904dd87a75 Merge "Add AllMetadataFiles() method to track deps." 2022-10-28 04:21:06 +00:00
Bob Badour
ab5cfbd5b7 Switch noticeindex from regex to proto.
Bug: 254534552

Test: m droid dist cts alllicensemetadata

Test: repo forall -c 'echo -n "$REPO_PATH  " && $ANDROID_BUILD_TOP/out/host/linux-x86/bin/compliance_checkmetadata . 2>&1' | fgrep -v PASS

Change-Id: I34dfe143cdc88432d6e33abee096409a37ce3b7e
2022-10-27 18:13:24 -07:00
Bob Badour
d6574e5c97 Add AllMetadataFiles() method to track deps.
Improve METADATA parsing error message.

Example error message (for an unqoted string url starting with ssh:):

============
  error in project "<redacted>" METADATA "<redacted>/METADATA": proto: (line 4:12): invalid value for string type: ssh

METADATA and METADATA.android files must parse as text protobufs
defined by
   build/soong/compliance/project_metadata_proto/project_metadata.proto

* unknown fields don't matter
* check invalid ENUM names
* check quoting
* check unescaped nested quotes
* check the comment marker for protobuf is '#' not '//'

if importing a library that uses a different sort of METADATA file, add
a METADATA.android file beside it to parse instead
============

Bug: 254534552

Test: m droid dist cts alllicensemetadata

Change-Id: Ie5c0adc7362941e455dd522baaa31f2913d7db5f
2022-10-27 18:12:30 -07:00
Treehugger Robot
a2faaa8c45 Merge "Remove all ZIP64LIMIT hack" 2022-10-27 22:44:22 +00:00
Treehugger Robot
1fca7c5e7f Merge "Enable zip64 support in build image script" 2022-10-27 22:31:00 +00:00
Jooyung Han
e3862eacb6 Merge "Fix boot fail due to missing /apex in images" 2022-10-27 21:54:13 +00:00
Victor Liu
c8c98e3f00 Merge "Revert "Fix typo"" 2022-10-27 19:11:31 +00:00
Brad Hinegardner
3e7f6b737c Revert "Fix typo"
Revert "Revert ^2 "Prevent unspecified values in soong_config_st..."

Revert submission 2262062-colefaust_soong_config_string_variable_2nd_try

Reason for revert: breaks builds, b/255996492 among others
Reverted Changes:
I3e2f59e5f:Fix typo
Id3bcd9a46:Revert ^2 "Prevent unspecified values in soong_con...

Change-Id: I9a9a150844c19eb8421575f5753b335f80ab6c66
2022-10-27 19:01:15 +00:00
Treehugger Robot
30b4bde37a Merge "core: Use pvmfw_embedded_key for INTERNAL_PVMFW_EMBEDDED_AVBKEY" 2022-10-27 18:47:43 +00:00
Treehugger Robot
6554098195 Merge "Call lunch before using b." 2022-10-27 17:36:28 +00:00
Spandan Das
03b846ff37 Merge "Migrate check_elf_file.py to python3" 2022-10-27 16:46:18 +00:00
Jaegeuk Kim
551a2e66c3 Allow RO build only for readonly mount points
Should support RW for all other partitions.

Bug: 255454067
Change-Id: I9d87cf39195f8da0f6fe4153c703ba6a372aa2ea
Signed-off-by: Jaegeuk Kim <jaegeuk@google.com>
2022-10-27 09:46:03 -07:00
Cole Faust
eef714a380 Merge "Fix typo" 2022-10-27 16:41:29 +00:00
Jingwen Chen
6db4d4f435 Call lunch before using b.
lunch is required to set up PATH to access build/bazel/bin/b as b.

Test: run the test
Bug: 255711288
Fixes: 255711288
Change-Id: Ie5bad8ffdacc3d59114f70d7f533486ebd12f778
2022-10-27 12:52:17 +00:00
Yi-yo Chiang
ed5649636a Merge "Reland "Mark BOARD_BUILD_SYSTEM_ROOT_IMAGE as KATI_obsolete_var"" 2022-10-27 08:26:54 +00:00
Spandan Das
60b8195c83 Migrate check_elf_file.py to python3
Also, create a python_binary_host so that it runs using the hermetic
python toolchain.

Test: m check-elf-files
Bug: 203436762
Change-Id: I964342a27f6b6c9dcdbbe910d4dc6c9ec00c2213
2022-10-27 02:08:23 +00:00
Roman Kiryanov
ada0ed43c0 Remove references to device/generic/goldfish/arm32-vendor.mk
this file is not maintained and being retired.

Bug: 250696437
Test: presubmit
Signed-off-by: Roman Kiryanov <rkir@google.com>
Change-Id: I6f84ae055014e16ef8af92d77c8db95f714e4182
2022-10-26 17:09:47 -07:00
Kelvin Zhang
37a4290909 Remove all ZIP64LIMIT hack
In the old days, we hacked values of ZIP64LIMIT to get around size
limitations of non-zip64 supported zip files. Now that we switched to
python3 + zip64, there's no point in keeping those hacks.

Test: th
Bug: 255683436
Change-Id: I913db33dad5503736c68a7a1f1321aa952019f60
2022-10-26 13:22:52 -07:00