Commit graph

27522 commits

Author SHA1 Message Date
Treehugger Robot
faf30e19d6 Merge "Add empty tag support for java_import" 2020-10-15 21:47:11 +00:00
Tom Cherry
5a09f1ca3b Merge "Update liblog header paths after git project move" am: 2517c408e5
Original change: https://android-review.googlesource.com/c/platform/build/soong/+/1455957

Change-Id: I4bf066a21db526d0b6a2f1e8f69565ff279f6d85
2020-10-15 21:33:10 +00:00
Tom Cherry
2517c408e5 Merge "Update liblog header paths after git project move" 2020-10-15 21:24:58 +00:00
Liz Kammer
b524af7d01 Clarify error for soong_ui failing to parse args am: 0e7993e3d2
Original change: https://android-review.googlesource.com/c/platform/build/soong/+/1462685

Change-Id: I70d7bc3c58b7d0e0993b90661d9415714dd000c6
2020-10-15 21:19:56 +00:00
Colin Cross
d888b6b4fc Add stats from ninja subprocesses to build.trace.gz
Propagate the subprocess stats from ninja to build.trace.gz.

There is too much data here to put into separate counters for each
statistic, so put them into args on each duration event for now.

We would like to track max RSS for each subprocess, but the Linux
kernel inherits the max RSS of the ninja process in each subprocess,
which sets a lower bound on the measurable max RSS to the size of
the ninja process.  The ninja process is large due to the multi-GB
build.ninja files.

Bug: 170701554
Test: examine build.trace.gz
Change-Id: I8aaaafe627a57f1a500af098c097c6381c583ba5
2020-10-15 13:46:32 -07:00
Kousik Kumar
578ba0021f Add -fdebug-compilation-dir option
The main use of this flag is to be to make both the debug info
and the build command line be independent of the compilation dir.
See: https://reviews.llvm.org/D63387 & https://blog.llvm.org/2019/11/deterministic-builds-with-clang-and-lld.html

Removed -fdebug-prefix-map and PWD variable being set in the compile
command line - these were workarounds we originally did to ensure that
the compile output is independent of the working directory and are no
longer needed now that we have -fdebug-compilation-dir.

Test: Ran "m
out/target/product/crosshatch/obj/SHARED_LIBRARIES/libexif.vendor_intermediates/same_vndk_variants.timestamp"
which fails on an RBE hardened stack without this change and passes with
this change.

Bug: b/169266636
Change-Id: Ib0f271e55f6cf0c89a30e65d3a0b25fe3f3a8f48
2020-10-15 15:25:08 -04:00
Liz Kammer
0e7993e3d2 Clarify error for soong_ui failing to parse args
Test: m soong_ui and give invalid command line args
Change-Id: I7b4479b392d953bd1d87218184c5ed2143568a07
2020-10-15 11:07:13 -07:00
Saeid Farivar Asanjan
128fe5c1f5 Add empty tag support for java_import
Test: manual
Change-Id: I53d7c6bb620fa8fe7f5c3ec0a12f723eb62fca16
2020-10-15 17:55:24 +00:00
Christopher Parsons
9e10324bf8 Merge "Change bazel_module property to be of struct type instead of string" am: 38fa0f5a77
Original change: https://android-review.googlesource.com/c/platform/build/soong/+/1461462

Change-Id: I8339233a9d5a86b9e81949aad4b53c2b79785ff6
2020-10-15 14:44:54 +00:00
Christopher Parsons
38fa0f5a77 Merge "Change bazel_module property to be of struct type instead of string" 2020-10-15 14:19:18 +00:00
Kiyoung Kim
62abd12ba5 Handle new filetype 'linker_config'
Handle new filetype 'linker_config' which is configuration for
linkerconfig in json type and convert into protobuf in build time.

Bug: 169634881
Test: Build succeeded and cuttlefish boot succeeded
Change-Id: I56555fc738e6d6600d15a191a24f79a2ee747f52
2020-10-15 23:09:35 +09:00
Chih-hung Hsieh
4936f55db1 Merge "Use protobuf-codegen default and add mod_stem.rs" am: f4155dc551
Original change: https://android-review.googlesource.com/c/platform/build/soong/+/1452056

Change-Id: I789e92c7e439545ff4c17c7d99b670fd33b50dbf
2020-10-15 06:08:07 +00:00
Chih-hung Hsieh
f4155dc551 Merge "Use protobuf-codegen default and add mod_stem.rs" 2020-10-15 05:46:18 +00:00
Jingwen Chen
83556b4e4c Merge "Stop hardcoding sdk/module_exports dynamic prop types for Bazel overlay." am: cc49b09560
Original change: https://android-review.googlesource.com/c/platform/build/soong/+/1460102

Change-Id: Ie8efd3992b67ee9e58369517fb4e95e49e99b5ca
2020-10-15 01:25:45 +00:00
Jingwen Chen
cc49b09560 Merge "Stop hardcoding sdk/module_exports dynamic prop types for Bazel overlay." 2020-10-15 01:02:44 +00:00
Treehugger Robot
d23b4dd166 Merge "Add odm_dlkm and vendor_dlkm to the installclean list" am: a9a427615b
Original change: https://android-review.googlesource.com/c/platform/build/soong/+/1461082

Change-Id: I6768391137df45b8ca2afe3334d2bb049bfd5292
2020-10-14 21:52:45 +00:00
Treehugger Robot
a9a427615b Merge "Add odm_dlkm and vendor_dlkm to the installclean list" 2020-10-14 21:37:19 +00:00
Chris Parsons
aa8be0515b Change bazel_module property to be of struct type instead of string
Test: Manual verification, and update to genrule_test.go
Change-Id: Ic507a35438be5261342a958f3a462a73739e2482
2020-10-14 16:22:37 -04:00
Colin Cross
ce4c7cd55d Add odm_dlkm and vendor_dlkm to the installclean list
Clean the odm_dlkm and vendor_dlkm staging directories in installclean
to get consistent results in incremental builds on the build servers.

Test: treehugger
Change-Id: Id431d7457d85e0be68437a2034fd544d74cc3709
2020-10-14 11:32:23 -07:00
Christopher Parsons
42c7aa8107 Merge "find bazel-related files and add them to bazel.list and ninja deps" am: 17e97d97e2
Original change: https://android-review.googlesource.com/c/platform/build/soong/+/1456830

Change-Id: I23ba87ea3caeb7ecfd9ba8088fa815a47a4de470
2020-10-14 16:41:58 +00:00
Christopher Parsons
17e97d97e2 Merge "find bazel-related files and add them to bazel.list and ninja deps" 2020-10-14 16:27:25 +00:00
Anton Hansson
4cc669d819 Merge "Make test api extend system in sdk_library.go" am: faa866c5f0
Original change: https://android-review.googlesource.com/c/platform/build/soong/+/1455032

Change-Id: I300d8fb6e3221046b89befaa7e679208a54cf705
2020-10-14 15:15:49 +00:00
Anton Hansson
faa866c5f0 Merge "Make test api extend system in sdk_library.go" 2020-10-14 14:43:03 +00:00
Treehugger Robot
deea9b7659 Merge "Support building WITHOUT_CHECK_API=true" am: 527b2578ea
Original change: https://android-review.googlesource.com/c/platform/build/soong/+/1458439

Change-Id: I2ae68652c8ccc8ef62866ac3db12a38411464ac8
2020-10-14 12:27:51 +00:00
Treehugger Robot
527b2578ea Merge "Support building WITHOUT_CHECK_API=true" 2020-10-14 12:13:26 +00:00
Jingwen Chen
6874dbe104 Stop hardcoding sdk/module_exports dynamic prop types for Bazel overlay.
These sdk/sdk_snapshot/module_exports/module_exports_snapshot properties
are dynamically created using RegisterSdkMemberType [1] and eventually
createDynamicSdkMemberType [2]. All dynamically created sdk member types
are string list types.

Instead of hardcoding the mapping, retrieve them from the registry
instead.

[1]: https://cs.android.com/android/platform/superproject/+/master:build/soong/android/sdk.go;l=489-497;drc=master
[2]: https://cs.android.com/android/platform/superproject/+/master:build/soong/sdk/sdk.go;l=156;drc=master

Bug: 166563303
Bug: 170798271
Fixes: 170798271

Test: m bazel_overlay && cd out/soong/bazel_overlay && bazel cquery //...
Signed-off-by: Jingwen Chen <jingwen@google.com>
Change-Id: Ib77f4e0cc14a7b4ec344a2de115682c234927c16
2020-10-14 04:55:00 -04:00
Andrew Scull
7cfb22f518 Merge changes from topic "rust4virt" am: 251b517222
Original change: https://android-review.googlesource.com/c/platform/build/soong/+/1458259

Change-Id: I81df4c50f8f503e4625d1db1957ec66c80589879
2020-10-14 07:31:57 +00:00
Andrew Scull
0382c2cccf Allow packages/modules/Virtualization to use rust am: af2015d7d6
Original change: https://android-review.googlesource.com/c/platform/build/soong/+/1455033

Change-Id: Icd6320a6aadfba6f084ffe08f81572a7a29988d9
2020-10-14 07:31:17 +00:00
Andrew Scull
251b517222 Merge changes from topic "rust4virt"
* changes:
  Update rustfmt preupload example reference
  Allow packages/modules/Virtualization to use rust
2020-10-14 07:15:02 +00:00
Treehugger Robot
52e3cbcfc4 Merge "Collect total number of CPU cores and available RAM for each build." am: 24600e394d
Original change: https://android-review.googlesource.com/c/platform/build/soong/+/1459645

Change-Id: I935657f9f48b1ae24136eb85eb332093caf0427f
2020-10-14 03:58:56 +00:00
Treehugger Robot
de33278844 Merge "Install prebuilt_etc modules to out/soong" am: 544446ca33
Original change: https://android-review.googlesource.com/c/platform/build/soong/+/1440498

Change-Id: Idca635fd62303c1cb1b2f31e486bebe40e47c98d
2020-10-14 03:56:36 +00:00
Treehugger Robot
24600e394d Merge "Collect total number of CPU cores and available RAM for each build." 2020-10-14 03:52:53 +00:00
Treehugger Robot
544446ca33 Merge "Install prebuilt_etc modules to out/soong" 2020-10-14 03:04:51 +00:00
Colin Cross
14ca2fcf31 Merge changes Idc985c52,Ibbbde323,I51417cf6,I9886498d,I195d99c9 am: 6ddb81b0db
Original change: https://android-review.googlesource.com/c/platform/build/soong/+/1451109

Change-Id: I354aa7fd48ba6b269edf8ef2fc24c9811f567ab8
2020-10-14 00:44:38 +00:00
Colin Cross
6ddb81b0db Merge changes Idc985c52,Ibbbde323,I51417cf6,I9886498d,I195d99c9
* changes:
  Move LLNDK and NDK versionSelectorMutator special cases into versionedInterface
  use version mutator for CRT
  Use version mutator for NDK
  Reuse more of apex stubs implementation for llndk stubs
  Use libraryInterface instead of concrete type asserts for stubs
2020-10-14 00:20:05 +00:00
Patrice Arruda
3edfd48ef4 Collect total number of CPU cores and available RAM for each build.
Collect the total number of CPU cores and available RAM for each build
as part of the system resource info. This is to know what kind of
build machines that the developers are using.

Bug: b/169453825
Test: m nothing and ran printproto on soong_metrics to validate the
      data.
Change-Id: I8617bdb9490b37d7689abd27d349af1a651533db
2020-10-13 23:58:41 +00:00
Colin Cross
051ea998fb Merge "Start using Providers instead of direct module access" am: d4620701ad
Original change: https://android-review.googlesource.com/c/platform/build/soong/+/1439475

Change-Id: I27cacc976cd2136965df0aac6052c011ba32ef8d
2020-10-13 22:21:53 +00:00
Colin Cross
d4620701ad Merge "Start using Providers instead of direct module access" 2020-10-13 21:48:26 +00:00
Chris Parsons
a798d96076 find bazel-related files and add them to bazel.list and ninja deps
This retriggers soong_build whenever a new bzl, WORKSPACE, or
BUILD.bazel file is changed or added.

Test: Manually verified on bionic/libc genrules with manual changes to
related BUILD/bzl/WORKSPACE files -- these all retrigger builds.
Test: Updated finder_test.go

Change-Id: I634384f88781a6b6db32f5d6bf9c07e179e14c39
2020-10-13 16:18:59 -04:00
Treehugger Robot
e3d0a6f17e Merge "Collect the hostname of the machine as a metric." am: 585d7d4c2e
Original change: https://android-review.googlesource.com/c/platform/build/soong/+/1457384

Change-Id: I95a9733c6aab8a343c7619e7d9e5cbaf6e01dab4
2020-10-13 18:10:22 +00:00
Evgenii Stepanov
2cd36f0b0a Merge "Support asan/hwasan versions of prebuilts." am: 00e07c9779
Original change: https://android-review.googlesource.com/c/platform/build/soong/+/1371811

Change-Id: Ib1ac643ba68d5f7b36b7ddb47579256442913ca8
2020-10-13 18:09:53 +00:00
Treehugger Robot
585d7d4c2e Merge "Collect the hostname of the machine as a metric." 2020-10-13 18:07:51 +00:00
Evgenii Stepanov
00e07c9779 Merge "Support asan/hwasan versions of prebuilts." 2020-10-13 17:51:58 +00:00
Steven Moreland
5ef24a21a2 Merge "Zero C++ heap by default." am: 88ed5d9353
Original change: https://android-review.googlesource.com/c/platform/build/soong/+/1379879

Change-Id: I05dad758bce9e8489a9c05ff267eaf529e1188e9
2020-10-13 17:11:08 +00:00
Steven Moreland
88ed5d9353 Merge "Zero C++ heap by default." 2020-10-13 16:49:16 +00:00
Paul Duffin
bc0fe96be3 Support building WITHOUT_CHECK_API=true
When WITHOUT_CHECK_API=true the check api process is not run which
means that the current.txt and removed.txt files are not generated by
the build. In that case this change causes the droidstubs module to
fallback to exporting the source files instead.

An additional removedApiFilePath property (to match apiFilePath) was
added to hold the exported path as removedApiFile has to be a
WritablePath and source paths are not writable.

Bug: 169034951
Test: m WITHOUT_CHECK_API=true nothing
      fails without this fix, passes with it.
Change-Id: If6b09dd67c8533368b71405143f524d66350703f
2020-10-13 15:37:10 +01:00
Andrew Scull
5a58bca1f4 Update rustfmt preupload example reference
The arguments passed to rustfmt have changed from those used in the
previously referenced CL so update the comment to reference a CL using
the new arguments.

Bug: 164111102
Test: None
Change-Id: I962d56ed36422709a1fcd07ca95f1c015daa6339
2020-10-13 13:52:37 +01:00
Andrew Scull
af2015d7d6 Allow packages/modules/Virtualization to use rust
Rust will be used for a few virtualization related components so allow
it to be used in the directory in which those components will reside.

Test: built a rust binary in the directory
Change-Id: I805d6117201c2144f7ecf21ec38b577c7c21e9c5
2020-10-13 11:43:52 +01:00
Anton Hansson
4fe970f303 Make test api extend system in sdk_library.go
The test stubs for the "main" android API are being changed to
incude @SystemApi annotated APIs. Update sdk_library to make modules
and optional libraries follow the same principle.

Bug: 129133308
Test: presubmit
Change-Id: I7bd940e1a8127d954d30c532c74d684a5ba9d33c
Merged-In: I7bd940e1a8127d954d30c532c74d684a5ba9d33c
(cherry picked from commit 13dbaac5b6)
2020-10-13 08:25:00 +01:00
Anton Hansson
4b59023120 Merge "Remove jdiff support from droiddoc" am: ff98103505
Original change: https://android-review.googlesource.com/c/platform/build/soong/+/1455335

Change-Id: I993974cb1da0e4f65c3c15488527fc569974fd61
2020-10-13 07:24:10 +00:00