Commit graph

429 commits

Author SHA1 Message Date
Jordan Liu
fffbdfa1eb Override gtest timeout and add logging
Note that this just increases the gtest time to match our
highest wait times. Each test still has wait times fitted for the
expected length of that test.

Bug: 159289514
Test: atest VtsHalRadioV1_0TargetTest
Change-Id: I0825305258bae20ea6e13e9b9a65ce30b7153611
2020-06-26 22:51:58 +00:00
Dan Shi
b2dd35aaf2 Disable framework for some VTS tests
The test doesn't need framework. It seems that the test can be flaky
when framework was stop/started earlier.

Bug: 154445273
Test: atest -a VtsHalBluetoothV1_0TargetTest \
  VtsHalSapV1_0TargetTest \
  VtsHalAudioV4_0TargetTest

Change-Id: I60f62923cfb826c5e33e9885ea08efdbe4c8f57e
2020-05-29 15:40:38 -07:00
Shuo Qian
4e866a3020 Skip voice call VTS for devices that don't support voice call with new Util
Bug: 154867827
Test: VtsHalRadio1_4Target
Change-Id: I888d4d4ffbff5d24bfe2b9b3cb878eb5f1e1762f
2020-05-13 01:30:01 +00:00
Steven Moreland
0b4b27183c Radio tests: root before multi-sim preparation.
These tests assumed that they were rooted before running, and due to
a combination of b/152655658 and b/154638140, these appeared to work
when a device already happened to be rooted and the test failures showed
up as problems with the test rather than as problems with the target
preparer.

This is the same workaround being used elsewhere.

Fixes: 154445273 # specifically about VtsHalSapV1_0TargetTest
Test: atest VtsHalSapV1_0TargetTest # passes 100%

The following tests, I confirm MultiSimTargetPreparer works, although my
test device has no SIM so I cannot get fully useful results.
Test: atest VtsHalRadioV1_0TargetTest # slot2 cases can now pass
Test: atest VtsHalRadioV1_1TargetTest # slot2 cases can now pass
Test: atest VtsHalRadioV1_2TargetTest # slot2 cases can now pass
Test: atest VtsHalRadioV1_3TargetTest # fully passes
Test: atest VtsHalRadioV1_4TargetTest # fully passes

Change-Id: Id62cb2e1b7a95552b560ab1d4ff2f63c0a7569a3
2020-05-06 14:17:05 -07:00
Dan Shi
aad51fa000 Rename vts-core to vts
Bug: 151896491
Test: local build
Exempt-From-Owner-Approval: This CL update suite name vts-core to vts as
the suite name is updated. This CL won't change test logic or behavior.

Change-Id: I562b4dc50765e953800a814a8fd84a01c1b9352b
Merged-In: I562b4dc50765e953800a814a8fd84a01c1b9352b
2020-04-07 16:37:40 -07:00
Shuo Qian
872ffc262f Starting from Android 11, VTS will use "DISABLE_" prefix to disable tests instead of the .xml file. We need to migrate these things.
Test: Treehugger; GoogleTest knowledge; VTS team confirmation
Bug: 152813990
Change-Id: I92616557ae44c2a421ee687d0420f7b7901ba5a9
2020-04-01 02:32:11 +00:00
Hsiaoan Hsu
6e8b33a127 VTS: Fix IRadio.nvResetConfig
- IRadio.nvResetConfig:
IRadio.nvResetConfig with ResetNvType ERASE cause radio restart.
The subsuquent test cases fail with RADIO_NOT_AVAILABLE.
Fix to use ResetNvType FACTORY_RESET which does not restart the radio.

Test: run vts -m VtsHalRadioV1_0Target
Bug: 147831226
Change-Id: I45e5cbcf9144c3ace987ac8e047e40fbee403734
2020-03-09 12:12:33 +08:00
Dan Shi
8caedd0d68 Convert VtsHalRadioV1_*TargetTest to be parameterized test
Bug: 142397658
Bug: 142972256
Test: atest VtsHalRadioV1_0TargetTest \
  VtsHalSapV1_0TargetTest \
  VtsHalRadioV1_1TargetTest \
  VtsHalRadioV1_2TargetTest \
  VtsHalRadioV1_3TargetTest \
  VtsHalRadioV1_4TargetTest

Change-Id: I1890f7a6b1401260e87c94c2bc4e1dfa7060a0cb
2019-11-22 13:57:26 -08:00
Xin Li
1942f9edaa DO NOT MERGE - Merge pie-platform-release (PPRL.190705.004) into master
Bug: 136196576
Change-Id: I58505f104075c7c210612eda8e266df9e3ecfeda
2019-07-09 15:22:03 -07:00
Steven Moreland
1ae4615d9f Update hidl makefiles for bpfmt
hidl-generated makefiles are now generated such that bpfmt(file) == file.

Bug: 67417008
Test: enable bpfmt hook
Change-Id: I1f69d292bc23a7cc293a66110cb02d597e1019ad
2019-04-17 09:38:50 -07:00
sqian
b2aa43ae94 Sleep one second after connect.
Modem side need time for connect to finish.

Test: Sanity (encountered by partner)
Bug: 122442056
Change-Id: Ib688b968730fcf604ef3807db9b6bd817594cad6
2019-03-11 16:07:49 -07:00
Steven Moreland
a878aee9ab Update makefies: no 'types'
Bug: 123976090
Test: N/A
Change-Id: I30fb04c81889b62775e1b764b965fdb0f893de17
2019-03-04 11:27:17 -08:00
Nathan Harold
5109018dfa Explicitly Document INT_MAX for Invalid Fields
When fields are inapplicable, they should not
be set to a clearly out-of-range value to signal
to the framework that those fields are not used.
In some cases, there is an in-range invalid value
that has been defined by the standards. The docs
are inconsistent in calling out INT_MAX as the
value to be used when something is inapplicable
vs the case when a measurement is simply not
reported. In all cases, INT_MAX can be used to
denote an invalid value, and in cases where the
field/structure is inapplicable, it is the correct
value. This CL updates all the docstrings for
SignalStrength-related fields to clarify that
INT_MAX is the correct "invalid" value for cases
when fields are inapplicable.

Bug: 123088652
Test: compilation (docstring-only change); CTS
    naturally enforces this change on devices with
    newer HALs; backwards compatibility is preserved
    for existing HAL versions.

Change-Id: I5cfa917f504d15691ab3f2c298189bdd47794a42
2019-01-28 18:59:08 -08:00
Keun Soo YIM
68ae05dd2d pack VTS cc_test binaries as general-tests
Test: make general-tests
Bug: 120093339
Merged-In: I363450d205868f900e4925ccff1430e2a569f2a4
Change-Id: I363450d205868f900e4925ccff1430e2a569f2a4
2018-12-07 10:49:56 -08:00
Youming Ye
f11cccda3b Correct the comments for radio hal types
The type of mcc and mnc is String instead of Int now. They should be an
empty string if unknown. Also added a test case for their values.

Bug: 111703979
Test: Vts
Change-Id: Ie0426453dc426ccc6cf203b315806e78511ce14d
2018-09-04 11:10:32 -07:00
Treehugger Robot
052f207b42 Merge "Fix setAllowedCarrier" into pie-vts-dev 2018-08-29 18:44:58 +00:00
sqian
f27a92e634 Fix setAllowedCarrier
If function is not supported or executed successfully, do not
expect its effect on cardStatus.

Bug: 112008372
Test: run vts
Change-Id: I4532a39af2cfcf0e44eafe29c3c7f6779ae101f5
Merged-In: I4532a39af2cfcf0e44eafe29c3c7f6779ae101f5
(cherry picked from commit 44b129f728)
2018-08-29 01:44:38 +00:00
Amit Mahajan
1f3d0a68a4 Allow general errors for getImsiForApp().
This is to match it with other 1.0 tests where general errors are
allowed. For newer tests we have decided to not allow these errors,
but a failure for this old test is reported when run with SIM
present.

Test: run vts -m VtsHalRadioV1_0Target
Bug: 109889468
Change-Id: If36083b7832706a50805932e8ba08e4eb397f3fe
Merged-In: If36083b7832706a50805932e8ba08e4eb397f3fe
(cherry picked from commit 817848e59e)
2018-08-29 01:42:18 +00:00
sqian
5fd0ccf7a8 Add REQUEST_NOT_SUPPORTED for pin and pin2 Icc VTS
Bug: 111222834
Test: sanity
Change-Id: Ia3b96e83d6173c2c80bdbf7763a876883b167af9
Merged-In: Ia3b96e83d6173c2c80bdbf7763a876883b167af9
(cherry picked from commit c0a06f34c8)
2018-08-22 19:04:18 +08:00
sqian
ad34a11fba Add SIM_PUK2 for Icc VTS tests
Add SIM_PUK2 for supplyIccPin2ForApp and changeIccPin2ForApp if sim
card is in the puk2 state.

Bug: 111211929
Test: sanity
Change-Id: I80d924cc4a61565887cbd2a65ee5927a42ad656e
Merged-In: I80d924cc4a61565887cbd2a65ee5927a42ad656e
(cherry picked from commit 4ed0a216ad)
2018-08-22 19:04:18 +08:00
Xin Li
b390ad2d90 Merge pie-vts-dev into master
Bug: 112170540
Merged-In: I48551f5469289b9fcfc47dd9fd2e455779640329
Change-Id: Icd613751ccf1dc8a0f879525f1d65b11dda7d357
2018-08-16 00:17:15 +00:00
sqian
e5bf3a268e Check INVALID_SIM_STATE for sim permanent lock status
PUK1 and PUK2 can get permanent blocked when it inputs wrong
passwords more than 10 times.

Bug: 111211929
Test: sanity
Change-Id: I736873b1b181b88f279df7dc1c09e18e0fc76af3
Merged-In: I736873b1b181b88f279df7dc1c09e18e0fc76af3
(cherry picked from commit cb9e9d10462cc82ee6e7074f8d4c831b6348b3ea)
2018-08-14 19:24:17 +00:00
Treehugger Robot
ed8cf648cd Merge "Fix setAllowedCarrier" 2018-08-14 19:19:19 +00:00
sqian
b2f6aa1e51 Fix setAllowedCarrier
If function is not supported or executed successfully, do not
expect its effect on cardStatus.

Bug: 112008372
Test: run vts
Change-Id: I4532a39af2cfcf0e44eafe29c3c7f6779ae101f5
Merged-In: I4532a39af2cfcf0e44eafe29c3c7f6779ae101f5
(cherry picked from commit 44b129f728)
2018-08-14 11:35:10 -07:00
sqian
3c608789e0 Add REQUEST_NOT_SUPPORTED for pin and pin2 Icc VTS
Bug: 111222834
Test: sanity
Change-Id: Ia3b96e83d6173c2c80bdbf7763a876883b167af9
Merged-In: Ia3b96e83d6173c2c80bdbf7763a876883b167af9
(cherry picked from commit c0a06f34c8)
2018-08-14 11:30:57 -07:00
sqian
f3791f6a3f Add SIM_PUK2 for Icc VTS tests
Add SIM_PUK2 for supplyIccPin2ForApp and changeIccPin2ForApp if sim
card is in the puk2 state.

Bug: 111211929
Test: sanity
Change-Id: I80d924cc4a61565887cbd2a65ee5927a42ad656e
Merged-In: I80d924cc4a61565887cbd2a65ee5927a42ad656e
(cherry picked from commit 4ed0a216ad)
2018-08-13 18:46:51 -07:00
sqian
2d0ba0f61b Check INVALID_SIM_STATE for sim permanent lock status
PUK1 and PUK2 can get permanent blocked when it inputs wrong
passwords more than 10 times.

Bug: 111211929
Test: sanity
Change-Id: I736873b1b181b88f279df7dc1c09e18e0fc76af3
2018-08-13 17:36:54 -07:00
sqian
9da8a72744 resolve merge conflicts of 898d05a713 to pie-vts-dev
Test: I solemnly swear I tested this conflict resolution.
Bug: 72075328
Change-Id: I5d7c124bc3905f899e63f080ac94def4e06fe9c2
Merged-In: I8c993cd2fa95c961dc7f976b5bd85a2826b42889
2018-08-13 16:32:59 -07:00
sqian
70afa883ae Add REQUEST_NOT_SUPPORTED for changeIccPinForApp and changeIccPin2ForApp
Bug: 110037298
Test: run vts -m VtsHalRadioV1_0Target
Merged-In: Iaba800814c5a6950d086a2f105714d01fdaa14a4
Change-Id: Iaba800814c5a6950d086a2f105714d01fdaa14a4
(cherry picked from commit 7470cbd04d)
2018-08-10 00:48:45 +00:00
sqian
898d05a713 resolve merge conflicts of dfa79a6292 to oreo-mr1-vts-dev
Test: I solemnly swear I tested this conflict resolution.
Bug: None
Change-Id: I10919718b841fdb33ab0e873d1b4bbd787fafcd2
2018-07-16 08:36:50 -07:00
sqian
70805cffdd Add NONE for LceService
"Allow startLceService to succeed even in the
SIM_ABSENT case. The original RIL documentation
states that SUCCESS is valid for all LCE
operations, and there is no logical reason why
one of these operations must fail in a no-SIM
case (though a vendor may choose not to support
that configuration). Thus, a call to
startLceService should permit NONE when requested
in the no-SIM case for 1.0 VTS.

In addition, a successful call to startLceService
should also permit a successful call to
pullLceData, so also allow RadioError::NONE for
the pull operation. Ideally the tests would only
allow NONE for pull if startLceService also
returns NONE, but that's out of scope for now."

Bug: 110181475
Bug: 72075328
Test: confirmed in the discussion; compilation
2018-07-13 18:12:08 +00:00
sqian
43f2c3e588 Add REQUEST_NOT_SUPPORTED for changeIccPinForApp and changeIccPin2ForApp
am: 617c98b537

Change-Id: I97e2ac6534ae7354fc66a5bcd6f1833fe0b20498
2018-06-22 19:43:22 -07:00
sqian
617c98b537 Add REQUEST_NOT_SUPPORTED for changeIccPinForApp and changeIccPin2ForApp
Bug: 110037298
Test: run vts -m VtsHalRadioV1_0Target
Change-Id: Iaba800814c5a6950d086a2f105714d01fdaa14a4
Merged-In: Iaba800814c5a6950d086a2f105714d01fdaa14a4
(cherry picked from commit 7470cbd04d)
2018-06-22 16:32:07 -07:00
sqian
ab2b8bf919 Fix setBandMode.
Bug: 67834975
Test: sanity

Merged-In: Ie907cdb464a44d92be47d898151d71eb2d83a11c
2018-06-18 17:10:08 +00:00
Amit Mahajan
47de621776 Allow general errors for getImsiForApp().
am: 2c36d90716

Change-Id: Id8832fa06f2e1b67210deeea06890a88b3bc45e2
2018-06-14 13:06:28 -07:00
Amit Mahajan
2c36d90716 Allow general errors for getImsiForApp().
This is to match it with other 1.0 tests where general errors are
allowed. For newer tests we have decided to not allow these errors,
but a failure for this old test is reported when run with SIM
present.

Test: run vts -m VtsHalRadioV1_0Target
Bug: 109889468
Change-Id: If36083b7832706a50805932e8ba08e4eb397f3fe
2018-06-14 17:18:38 +00:00
sqian
2a60b89b9c Sim Status Present VTS
Fix and enhance sim-present tests,
Save VTS running time,
Fix serial number inconsistancy issue

Fix and enhance sim-present tests:
In 1.0:
- setupDataCall timeout, need more waiting time
- requestIccSimAuthentication returns REQUEST_NOT_SUPPORTED,
need to check it
- sendSms timeout, would need more waiting time
- sendSMSExpectMore timeout, would need more waiting time
- getAllowedCarriers, getting CardState::RESTRICTED, the previous test
of setAllowedCarriers is doing resetting back to no carrier restriction,
but that needs some time to populate.
In 1.1:
- setSimCardPower_1_1 set sim card power down that makes other tests
fail, reset it back with sim card power on.

Save VTS running time,
- Use waiting loop and prevent unnecessary waiting to save the whole
running time.

Fix serial number inconsistancy issue
- During the enforcement running, it is liked the serial number is
not consistent. And it happens in b/78249227. Suspect that when sim
card is inserted, during the testing running time, the radio may
request some response that is not triggered from the test, but the
test may receive it and think it is what is triggered by the test. The
fix is to check serial number before notifying of unlock the test
lock.

Bug: 76125134
Bug: 78248071
Bug: 78139665
Bug: 78249227
Test: run vts -m VtsHalRadioV1_0Target; run vts -m VtsHalRadioV1_1Target
Change-Id: I08fe9d7ac16283c7ce1a5aeb6b3b372786a8d5c3
Merged-In: I08fe9d7ac16283c7ce1a5aeb6b3b372786a8d5c3
(cherry picked from commit 788eb80830)
2018-04-20 14:54:12 -07:00
sqian
788eb80830 Sim Status Present VTS
Fix and enhance sim-present tests,
Save VTS running time,
Fix serial number inconsistancy issue

Fix and enhance sim-present tests:
In 1.0:
- setupDataCall timeout, need more waiting time
- requestIccSimAuthentication returns REQUEST_NOT_SUPPORTED,
need to check it
- sendSms timeout, would need more waiting time
- sendSMSExpectMore timeout, would need more waiting time
- getAllowedCarriers, getting CardState::RESTRICTED, the previous test
of setAllowedCarriers is doing resetting back to no carrier restriction,
but that needs some time to populate.
In 1.1:
- setSimCardPower_1_1 set sim card power down that makes other tests
fail, reset it back with sim card power on.

Save VTS running time,
- Use waiting loop and prevent unnecessary waiting to save the whole
running time.

Fix serial number inconsistancy issue
- During the enforcement running, it is liked the serial number is
not consistent. And it happens in b/78249227. Suspect that when sim
card is inserted, during the testing running time, the radio may
request some response that is not triggered from the test, but the
test may receive it and think it is what is triggered by the test. The
fix is to check serial number before notifying of unlock the test
lock.

Bug: 76125134
Bug: 78248071
Bug: 78139665
Bug: 78249227
Test: run vts -m VtsHalRadioV1_0Target; run vts -m VtsHalRadioV1_1Target
Change-Id: I08fe9d7ac16283c7ce1a5aeb6b3b372786a8d5c3
2018-04-20 00:21:14 +00:00
Iris Chang
14ad821b0a VTS: fix RadioHidlTest.getAvailableNetworks issue
Analysis: VtsHalRadioV1_0Target's timeout is too short for
getAvailableNetworks, because this request duration depends on NW
environment or frequency.

Suggested solution: Add a timeout parameter to wait() and default
timeout value is 5 minutes in order to avoid timeout fail due to NW
environment.

Bug: 68834032
Test: getAvailableNetworks can be passed after we apply this patch and
      test result for all other telephony 1.0 test cases are not changed.

Change-Id: Iaef7e8eefa8fcfde0ff8030cba1f9753a28eac61
Merged-In: Iaae71e0abacd28275d86a19264813ff209ddb79c
2018-04-16 05:53:27 +00:00
Jordan Liu
6f8e4d5593 Fix wcdma signal strength comments
As per the spec, the range should be 0-31, 99, and the section
should be 8.5.

Test: builds - No change to behavior
Bug: 71329173
Change-Id: Ib1ea54b19a7bcb33a0235b3ddb3fa09c4872890f
2018-03-05 20:30:18 +00:00
Nathan Harold
6aae45015f Fix LTE Timing Advance Doc String
The LTE TA Doc string has been fixed to reflect
the actual reported value of the field. The spec
reference was previously incorrect, which would
have indicated a range of 0-63 as the incremental
timing advance; however the field actually reports
the absolute timing advance, which has a much
larger range of 0-1282. In addition, this CL
updates the comment to remove a link to a defunct
website and explicitly states the range extracted
from the updated spec reference. This does not
impact the current behavior of the API as the the
previously incorrect docstring was nonsensical.

Bug: 66751464
Test: compilation (doc only change)
Change-Id: I2fc90c08ed6dd14548b10c638bf805b37d5c34e8
2018-02-16 17:32:47 +00:00
Zhuoyao Zhang
21b0a0ad25 Convert radio hal test to use VtsHalHidlTargetTestEnvBase
Bug: 64203181
Test: make vts
      vts-tradefed run vts -m VtsHalRadioV1_0Target
      vts-tradefed run vts -m VtsHalSapV1_0Target
      vts-tradefed run vts -m VtsHalRadioV1_1Target
      vts-tradefed run vts -m VtsHalRadioV1_2Target

Change-Id: I067ce9634e41c0400d9eb060065e9bb3bc511546
2018-02-12 15:22:32 -08:00
sqian
985866db5c Merge "Add None into cancelPendingUssd" into oreo-vts-dev am: 4ccc3b0140 am: efebbbeeea am: e7da333a91
am: 9b544fb083

Change-Id: I9b54f0d11f9150f22ad79daaa4b32b551ee1e763
2018-01-25 03:44:52 +00:00
sqian
9b544fb083 Merge "Add None into cancelPendingUssd" into oreo-vts-dev am: 4ccc3b0140 am: efebbbeeea
am: e7da333a91

Change-Id: Ia62e2a8ae1e8975ef33203142a4ebe20b45d60b9
2018-01-25 03:10:50 +00:00
sqian
efebbbeeea Merge "Add None into cancelPendingUssd" into oreo-vts-dev
am: 4ccc3b0140

Change-Id: Iad35b1764095d6b4bdd52dfd8f8e6a73940bfab5
2018-01-25 02:40:26 +00:00
sqian
40c4ff77c6 Add None into cancelPendingUssd
Bug: 67834975
Test: Compile
2018-01-23 16:36:05 -08:00
sqian
d4c4a4edfb Set time delay in the vts test setup
Bug: 69398018
Test: run vts
Change-Id: Ibe1e8f1b08342f1b0b867bfa7bcf1b2fe4a85622
Merged-In: Ibe1e8f1b08342f1b0b867bfa7bcf1b2fe4a85622
(cherry picked from commit 1a5c25dd95)
2018-01-23 22:38:12 +00:00
sqian
1d93dbfb3b Add REQUEST_NOT_SUPPORTED / SIM_ABSENT for vts tests
Bug: 65230472
Test: run vts
Merged-In: I1fab6f49f04a04a7f1cd3b613fe7049f927171d1
Change-Id: I1fab6f49f04a04a7f1cd3b613fe7049f927171d1
(cherry picked from commit 83cc3ab888)
2018-01-23 22:31:26 +00:00
Sanket Padawe
71620817a9 Fix VTS test which turns off radio.
Since the purpose of most of the test cases in current VTS is to check
if proper errors are returned and there is no crash seen in vendor code,
updating setRadioPower test case to turn on the radio instead of
turning off. We want to avoid test cases which turn off
radio or leads to modem shut down as those test cases affect other tests.

Test: VTS
Change-Id: I4fb9f18884f7ef21162015a0032c4431444f7025
Merged-In: I4fb9f18884f7ef21162015a0032c4431444f7025
Bug: 65230472
(cherry picked from commit 9a721b8087)
(cherry picked from commit 536818d17a)
2018-01-23 22:31:01 +00:00
sqian
40d93997b5 Add EMPTY_RECORD for getDeviceIdentity
Remove same unit test case with arguments "","0" for:
- sendEnvelope
- sendTerminalResponseToSim
- sendEnvelopeWithStatus

Test: verified by vendor, treehuger
Bug: 62926561
Change-Id: I5f535bdfc5821275a7ea2571d411374e0d7a8822
Merged-In: I5f535bdfc5821275a7ea2571d411374e0d7a8822
(cherry picked from commit 67901bf2ce)
2018-01-23 22:19:46 +00:00