Gregory Becker
e221ba6ba7
update macos test for new unit-test command
2020-09-23 12:43:12 -07:00
Gregory Becker
4146c3d135
flake
2020-09-23 12:43:10 -07:00
Gregory Becker
f5b165a76f
flake
2020-09-23 12:43:08 -07:00
Tamara Dahlgren
3508362dde
smoke tests: grab and run build examples (openmpi) ( #16365 )
...
* Snapshot smoke tests that grab and run examples
* Resolved openmpi example test issues for 2.0.0-4.0.3
* Use spec.satisfies; copy extra packages after install (vs. prior to install tests
* Added smoke tests for selected openmpi installed binaries
* Use which() to determine if install exe exists
* Switched onus for installer test source grab from installer to package
* Resolved (local) flake8 issues with package.py
* Use runner.name; use string format for *run_test* messages
* Renamed copy_src_to_install to cache_extra_test_source and added comments
* Metadata path cleanup: added metadata_dir property to and its use in package
* Support list of source paths to cache for install testing (with unit test)
* Added test subdir to install_test_root; changed skip_file to lambda
2020-09-23 12:43:05 -07:00
Tamara Dahlgren
fb145df4f4
bugfix: Resolve perl install test bug ( #16501 )
2020-09-23 12:43:02 -07:00
Tamara Dahlgren
fd46f67d63
smoke tests: Refined openmpi version checks ( #16337 )
...
* Refined openmpi version checks to pass for 2.1.0 through 4.0.3
* Allow skipping install tests with exe not in bin dir and revised openmpi version tests
2020-09-23 12:43:00 -07:00
Greg Becker
edf3e91a12
Add --fail-first and --fail-fast options to spack test run ( #16277 )
...
`spack test run --fail-first` exits after the first failed package.
`spack test run --fail-fast` stops each package test after the first
failure.
2020-09-23 12:42:58 -07:00
Gregory Becker
bca630a22a
make output comparisons regex
2020-09-23 12:42:56 -07:00
Gregory Becker
5ff9ba320d
remove debug log parser from ctest
2020-09-23 12:42:54 -07:00
Gregory Becker
50640d4924
update from Error to FAILED
2020-09-23 12:42:51 -07:00
Gregory Becker
f5cfcadfc5
change test headings from {name}-{hash} to {name}-{version}-{hash}
2020-09-23 12:42:49 -07:00
Gregory Becker
a5c534b86d
update bash completion
2020-09-23 12:42:46 -07:00
Gregory Becker
99364b9c3f
refactor
2020-09-23 12:42:43 -07:00
Gregory Becker
749ab2e79d
Make Spack tests record their errors and continue
...
previously, tests would fail on the first error
now, we wrap them in a TestFailure object that records all failures
2020-09-23 12:42:40 -07:00
Greg Becker
1b3e1897ca
Features/spack test subcommands ( #16054 )
...
* spack test: subcommands for asynchronous tests
* commands are `run`, `list`, `status`, `results`, `remove`.
2020-09-23 12:42:36 -07:00
Tamara Dahlgren
3976b2a083
tests: Preliminary libsigsegv smoke tests (updated) ( #15981 )
...
* tests: Preliminary libsigsegv smoke tests (updated)
* Cleaned up and added doc to libsigsegv smoke test
2020-09-23 12:42:33 -07:00
Tamara Dahlgren
54603cb91f
tests: Update openmpi smoke tests to new run_test api ( #15982 )
...
* tests: Update openmpi smoke tests to new run_test api
* Removed version check try-except tracking per discussion
* Changed openmpi orted command status values to list
2020-09-23 12:42:29 -07:00
Tamara Dahlgren
aa630b8d71
install tests: added support for multiple test command status values ( #15979 )
...
* install tests: added support for multiple test command status values
2020-09-23 12:42:25 -07:00
Gregory Becker
77acf8ddc2
spack unit-test: fix pytest help command
2020-09-23 12:42:22 -07:00
Gregory Becker
dfb02e6d45
test runner: add options to check installation dir and print purpose
2020-09-23 12:42:18 -07:00
Gregory Becker
cf4a0cbc01
python: use self.command to get exe name in test
2020-09-23 12:42:16 -07:00
Gregory Becker
b0eb02a86f
cmd/test.py: fix typo in spdx license header
2020-09-23 12:42:14 -07:00
Gregory Becker
73f76bc1b5
update bash completions
2020-09-23 12:42:12 -07:00
Gregory Becker
6f39d8011e
spack test: factor out common args
2020-09-23 12:42:10 -07:00
Gregory Becker
97dc74c727
python: fix tests, remove intentional debug failures
2020-09-23 12:42:08 -07:00
Gregory Becker
d53eefa69f
fix docs
2020-09-23 12:42:05 -07:00
Gregory Becker
bae57f2ae8
spack test: update existing docs for moved unit-test cmd
2020-09-23 12:41:23 -07:00
Gregory Becker
ba58ae9118
simplify error handling using language features
2020-09-23 12:36:23 -07:00
Gregory Becker
fdb8a59bae
fix get_package_context check whether in a package file
2020-09-23 12:36:22 -07:00
Gregory Becker
d92f52ae02
fix handling of asserts for python3
2020-09-23 12:36:22 -07:00
Gregory Becker
3229bf04f5
fix 'belt and suspenders' for config values
2020-09-23 12:36:21 -07:00
Gregory Becker
ccf519daa5
update travis
2020-09-23 12:36:20 -07:00
Gregory Becker
c5ae92bf3f
flake
2020-09-23 12:36:19 -07:00
Gregory Becker
f83280cb58
standardize names for configure_test, build_test, install_test
2020-09-23 12:36:18 -07:00
Gregory Becker
6e80de652c
unbreak zlib
2020-09-23 12:36:17 -07:00
Gregory Becker
0dc212e67d
tests and bugfixes
2020-09-23 12:36:16 -07:00
Gregory Becker
3ce2efe32a
update bash completions
2020-09-23 12:36:14 -07:00
Gregory Becker
76ce5d90ec
fixup unit-test from develop
2020-09-23 12:36:14 -07:00
Gregory Becker
e5a9a376bf
fix cmd/clean tests
2020-09-23 12:36:13 -07:00
Gregory Becker
d6a497540d
fixup reporter work
2020-09-23 12:36:12 -07:00
Gregory Becker
b996d65a96
bugfix
2020-09-23 12:36:11 -07:00
Gregory Becker
991a2aae37
test name message
2020-09-23 12:36:10 -07:00
Tamara Dahlgren
8ba45e358b
Initial OpenMPI smoke tests: version checks
2020-09-23 12:36:09 -07:00
Gregory Becker
28e76be185
spack clean: option to clean test stage (-t)
2020-09-23 12:36:09 -07:00
Gregory Becker
70e91cc1e0
spack test: add dirty/clean flags to command
2020-09-23 12:36:08 -07:00
Gregory Becker
b52113aca9
move test dir to config option
2020-09-23 12:36:07 -07:00
Gregory Becker
ce06e24a2e
refactor run_test to Package level
2020-09-23 12:36:06 -07:00
Gregory Becker
dd0fbe670c
continue testing after error
2020-09-23 12:36:05 -07:00
Tamara Dahlgren
6ad70b5f5d
Preliminary libxml2 tests ( #15092 )
...
* Initial libxml2 tests (using executables)
* Expanded libxml2 tests using installed bins
* Refactored/generalized _run_tests
2020-09-23 12:36:04 -07:00
wspear
dadf4d1ed9
Fixed import string ( #15094 )
2020-09-23 12:36:03 -07:00