zhangyiss/spack
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
9abee2e851
spack/lib/spack/spack
History
Jordan Galby 6c12630e95
Optimize concurrent misc_cache provider index rebuild (#32874) 
When concurrent misc_cache provider index rebuilds happen, try to
rebuild it only once, so we don't exceed misc_cache lock timeout.

For example, when using `spack env depfile`, with no previous
misc_cache, running `make -f depfile -j8` could run at most 8 concurrent
`spack install` locking on misc_cache to rebuild the provider index. If
one rebuild takes 30s, before this fix, the "worst" lock could wait up
to 30s * 7, easily exceeding misc_cache lock timeout. Now, the "worst"
lock would take 30s * 1 + ~1s * 6.
2022-10-05 06:01:59 -06:00
..
build_systems autotools: Filter libtools when building with dpcpp (#32876) 2022-10-05 11:57:37 +00:00
cmd find/list: display package counts last (#32946) 2022-10-04 10:56:46 -07:00
compilers Add c++14 support flag for xl compiler (#31826) 2022-08-17 13:57:13 +02:00
container black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
detection black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
environment develop: canonicalize dev paths and base relative paths on env.path (#30075) 2022-09-30 20:56:53 +00:00
hooks black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
modules modules: add missing Python imports (#32012) 2022-08-10 10:00:33 +02:00
operating_systems Move type hint to satisfy Python 3.6, 3.7 interpreters (#31932) 2022-08-04 20:48:05 +00:00
platforms black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
reporters spack ci: add support for running stand-alone tests (#27877) 2022-08-23 00:52:48 -07:00
schema spack ci: add support for running stand-alone tests (#27877) 2022-08-23 00:52:48 -07:00
solver develop: canonicalize dev paths and base relative paths on env.path (#30075) 2022-09-30 20:56:53 +00:00
test BuildEnvironment: accumulate module changes to poke to all relevant modules (#32340) 2022-10-04 13:06:50 -07:00
util develop: canonicalize dev paths and base relative paths on env.path (#30075) 2022-09-30 20:56:53 +00:00
__init__.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
abi.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
audit.py Port package sanity unit tests to audits (#32405) 2022-09-01 08:21:12 +02:00
binary_distribution.py Fetching/decompressing: use magic numbers (#31589) 2022-09-26 00:01:42 -07:00
bootstrap.py Fixup errors introduced by Clingo Pr: (#32905) 2022-10-02 17:44:05 -07:00
build_environment.py BuildEnvironment: accumulate module changes to poke to all relevant modules (#32340) 2022-10-04 13:06:50 -07:00
caches.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
ci_needs_workaround.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
ci_optimization.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
ci.py Fix cause of checksum failures in public binary mirror (#32407) 2022-09-01 15:29:44 -06:00
compiler.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
concretize.py develop: canonicalize dev paths and base relative paths on env.path (#30075) 2022-09-30 20:56:53 +00:00
config.py Environments: Add support for include URLs (#29026) 2022-08-30 11:13:23 -07:00
cray_manifest.py Manifest parsing: skip invalid manifest files (#32467) 2022-09-14 13:02:51 -07:00
database.py Optimize reuse from buildcaches (#30806) 2022-08-02 11:43:14 -07:00
dependency.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
directives.py Add missing info to diagnostic for circular provides (#32027) 2022-08-11 14:20:17 +02:00
directory_layout.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
error.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
extensions.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
fetch_strategy.py Fetching/decompressing: use magic numbers (#31589) 2022-09-26 00:01:42 -07:00
filesystem_view.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
gcs_handler.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
graph.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
hash_types.py bugfix: package hash should affect process, dag, and dunder hashes (#32516) 2022-09-16 00:57:10 +00:00
install_test.py spack ci: add support for running stand-alone tests (#27877) 2022-08-23 00:52:48 -07:00
installer.py Install: Add use-buildcache option to install (#32537) 2022-09-29 13:48:06 -05:00
main.py Make GHA tests parallel by using xdist (#32361) 2022-09-07 20:12:57 +02:00
mirror.py Fix performance regression with spack mirror create --all (#32005) 2022-08-11 16:51:01 -07:00
mixins.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
multimethod.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
package_base.py Windows rpath support (#31930) 2022-09-13 10:28:29 -07:00
package_prefs.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
package_test.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
package.py Allow more fine-grained control over what submodules are updated (#27293) 2022-06-09 07:45:49 +02:00
parse.py improve lexing error (#32832) 2022-09-26 22:47:45 +00:00
patch.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
paths.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
projections.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
provider_index.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
relocate.py Fetching/decompressing: use magic numbers (#31589) 2022-09-26 00:01:42 -07:00
repo.py Optimize concurrent misc_cache provider index rebuild (#32874) 2022-10-05 06:01:59 -06:00
report.py spack ci: add support for running stand-alone tests (#27877) 2022-08-23 00:52:48 -07:00
reporter.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
resource.py Update copyright year to 2022 2022-01-14 22:50:21 -08:00
rewiring.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
s3_handler.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
spec_list.py New command, spack change, to change existing env specs (#31995) 2022-09-01 11:04:01 -07:00
spec.py bugfix: package hash should affect process, dag, and dunder hashes (#32516) 2022-09-16 00:57:10 +00:00
stage.py Environments: Add support for include URLs (#29026) 2022-08-30 11:13:23 -07:00
store.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
subprocess_context.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
tag.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
target.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
tengine.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
url.py Fetching/decompressing: use magic numbers (#31589) 2022-09-26 00:01:42 -07:00
user_environment.py Don't set LD_LIBRARY_PATH by default on Linux (#28354) 2022-08-11 09:33:08 -05:00
variant.py Allow conditional variants as first values in a variant directive (#32740) 2022-09-21 19:22:58 +02:00
verify.py black: reformat entire repository with black 2022-07-31 13:29:20 -07:00
version.py Fix two docstring typos (#32751) 2022-09-23 11:17:01 -07:00