Commit Graph

23593 Commits

Author SHA1 Message Date
Massimiliano Culpo
22db992b5c Add Changelog for v0.17.3, bump version number v0.17.3 2022-07-15 15:31:21 +02:00
Jordan Galby
0b1be57e08 Fix spack install chgrp on symlinks (#30743)
Fixes missing chgrp on symlinks in package installations, and errors on
symlinks referencing non-existent or non-writable locations.

Note: `os.chown(.., follow_symlinks=False)` is python3 only, but
`os.lchown` exists in both versions.
2022-07-14 16:47:26 +02:00
Jordan Galby
9d04632cee Non-existent upstream is not fatal (#30746)
A non-existent upstream should not be fatal: it could only mean it is
not deployed yet. In the meantime, it should not block the user to
rebuild anything it needs.

A warning is still emitted, to let the user decide if this is ok or not.
2022-07-14 16:47:26 +02:00
Jordan Galby
f374fe8a62 Don't try to mkdir upstream directory when nonexistent (#30744)
When an upstream is specified but the directory does not exist, don't
create the directory for it, it might not be yours.
2022-07-14 16:47:26 +02:00
Harmen Stoppels
6193d59d5d Compiler wrapper: fix globbing and debug out.log bell chars (#30699)
* Disable globbing

* Split on bell char when dumping cmd to out.log
2022-07-14 16:47:26 +02:00
andymwood
fa0ac5f24b Avoid calling a method on a NoneType object (#30637) 2022-07-14 16:47:26 +02:00
Alberto Invernizzi
5cea962e8e Fix for spack stage command not extracting packages in custom paths (#30448) 2022-07-14 16:47:26 +02:00
Todd Gamblin
b9fa27ac65 bootstrap: clean up CI workflows a bit (#30574)
- [x] Add `mkdir -p` and `chmod` to ensure `/home/spack-test` exists and
      has correct permissions.
- [x] Remove version comments from dependabot-managed action commits
- [x] Don't duplicate comment describing required fixes for distros with
      patched git
2022-07-14 16:47:26 +02:00
Massimiliano Culpo
96535dc39f CI: fix bootstrapping on Fedora (#30559)
Fedora updated git, so we need to apply, again, the
workaround for CVE-2022-24765
2022-07-14 16:47:26 +02:00
Massimiliano Culpo
b74b175673 Fix issue in CI with Git 2.35 (#30436) 2022-07-14 16:47:26 +02:00
Massimiliano Culpo
912109da16 Bump version number to v0.17.2 v0.17.2 2022-04-14 11:08:17 +02:00
Massimiliano Culpo
5e0eb1f887 CI: avoid issues with Ubuntu patched git by adding safe.directory (#30042)
Ubuntu patched git v2.25.1 with a security fix that also
introduced a breaking change, so v2.25.1 behaves like
v2.35.2 with respect to the use cases in CVE-2022-24765
2022-04-14 11:08:17 +02:00
Massimiliano Culpo
7cd7b38cb8 Add CHANGELOG for v0.17.2 2022-04-14 11:08:17 +02:00
Michael Kuhn
a2a403ae0a installer: Fix cosmetic problem with terminal title (#29070)
The status displayed in the terminal title could be wrong when doing
distributed builds. For instance, doing `spack install glib` in two
different terminals could lead to the current package being reported as
`40/29` due to the way Spack handles retrying locks.

Work around this by keeping track of the package IDs that were already
encountered to avoid counting packages twice.
2022-04-14 11:08:17 +02:00
Greg Becker
3b12a8b192 patch cache: fix bug finding inherited packages (#29574) 2022-04-14 11:08:17 +02:00
Massimiliano Culpo
e9896620e4 Remove known issues from documentation (#29664)
Known issues reports only 2 issues, among the bugs reported on GitHub.
One of the two is also outdated, since the issue has been solved
with the new concretizer. Thus, this commit removes the section.
2022-04-14 11:08:17 +02:00
Harmen Stoppels
9d00894c5a fix --reuse w/ upstreams in env (#29680) 2022-04-14 11:08:17 +02:00
Harmen Stoppels
1cc2b82408 environment: be more defensive when deleting roots for old views (#29636)
Currently `old_root` is computed by reading the symlink at `self.root`.
We should be more defensive in removing it by checking that it is in the
same directory as the new root. Otherwise, in the worst case, when
someone runs `spack env create --with-view=./view -d .` and `view`
already exists and is a symlink to `/`, Spack effectively runs `rm -rf /`.
2022-04-14 11:08:17 +02:00
Greg Becker
ad2c020848 config add: fix parsing of validator error to infer type from oneOf (#29475) 2022-04-14 11:08:17 +02:00
Massimiliano Culpo
bd119927ff Use Spec.constrain to construct spec lists for stacks (#28783)
* stacks: add regression tests for matrix expansion

* Use constrain semantics to construct spec lists for stacks

* Fix semantics for constraining an anonymous spec. Add tests
2022-04-14 11:08:17 +02:00
Tom Scogland
2a8fe3a5b0 allow ci reproduce to work when spack is cloned to a directory not named spack (#29518) 2022-04-14 11:08:17 +02:00
Harmen Stoppels
3427e2c8cf PackageViewMixin: fix symlinks conflict issue (#29515)
`stat`'ing a file in the dst dir is the wrong thing to do, you should
`lstat` to capture broken symlinks.
2022-04-14 11:08:17 +02:00
Harmen Stoppels
e8bb341536 intel-mkl: load compiler modules when querying compiler (#29439) 2022-04-14 11:08:17 +02:00
百地 希留耶
08009ffd70 Hide package repository count when redirecting stdout (#29402) 2022-04-14 11:08:17 +02:00
百地 希留耶
d4f2326824 Fix tab completion erroring with spack unit-test (#29405) 2022-04-14 11:08:17 +02:00
Harmen Stoppels
9edfd25134 ci.py: fix utf-8 issue with git log output (#29419) 2022-04-14 11:08:17 +02:00
Harmen Stoppels
afb3f4ff20 Add a test 2022-04-14 11:08:17 +02:00
Harmen Stoppels
9d8e411d76 VersionRange.satisfies should test non-empty intersection 2022-04-14 11:08:17 +02:00
Massimiliano Culpo
fbdcd7cbf1 Fix typos when forwarding arguments to traverse_edges (#29261)
A few calls use `deptypes=...` instead of `deptype=...`
2022-04-14 11:08:17 +02:00
Harmen Stoppels
5b0d4fe928 Unalias despacktivate only when alias exists (#28939) 2022-04-14 11:08:17 +02:00
Harmen Stoppels
deb9102b2d database: fix reindex with uninstalled deps (#28764)
* Fix reindex with uninstalled deps

When a prefix of a dep is removed, and the db is reindexed, it is added
through the dependent, but until now it incorrectly listed the spec as
'installed'.

There was also some questionable behavior in the db when the same spec
was added multiple times, it would always be marked installed.

* Always reserve path

* Only add installed spec's prefixes to install prefixes set

* Improve warning, and ensure ensure only ensures

* test: reindex with every file system remnant removed except for the old index; it should give a database with nothing installed, including records with installed==False,external==False,ref_count==0,explicit=True, and these should be removable from the database
2022-04-14 11:08:17 +02:00
Adam J. Stewart
e0be0d8683 Resource stage: no space before colon (#28560) 2022-04-14 11:08:17 +02:00
Jordan Galby
1179623002 Fix spack -C command_line_scope with other flags (#28418)
The option `spack -C` was broken if another flag that touched config was
also set (`spack -C ... -d`, `-c config:...` etc...).
2022-04-14 11:08:17 +02:00
Tamara Dahlgren
ab5c02d538 is_system_path: return False if path is None (#28403) 2022-04-14 11:08:17 +02:00
Peter Scheibel
1fd6fedba5 stage.steal_source: preserve symlinks
This avoids dangling symlink errors. ignore_dangling_symlinks option would be more-targeted but is only available for Python >= 3.2 (#28318)
2022-04-14 11:08:17 +02:00
Harmen Stoppels
69cbf10a80 Fix spack install --v[tab] spec (#28278) 2022-04-14 11:08:17 +02:00
Harmen Stoppels
5b2d7445b8 Fix double space in prompt after 'spack env activate -p' (#28279) 2022-04-14 11:08:17 +02:00
Massimiliano Culpo
e974b44e86 Fix execution of style tests v0.17.1 2021-12-23 16:34:31 +01:00
Massimiliano Culpo
69b8cddb1b Bump version and update CHANGELOG.md 2021-12-23 16:02:09 +01:00
Tom Scogland
8e659f512e locks: allow locks to work under high contention (#27846)
* locks: allow locks to work under high contention

This is a bug found by Harshitha Menon.  

The `lock=None` line shouldn't be a release but should be 
```
return (lock_type, None)
``` 
to inform the caller it couldn't get the lock type requested without
disturbing the existing lock object in the database.  There were also a
couple of bugs due to taking write locks at the beginning without any
checking or release, and not releasing read locks before requeueing.
This version no longer gives me read upgrade to write errors, even
running 200 instances on one box.

* Change lock in check_deps_status to read, release if not installed,
  not sure why this was ever write, but read definitely is more
  appropriate here, and the read lock is only held out of the scope if
  the package is installed.

* Release read lock before requeueing to reduce chance of livelock, the
  timeout that caused the original issue now happens in roughly 3 of 200
  workers instead of 199 on average.
2021-12-23 16:02:09 +01:00
Harmen Stoppels
5daf023aec Regenerate views when specs already installed (#28113)
With this commit:
```
$ spack env activate --temp
$ spack install zlib
==> All of the packages are already installed
==> Updating view at /tmp/spack-faiirgmt/.spack-env/view
$ spack install zlib
==> All of the packages are already installed
```

Before this PR:
```
$ spack env activate --temp
$ spack install zlib
==> All of the packages are already installed
$ spack install zlib
==> All of the packages are already installed
```

No view was generated
2021-12-23 16:02:09 +01:00
Massimiliano Culpo
87abda4cdd py-pandas: fix issue reported by vermin 2021-12-23 16:02:09 +01:00
Morten Kristensen
fa5e186d4a py-vermin: add latest version 1.3.2 (#28072)
* py-vermin: add latest version 1.3.2

* [vermin] Fixed usages of super() without arguments (v3+)
2021-12-23 16:02:09 +01:00
Paul Spencer
e1cc28a30a sbang: respect package permissive package permissions for sbang (#25764)
Co-authored-by: Todd Gamblin <tgamblin@llnl.gov>
Co-authored-by: Tamara Dahlgren <35777542+tldahlgren@users.noreply.github.com>
2021-12-23 16:02:09 +01:00
victorusu
17edf1ae90 Add setdefault option to tcl module (#14686)
This commit introduces the command

spack module tcl setdefault <package>

similar to the one already available for lmod

Co-authored-by: Massimiliano Culpo <massimiliano.culpo@gmail.com>
2021-12-23 16:02:09 +01:00
Harmen Stoppels
79fd1c5114 Set backup=False by default in filter_file (#28036) 2021-12-23 16:02:09 +01:00
Harmen Stoppels
13e36c5457 Fix table formatting (#28037) 2021-12-23 16:02:09 +01:00
Harmen Stoppels
b2694013d4 Revert "patches: make re-applied patches idempotent (#26784)" (#27625)
This reverts commit c5ca0db27f.
2021-12-23 16:02:09 +01:00
Andrew W Elble
8f3b025b55 MANPATH needs a trailing ':' to utilize system defaults (#21682)
otherwise spack breaks using system man pages by default.

Co-authored-by: Harmen Stoppels <harmenstoppels@gmail.com>
2021-12-23 16:02:09 +01:00
Christian Goll
37fbe30c4a Added opensuse/leap:15 to spack containerize (#27837)
Co-authored-by: Massimiliano Culpo <massimiliano.culpo@gmail.com>
2021-12-23 16:02:09 +01:00