Commit Graph

449 Commits

Author SHA1 Message Date
Jan Tojnar
71c246c785
maintainers/scripts/update.nix: Run update scripts from the worktree
`update.nix` extracts `passthru.updateScript` attributes in the main repo
and when they are relative paths (e.g. `./update.sh`), Nix will resolve them
to absolute paths in the main repo.

Update scripts can use $(dirname $0) to get the location of files they
should update but that would point to the main repo.
We want them to modify the appropriate git worktree instead
so we replace the prefix accordingly.

`git rev-parse --show-toplevel` will resolve symlinks but, fortunately,
Nix will do that as well, so the path will match:

https://github.com/NixOS/nixpkgs/pull/98304#issuecomment-695761754
2020-09-20 20:12:34 +02:00
Jan Tojnar
0c5ddf3358
maintainers/scripts/update.nix: run update script with UPDATE_NIX_ATTR_PATH
The environment variable will contain the attribute path the script is supposed to update.
2020-09-20 20:12:33 +02:00
Jan Tojnar
c21a85c6a0
maintainers/scripts/update.nix: auto-detect attrPath 2020-09-20 20:11:46 +02:00
Jan Tojnar
b351de0971
maintainers/scripts/update.nix: mention when there were no changes committed 2020-09-20 20:11:46 +02:00
Jan Tojnar
b828285933
maintainers/scripts/update.nix: support filling in auto-commit attributes
We can determine all of them when attrPath is present so we might jsut as well do it.
2020-09-20 20:11:46 +02:00
Jan Tojnar
4a161ddb3b
maintainers/scripts/update.nix: support auto-committing by passing attrPath
Instead of having the updateScript support returning JSON object,
it should be sufficient to specify attrPath in passthru.updateScript.
It is much easier to use.

The former is now considered experimental.
2020-09-20 20:11:46 +02:00
Jan Tojnar
01b9d5371c
maintainers/scripts/update.nix: switch to asyncio
This will make it cleaner and also better respect SIGTERM.
2020-09-20 20:11:45 +02:00
Jan Tojnar
17f89667b3
maintainers/scripts/update.nix: refactoring
Get rid of some globals, split main into smaller functions, rename some variables, add typehints.
2020-09-20 20:11:45 +02:00
Jan Tojnar
1efc042d92
maintainers/scripts/update.nix: Add support for auto-commiting changes
Update scripts can now declare features using

	passthru.updateScript = {
	  command = [ ../../update.sh pname ];
	  supportedFeatures = [ "commit" ];
	};

A `commit` feature means that when the update script finishes successfully,
it will print a JSON list like the following:

	[
	  {
	    "attrPath": "volume_key",
	    "oldVersion": "0.3.11",
	    "newVersion": "0.3.12",
	    "files": [
	      "/path/to/nixpkgs/pkgs/development/libraries/volume-key/default.nix"
	    ]
	  }
	]

and data from that will be used when update.nix is run with --argstr commit true
to create commits.

We will create a new git worktree for each thread in the pool and run the update
script there. Then we will commit the change and cherry pick it in the main repo,
releasing the worktree for a next change.
2020-09-20 20:11:22 +02:00
Jan Tojnar
5adbeb13c5
update.nix: use ThreadPoolExecutor
Not sure why I chose ProcessPoolExecutor in the first place.
2020-09-18 20:52:07 +02:00
Erik Arvstedt
be33b54672 maintainers/build: skip packages that don't evaluate 2020-09-14 21:17:13 -07:00
Francesco Gazzetta
b4496d4095 maintainers/build: skip packages without meta
Some packages do not have a meta attribute, and made the script crash.
2020-09-09 09:54:03 +02:00
Bruno Bigras
215ff41134 luaPackages.lua-resty-openidc: init at 1.7.2-1 2020-08-30 03:11:31 -04:00
Doron Behar
039056386d
luaPackages.pulseaudio: remove (#94939)
It's not maintained any more by upstream (by @doronbehar) and it doesn't
build correctly with `buildLuarocksPackage` (see #89767).
2020-08-08 15:43:13 +02:00
Vladimír Čunát
a44f91af27
lua packages: remove myself from some meta.maintainers
It will really happen after regeneration (no need to hurry, I guess).
Commit b7e6161b4 added me to cyrussasl by a mistake apparently.
In knot-resolver upstream we dropped luaossl and luafilesystem from
closure to ease up maintenance, so I no longer have motivation for them.
2020-06-10 07:30:59 +02:00
Luka Blaskovic
bd400bd006 lyaml: init at 6.2.5-1, update all generated packages 2020-06-06 18:45:57 +02:00
Jan Tojnar
3f3aeb7c85
maintainers/scripts/update.nix: refactor package collector
The `packagesWith` function expected an attrSet but `packagesWithUpdateScript`
could be passing it a derivation or a list when the attribute path
supplied by user through the `--argstr path` argument pointed to one.
It only worked because derivations are also attrSets and contain their
outputs as attributes, and did not work for lists at all.

Additionally, the improper handling would cause the `src` attribute
to be built in some rare cases (`mkYarnPackage` seems to trigger this).

Rewriting the `packagesWith` function to be inductive with a derivation
as a base case and attrSets and lists as inductive steps is much cleaner
and also fixes the unnecessary build.
2020-05-13 12:12:18 +02:00
Jan Tojnar
fab2ee8c10
maintainers/scripts/update.nix: derivation is the final station
It does not make sense to look for derivations within derivations,
not even when `recurseForDerivations` is true. Nix does not do that either:

ebc024df22/src/libexpr/get-drvs.cc (L346-L355)
2020-05-13 11:06:33 +02:00
Jan Tojnar
8f50956ee0
maintainers/scripts/update.nix: Import lib into scope
This will make it easier to change it if we want to decouple from pkgs.
2020-05-13 11:06:33 +02:00
gnidorah
d0c3e7bedb maintainers/scripts/build.nix: script to build all maintainer packages 2020-05-09 18:59:04 +02:00
Pavol Rusnak
7b0167204d treewide: use https for nixos.org and hydra.nixos.org
tarballs.nixos.org is omitted from the change because urls from there
are always hashed and checked
2020-05-03 22:14:21 -07:00
Benjamin Hipple
58b812f749 discord-{ptb,canary}: update to latest versions and fixup updateScript
This commit:

- Moves the update script into the dir, out of the maintainers dir. This makes
  it more discoverable in general. It can also be invoked from anywhere to write
  to default.nix
- Swaps it to use the standardized `passthru.updateScript`. This means that
  eventually bots like `nixpkgs-update` will be able to handle it.
- Runs the script to upgrade to the latest versions

See https://nixos.org/nixpkgs/manual/#ssec-stdenv-attributes
2020-04-12 11:55:36 -04:00
ydlr
9035381b11 nix-generate-from-cpan: use Module::CoreList to detect core modules
The previous way of detecting core modules failed to filter "if" and
possibly other core modules.
2020-03-14 00:25:33 -05:00
ydlr
5e2beafd02 nix-generate-from-cpan: remove unkown license
Leave license empty when it is not provided. This prevents packages from
failing to build because the license is set to
`stdenv.lib.licenses.unkown`.

There will still be a warning about the unkown license.
2020-03-13 23:49:45 -05:00
Jan Tojnar
cf366dd5f0
Merge pull request #80562 from NixOS/cus-broken
common-updater-scripts: Handle errors in src hashing
2020-02-20 20:25:50 +01:00
Jan Tojnar
bacb0969f2
maintainers/scripts/update.nix: allow updating overlays 2020-02-19 21:06:42 +01:00
Mario Rodas
7d64380b6b
luaPackages.cosmo: init at 16.06.04-1 2020-02-11 16:18:19 +03:00
Mario Rodas
0b2a15fddd
luaPackages.cassowary: init at 2.2-1 2020-02-11 16:18:19 +03:00
Thomas Tuegel
1af6bdd48f
plasma5: 5.16.5 -> 5.17.5 2020-01-27 08:29:28 -06:00
Matthieu Coudron
27c88c51e7 update-luarocks-packages: disable by default
Not only the binary `parallel` displays a re,inder to quote their
software but it systematically breaks update here regardless of my
network quality.
Better be slow than fail. If anyone can fix it, we may rollback this.
2020-01-25 19:39:28 +01:00
Matthieu Coudron
84a2134baa luaPackages.vstruct: init at 2.0.2-1 2020-01-25 19:39:28 +01:00
Matthieu Coudron
a032a3ad90 luaPackages.luarepl: init at 0.9-1 2020-01-25 19:39:28 +01:00
Matthieu Coudron
460224d4cd luaPackages.luaepnf: init at 0.3-1 2020-01-25 19:39:28 +01:00
Matthieu Coudron
bc07d117f2 luaPackages.linenoise: init at 0.9-1 2020-01-24 21:23:08 +01:00
Matthieu Coudron
5365e3650d luaPackages.digestif: scm1 -> 0.2-1
Now it's a released package so no need to specify the manifest anymore.
2020-01-24 21:23:08 +01:00
danbst
50db72d548 maintainers update.nix: fix typo in script help 2019-12-20 08:07:44 +02:00
worldofpeace
e716e86bed update.nix: fix eval 2019-11-25 15:08:59 -05:00
John Ericson
d0d5136cce Merge remote-tracking branch 'upstream/master' into wrapper-pname-support 2019-11-24 17:25:07 +00:00
John Ericson
9b090ccbca treewide: Get rid of most parseDrvName without breaking compat
That is because this commit should be merged to both master and
release-19.09.
2019-11-24 17:22:28 +00:00
Matthieu Coudron
5f3db033df
Merge pull request #71802 from teto/luadoc
adds Luadoc.
2019-10-24 18:04:12 +09:00
Matthieu Coudron
15818981fe luaPackages.luadoc: init at 3.0.1-1
Used in vim plugins like nvim-terminal-lua to generate html docs.
2019-10-23 20:03:57 +09:00
Matthieu Coudron
af6bdae831 luaPackages.lualogging: init at 1.3.0-1
Dependency of luadoc
2019-10-23 20:00:45 +09:00
Tadeo Kondrak
70167b64c5 maintainers/scripts/update-discord: improve
- add comment specifying file is generated
- remove repetition of version number
2019-10-15 21:21:13 -07:00
Matthieu Coudron
73c64f0f38 luaPackages.luacov: init at 0.13.0-1
It is needed to run luarocks test.
2019-10-14 21:53:23 +09:00
Doron Behar
922de4f4b5 luaPackages.pulseaudio: init at 0.1 2019-10-04 21:19:19 +02:00
edef
ac1fbe68bb nix-generate-from-cpan: strip leading v from versions
Everything currently in perl-packages.nix already does this,
so we might as well automate it.
2019-09-25 01:16:02 +00:00
edef
838902a82c nix-generate-from-cpan: use pname/version rather than version
The `name` parameter to buildPerlPackage is deprecated, and
everything currently in perl-packages.nix has already been
converted to use pname/version instead.

This also changes the URLs to be pure string literals,
matching the convention used in nixpkgs in practice.
2019-09-25 01:16:02 +00:00
Samuel Leathers
11fc56348e
maintainer scripts: fix hydra-eval-failures script 2019-09-13 23:33:38 -04:00
Matthieu Coudron
59d65e23e1
Merge pull request #68258 from teto/luarocks-nix_bump
Moved luarocks-nix to community and leverage luarocks mirrors when possible.
2019-09-09 12:41:54 +09:00
Matthieu Coudron
4a3189085a luarocks-nix: bump to 2019-09-07
added version and transferred the repostiory to nix-community.
With this bump, luarocks-nix generates mirro://luarocks urls.
2019-09-08 01:14:16 +09:00
Philipp
2787d4160c lua*Packages.lua-yajl: init at 2.0-1
Dependency for mudlet >= 4.0
2019-09-07 23:05:55 +09:00
Philipp
fc250d64e5 lua*Packages.luautf8: init at 0.1.1-1
Dependency for mudlet >= 4.0
2019-09-07 23:05:55 +09:00
Matthieu Coudron
89c3c1cb42 update-luarocks-packages: reference only 1 server
we now pass a configuration file when calling luarocks to prevent
impurities.
2019-09-07 19:59:09 +09:00
Michael Fellinger
1f49035aca ruby.withPackages: init
Co-authored-by: Alyssa Ross <hi@alyssa.is>
2019-09-03 19:44:49 +00:00
Luka Blaskovic
4d11f5dabd ljsyscall: init at 20180515 2019-08-28 19:58:14 +09:00
Alexei Robyn
740a7255b6 lua*Packages.moonscript: init at 0.5.0-1 (generated) 2019-08-21 22:06:32 +10:00
Alexei Robyn
c84a282c74 lua*Packages.alt-getopt: init at 0.8.0-1 (generated) 2019-08-21 22:04:19 +10:00
worldofpeace
3f4a353737 treewide: use dontUnpack 2019-07-01 04:23:51 -04:00
Alexei Robyn
3ca771cdc3 luaPackages.luaexpat: Downgrade to fix issue and match typical distros
Matches version used on most distros. Fixes an issue with prosody.
Detailed reasoning behind this can be found
[here](https://github.com/NixOS/nixpkgs/pull/63108#issuecomment-504015507).
2019-06-24 04:08:29 +02:00
Tadeo Kondrak
e6f23b8b1e discord-{ptb,canary}: init; add update-discord 2019-06-23 11:50:09 -07:00
Alexei Robyn
671e53af67 update-luarocks: Use containing nixpkgs, ensure Lua drvs exist 2019-06-14 15:17:52 +10:00
Alexei Robyn
46c6b27633 update-luarocks: Several improvements
Changes:
- Fetches rocks and builds Nix expressions for them in parallel
- Passes 'maintainers' list to luarocks-nix
- Constructs the luarocks argument list more cleanly, by using an
  indexed array
- Made indentation consistent
2019-06-13 20:00:00 +10:00
Alexei Robyn
b7e6161b4d luarocks-packages.csv: Add remaining manual Lua expression packages
And their deps.
2019-06-13 19:58:20 +10:00
Alexei Robyn
5a249ec657 luarocks-packages.csv: Sort rows, add some missing maintainers 2019-06-13 19:52:41 +10:00
Matthieu Coudron
128ca15808 luaPackages.lpeg: 1.0.1 -> 1.0.2
and move to generated
2019-06-07 21:17:01 +09:00
Matthieu Coudron
2d77d620ce luaPackages.luaposix: move to generated 2019-06-06 14:39:14 +09:00
Matthieu Coudron
6fe580e30b luaPackages.mpack: removed duplicate manual package 2019-06-06 14:39:14 +09:00
Matthieu Coudron
9a3f13f95f luarocks-packages.csv: track maintainers in column
luarocks-nix doesn't use yet but it will in next update.
2019-06-06 12:15:13 +09:00
Matthieu Coudron
dbf4c8051a luaPackages.lua-zlib: 1.1 -> 1.2
Renamed from luazlib to luarocks name lua-zlib.
Move to generated.
2019-06-06 12:12:15 +09:00
Matthieu Coudron
704358dcb5 luaPackages.luazip: 2007-10-30 -> 1.2.7 2019-06-05 16:20:27 +09:00
Matthieu Coudron
62d4e044e7 luaPackages.cjson: move to generated 2019-06-05 15:23:42 +09:00
Matthieu Coudron
f2f1726a9f
Merge pull request #62669 from teto/lua-lsp
Add one latex and one lua LSP server
2019-06-05 12:36:07 +09:00
Jan Tojnar
ea59f09946
maintainers/scripts/update.nix: various fixes (#62478)
maintainers/scripts/update.nix: various fixes
2019-06-04 18:24:16 +02:00
Matthieu Coudron
1b2e667ad6 luaPackages.lua-lsp: init at scm-2 2019-06-05 00:12:15 +09:00
Matthieu Coudron
021e04d0eb luaPackages.lpeglabel: init at 1.5.0 2019-06-05 00:11:56 +09:00
Matthieu Coudron
2fc71c7404 luaPackages.digestif: init at scm-1 2019-06-05 00:01:42 +09:00
Matthieu Coudron
87d1ab0905 luarocks-packages.csv: remove unnecessary servers
Now that luarocks-nix supports installation from rockspecs, it's
possible to remove some server specifications.
2019-06-04 19:11:42 +09:00
Matthieu Coudron
6736cc3e3a luarocks-packages.csv: Support luaversion
Opened with libreoffice calc which added the different commas
2019-06-04 18:57:42 +09:00
Matthieu Coudron
6402fbb6b8 update-luarocks: can install for a different lua
the recent luarocks can install for a different interpreter than the one
running luarocks.
Due to the way the update is done on nix, it seems more practical to use
this feature than running the script with different luarocks-nix ?
2019-06-04 18:57:42 +09:00
Matthieu Coudron
e967121053 update-luarocks: contact only the specified server
use --server-only instead of --server, I haven't run any testing but it
should be a bit faster as well as more deterministic.
2019-06-04 18:57:42 +09:00
Matthieu Coudron
cf45c7857a update-luarocks: doesn't crash when no arguments
define print_help function before it gets called.
2019-06-04 18:57:42 +09:00
Jan Tojnar
e98c804cc9
maintainers/scripts/update.nix: Clean up
Make calling update.py a little nicer
2019-06-02 09:07:18 +02:00
Jan Tojnar
c3dd31f177
maintainers/scripts/update.nix: handle null paths
Previously we did not handle non-existant paths making the program crash.
Let’s show a proper error.
2019-06-02 09:03:41 +02:00
Jan Tojnar
36b2012447
maintainers/scripts/update.nix: ignore overlays
It makes little sense for update.nix to try to update overlays; for most people,
they will point to a read-only repository most of the cases.
2019-06-02 08:55:29 +02:00
Jan Tojnar
fa1bbe69fb
maintainers/scripts/update.nix: Do not store updateScripts
For update script parallelization, we have started calling builtins.toJSON
on updateScripts, which triggers evaluation of paths and therefore their copying
to Nix store. This breaks update scripts that assume that they exist in nixpkgs
like dwarf-fortress.

https://github.com/NixOS/nixpkgs/issues/61935

Let’s stringify the paths before JSONification to prevent the evaluation.
2019-06-02 08:10:17 +02:00
Vladimír Čunát
ec5f5a21d7
Merge #60614: lua*Packages improvements 2019-05-12 10:01:48 +02:00
Will Dietz
d7ff576529
Merge pull request #60343 from dtzWill/fix/luarocks-nix-formatting-and-awesome-doc-goodness
luarocks-nix,luaPackages: formatting and additions; awesome: docs!
2019-05-10 16:56:58 -05:00
Vladimír Čunát
110fb944f1
lua*Packages.http: 0.3 -> 0.4 (and generate)
One bugfix patch is included - merged upstream but not released yet.
knot-resolver wrapper would need to add binaryheap explicitly,
so it's migrated to the automatic LUA path discovery instead.
2019-05-01 11:28:47 +02:00
Vladimír Čunát
6108e63a01
lua*Packages.binaryheap: init at 0.4-1 (generated)
The generator wanted to do various changes in other packages as well,
but I didn't commit those.
2019-05-01 10:33:26 +02:00
Luka Blaskovic
ca80cf922a lua: add rapidjson, lua-toml and lua-messagepack to generated packages 2019-04-30 08:35:29 +00:00
Will Dietz
55f7515442 luarocks: Add 'markdown' 2019-04-28 10:14:05 -05:00
Will Dietz
9a3ed7ea04 luaPackages: add ldoc 2019-04-28 10:14:05 -05:00
Will Dietz
c37b3ab888 update-luarocks-packages: simplify server var, whitespace fixup 2019-04-28 10:08:56 -05:00
Matthieu Coudron
e195a37fd9 luaPackages: rename std._debug to std__debug
Similarly rename std.normalize to std_normalize.
Having a dot in the name prevents some changes to the lua infrastructure,
for instance passing attribute names { std._debug }: to a function would fail with
`syntax error, unexpected ',', expecting '.' or '=',`
2019-04-14 16:38:23 +09:00
Matthieu Coudron
f84594c7d7 update-luarocks-package: fix version pinning 2019-04-14 16:38:23 +09:00
nyanloutre
4b7d9dc868 fetch-kde-qt.sh: get hashes from metadata 2019-03-27 22:16:18 -04:00
Matthieu Coudron
68a72f1a47 luarocks-nix: bump to match luarocks
Also made changes to lua package generation system to account for packages like cqueues
that have one version per lua interpreter.
The csv file also accepts comments now.
2019-03-07 17:43:07 +09:00
Vladimír Čunát
3e442fd0f9
Revert "luaPackages.cqueues: move to generated"
This reverts commit c01fe375ca.
See the reverted commit on GitHub for discussion.  /cc PR #55305.
2019-03-04 20:34:07 +01:00
Will Dietz
e49175ceae udpate-luarocks-package: drop 'lua' argument here as well 2019-02-25 23:53:21 -06:00
Matthieu Coudron
0cb3ee3bde luaPackages.lua-iconv: move to generated 2019-02-13 14:13:39 +09:00