19:00:11 #startmeeting 19:00:11 Meeting started Thu Mar 12 19:00:11 2020 UTC. The chair is wumpus. Information about MeetBot at http://wiki.debian.org/MeetBot. 19:00:11 Useful Commands: #action #agreed #help #info #idea #link #topic. 19:00:19 hi 19:00:21 #bitcoin-core-dev Meeting: wumpus sipa gmaxwell jonasschnelli morcos luke-jr sdaftuar jtimon cfields petertodd kanzure bluematt instagibbs phantomcircuit codeshark michagogo marcofalke paveljanik NicolasDorier jl2012 achow101 meshcollider jnewbery maaku fanquake promag provoostenator aj Chris_Stewart_5 dongcarl gwillen jamesob ken281221 ryanofsky gleb moneyball kvaciral ariard digi_james amiti fjahr 19:00:22 hi 19:00:23 jeremyrubin lightlike emilengler jonatack hebasto jb55 19:00:25 hi 19:00:26 hi 19:00:27 hi 19:00:33 hi 19:00:36 hi 19:00:38 hello 19:00:46 hi (though distracted) 19:00:57 hi 19:01:01 one proposed topic in http://gnusha.org/bitcoin-core-dev/proposedmeetingtopics.txt : PPA URI (luke-jr) if he's here 19:01:07 hi 19:01:28 hi 19:01:33 other topic: status of coredev.tech survey about meeting options, or any results, or when to expect as much 19:01:42 (i don't have that information) 19:01:50 here for now 19:01:53 good thing that it was decided to cancel coredev last week, because people from Europe aren't even allowed to travel to the US anymore 19:02:29 #topic Features for 0.20 19:02:49 hi 19:02:50 as you might know, the feature freeze for 0.20 is in three days (the 15th) 19:03:34 is there anything in progress, that only needs a bit of review to go, could still be ready before then? 19:03:56 #16224 ? 19:03:58 https://github.com/bitcoin/bitcoin/issues/16224 | gui: Bilingual GUI error messages by hebasto · Pull Request #16224 · bitcoin/bitcoin · GitHub 19:04:30 hebasto: yes, good one 19:04:39 #17509? 19:04:41 https://github.com/bitcoin/bitcoin/issues/17509 | gui: save and load PSBT by Sjors · Pull Request #17509 · bitcoin/bitcoin · GitHub 19:05:01 I'd like #18204 too 19:05:07 https://github.com/bitcoin/bitcoin/issues/18204 | descriptors: improve descriptor cache and cache xpubs by achow101 · Pull Request #18204 · bitcoin/bitcoin · GitHub 19:05:12 hebasto: Will review this PR tomorrow 19:05:16 ^ I'll try to conserve ACKs but can quickly address feedback if needed on 19:05:29 that would be really nice to have 19:07:23 achow101: is 18204 a feature or performance improvement? 19:07:52 (I mean if the latter it could potentially go in after the feature freeze) 19:08:07 it can go in after the feature freeze I guess 19:08:28 it's really a performance improvement 19:08:41 i think it's a weak performance improvement, but also a necessity for descriptor wallets 19:08:51 but it has quite some ACKs, I see, so might not need to wait that long anyhow 19:09:06 I just don't want it to get stuck for another few months with 2 acks 19:09:47 it's always ok to remind me if something is almost ready for merge btw no need to wait until the meeting 19:10:53 #topic PPA URI (luke-jr) 19:11:32 pinging BlueMatt 19:11:47 ah, he's going through airport security 19:11:54 remove that 3 second wait on the send button 19:12:05 ? 19:12:05 or at least add an option 19:12:06 I'll let BlueMatt and luke-jr fight this out 19:12:16 I think the only question was whether to use deterministic builds or not 19:12:28 I can't see an argument for non-deterministic builds 19:12:36 and whether we want to support PPAs at all 19:12:43 I think that's the main question 19:12:55 there's various documentation written by other people that refer to the ppa 19:13:24 if we can make the PPA deterministic (or even identical to the release builds), that would be ideal 19:13:53 yes, definitely 19:13:54 I am maintaining the PPA 19:14:03 Note that ppa has two series’ of issues that releases did not: GUI issues that persisted for two releases and weren’t ever solved and the 32-bit test failures. 19:14:13 I don't really know why anyone else needs to be involved in this fact.. 19:14:25 The second one especially scares me 19:14:36 what do you need from us then? 19:14:37 the only question in my mind is whether it should remain at 'bitcoin' as some have suggested, or move to my own launchpad 19:14:37 That was the gcc compiler bug 19:14:54 But if people want it, it should be maintained as a part of the packaging repo 19:15:10 I think it should remain at 'bitcoin' as that's where a bunch of docs that mention the ppa point to 19:15:29 BlueMatt seems to not only want to stop maitnaining it, but also suppress others from doing so. hence the meeting topic 19:16:01 I think we shouldn't offer software that is impossible to audit 19:16:37 determinisitic builds in the ppa are fine, though 19:16:37 well the "bitcoin" PPA is his so as for maintining that that's his decision, if you maintain youre own somewhere else that's fine, but we likely won't link to it 19:16:57 (we never even linked from the repo to his ppa either afaik) 19:17:22 bitcoincore 19:17:32 wumpus: the ppa has been linked to before from both our repo and bitcoincore.org. those were removed, but it has been "official" 19:17:47 bitcoincore.org or bitcoin.org linked to it as a way of installing 19:18:01 Yes, I remember removing that link 19:18:05 achow101: I think the ppa was only linked as a means to install bdb4 19:18:16 oh okay 19:19:33 I think there is no one objecting a ppa that wraps our normal release builds 19:19:45 like the snap does, right? 19:20:07 jup 19:20:29 But some people don't like the snap, because it doesn't install it in the "classic" location etc 19:20:57 … how much of that made it :/ 19:21:09 Canonical is ultimately responsible for the PPA builds 19:21:09 it's also not what you'd get by building from source and knstalling 19:21:22 the gitian builds are terrible; they have a purpose, sure, but they're not even close to what users ideally would use 19:21:24 luke-jr: your last message was "BlueMatt seems to not only want to stop maitnaining it, but also suppress others from doing so. hence the meeting topic" 19:21:25 the PPA is built by the OS vendor, and produces binaries specifically for the OS 19:21:44 wumpus: after that was [19:16:12] so I guess the questions are 1) do we want to keep the PPA at the old URI, and 2) can we satisfy BlueMatt to allow that? 19:21:49 make the gitian builds less horrible then 19:21:59 wumpus: that's incompatible with the goal of them 19:22:03 it's what everything is based on and the only auditable one 19:22:13 wumpus: gitian builds are intended to run anywhere, but that's incompatible with being targetted to a specific distro 19:22:39 luke-jr: how so? something that runs anywhere should also run on a specific distro 19:22:46 * dongcarl is so confused 19:22:49 agree with achow101 19:22:57 luke-jr: just because of UI theming etc? 19:22:58 achow101: ideally, binaries should dynamic link to system libraries for ~everything 19:23:01 things like GUI costomization/integration I guess 19:23:10 sipa: that's a symptom 19:23:26 not that that ever worked well for the PPA 19:23:37 we had more UI issues with the PPA than ever with the gitian builds 19:23:43 seema like a small price to pay for auditabke builds 19:23:47 luke-jr: but we don't necessarily support the specific system libraries that may be installed 19:23:50 sorry, car tyoing 19:23:50 nobody is suggesting removing the gitian option 19:23:51 there may be version differences, etc. 19:23:58 achow101: we do 19:24:03 although at least the crazyness with ubuntu unity is gone now 19:24:05 achow101: the preferred install is from source 19:24:35 achow101: (and PPAs don't support distros without the required versions) 19:25:14 logical order of preference, for an Ubuntu user, is build-from-source > PPA > gitian 19:25:23 but I agree with sipa, deterministic builds are worth a little bit of GUI integration annoyance 19:25:29 If someone really wants to use the system libs, why can't they build from source? 19:25:37 it might be nice if we could deterministically make the PPA debs, but Launchpad doesn't support that 19:25:47 if a distro version lacks the requisite system libs, gitian would still work there, no? I think that's a good thing 19:25:49 MarcoFalke: many users don't know how, or don't want to spend the time 19:25:50 Very naive thought: is it possible to have 2 PPAs, 1 for gitian built binaries, 1 for specifically OS-integrated? 19:25:57 achow101: absolutely 19:26:05 dongcarl: I'd support that 19:26:08 achow101: PPAs are not a replacement for gitian, they are an alternative for certain users 19:26:17 dongcarl: should be 19:26:24 bitcoin/bitcoin would be deterministic and luke-jr/bitcoin is built with system libs 19:26:25 dongcarl: sounds like a good idea, even 19:26:33 MarcoFalke: that seems backward 19:26:46 bitcoin/bitcoin has always been system libs 19:27:00 luke-jr: you seem to be the only one arguing for system libs 19:27:14 sipa: so? 19:27:17 I think anything "official" should only be determinisitic 19:27:22 agree 19:27:23 agree 19:27:24 achow101: +1 19:28:01 agree 19:28:12 +1 19:28:13 achow101: why? 19:28:20 Distro-built is equivalent security 19:28:31 if your distro is compromised, a gitian build won't help you 19:28:36 because it's the only one we can vouch for based on the sha256 hashes 19:28:58 luke-jr: We are talking about the ppa infrastructure being compromised, not the normal package build infra 19:29:07 MarcoFalke: isn't it the same? 19:29:18 I hope for Ubuntu that they are different, at least different datacenters 19:29:34 MarcoFalke: i doubt that 19:29:45 so I think we've pretty much reached an agreement here, any other topics? 19:29:47 anyway, how about adding a disclaimer to the effect of "These are built by Canonical, not the Bitcoin Core project"? 19:29:48 luke-jr: how is it the same? 19:30:01 achow101: PPAs are built by Canonical 19:30:12 luke-jr: and maintained by the PPA maintainer 19:30:33 yes but their build infrastructure runs arbitrary builds of arbitrary software, in the PPA case, so it's not that far fetched it could be compromised 19:30:39 sipa: just like the snaps are.. 19:30:56 luke-jr: The snap you can check against the signed hash 19:31:11 MarcoFalke: our website says you can't last I checked 19:31:13 right, the snap packages the gitian-built executables so you can verify them in the same way 19:31:27 luke-jr: I coldn't find a cross-platform way to do it 19:31:45 But on my machine it works last time I tried 19:31:53 this would also be true for a PPA that packages the gitian-built binaries 19:32:22 wumpus: I am not sure the blockers are a topic this week, but FWIW it looks like #16426 is currently replaced by #17954 19:32:26 https://github.com/bitcoin/bitcoin/issues/16426 | Reverse cs_main, cs_wallet lock order and reduce cs_main locking by ariard · Pull Request #16426 · bitcoin/bitcoin · GitHub 19:32:29 https://github.com/bitcoin/bitcoin/issues/17954 | wallet: Remove calls to Chain::Lock methods by ryanofsky · Pull Request #17954 · bitcoin/bitcoin · GitHub 19:32:44 MarcoFalke: it verifies the entire snap, not just the chosen binaries installed? 19:32:45 which, by mutual agreement of the PR authors, apparently should be merged in first 19:33:03 jonatack: I've forgone blockers because of focusing on things that need to go in before the feature freeze which is imminent, but sure I'll swap them 19:33:05 I'm not entirely sure what argument sipa is trying to make.. 19:33:20 luke-jr: Of course you'd still have to trust the snapd 19:33:30 there is no way I could as maintainer compromise the PPA without it being publicly visible 19:34:31 but it's possible for canonical to compromise it invisibly 19:34:37 achow101: absolutely. 19:34:42 just like they can compromise the OS 19:34:52 in which case gitian does no good to prevent it 19:35:54 but at least users can verify that the ppa was not compromised with gitian 19:36:03 are any estimation of a ppa share among all users? 19:36:06 and IIRC, PPAs can still be used on ubuntu derivatives 19:36:14 and other distros which are not necessarily canonical 19:36:19 hebasto: very few have noticed the URI changed 19:36:30 luke-jr: it didn't cba ge 19:36:37 it was discontinued 19:36:47 sipa: no, I am still maintaining it 19:36:47 you have your own PPA 19:37:32 hebasto: 2019-09, there were still around 8000 users of the PPA at bitcoin/bitcoin 19:37:53 so we already discussed a compromise acceptable with most people here (two PPAs), I'm not sure it makes sense to continue arguing this 19:37:56 who are now stuck on 0.18.0 until they switch to the new PPA 19:38:40 wumpus: anyone can make a 2nd PPA, but I'm not sure there's a need with the snap doing the gitian binaries already 19:38:43 maybe we should, until we resolve this, push an update to the PPA that installs a binary that just prints "this is not maintained, see page X" 19:38:56 sipa: or at least deletes the binary 19:39:02 right 19:39:29 i agree there are probably people stuck at 0.18 by not noticing the ppa page that says it's not maintained 19:39:30 maybe less invasive to patch 0.18.0 with a message, but.. not sure I like the idea of doing a known-vulnerable "release" 19:39:31 at least make sure it doesn't delete the wallet ... 19:39:55 wumpus: i don't think system installs can delete user files 19:40:18 sipa: I think that was a risk wit hthe snap at some point 19:40:22 I guess that's one potentially scary thing about Snaps 19:40:24 yeah 19:40:31 wumpus: i know nothing about snap 19:40:39 sipa: it's basically a chroot AIUI 19:40:58 but yes unintalling a deb shouldn't remove user files (or even system configuration files without --purge) 19:41:16 Snap creates a snapshot of your wallet on uninstall 19:41:32 MarcoFalke: scary 19:41:37 I suppose that might be a reason to support a second gitian-binary PPA 19:41:59 sipa: Less scary than deleting it 19:42:07 fair 19:42:13 back to the original topic though, bitcoin/bitcoin seems like a bad URI IMO 19:42:25 bumping it with a move message seems like a good solution 19:42:35 and that can refer to the two new PPAs with clarification of distinction 19:42:36 ? 19:43:19 could be luke-jr/bitcoincore & luke-jr/bitcoincore-deterministic, or bitcoincore/bitcoincore-{system,deterministic} or something along those lines? 19:43:43 (not promising I'll make the gitian binary PPA - just throwing out ideas for discussion) 19:44:02 advantage of the former is that it's obvious who maintains it; but the latter will work even if multiple people or maintainers change 19:44:22 I think we have to keep bitcoin/bitcoin just to keep existing docs working and not confusing existing users further 19:44:28 downside of the latter is it implies the project is responsible for it, which seems undesirable 19:45:06 if there's two PPAs then docs have to be updated anyway 19:45:09 achow101: currently only BlueMatt has a monopoly on the 'bitcoin' name 19:45:22 WITH documentation on what the choice is and why 19:45:44 even providing a notice-bump on the old PPA will require BlueMatt's cooperation 19:47:13 In launchpad it is possible to change the email address to something@bitcoincore.org, so that whoever has access to that can reset it 19:47:27 That is how I set up the snap 19:49:02 MarcoFalke: I don't know how BlueMatt setup the Launchpad stuff - I suspect the account is his personal account, and ~bitcoin is just a team with only him 19:49:11 would be nice if we could come to some agreement here to present to BlueMatt.. maybe "two new PPAs, and bump bitcoin/bitcoin with a notice"? 19:49:51 actually, notice should mention the gitian builds and Snap too for completeness IMO 19:51:14 yes +1 with adding a notice to bitcoin/bitcoin at least, no matter if there's any new PPAs 19:52:01 it would be IMO absurd to say that BlueMatt is allowed to maintain a PPA and I am not 19:52:55 (which is what would be implied by refusing to tell users of the new URI) 19:52:56 well we all think an 'official' PPA should be built from the gitian-built binaries, and you disagree with that, so that's not entirely unexpected 19:53:20 wumpus: it never has been 19:53:21 does PPA require a single maintainer? with snaps we have a github packaging repository that gets normal review and a something@bitcoincore.org owner like marco mentioned 19:53:40 ryanofsky: the PPA stuff is in the same repo 19:54:01 ryanofsky: I have a PR open for the gitian YML that submits it to Canonical, but nobody seem to care to review it 19:54:49 that's another point to simply package the gitain-built binaries; it doens't require as much maintenance or separate testing 19:54:49 oh, well it seems kind of important to get that merged so we can have multiple maintainers 19:54:53 luke-jr: It seems to be pending on the further steps we take 19:55:18 ryanofsky: I wasn't aware anyone else was interested ;) 19:56:10 MarcoFalke: ultimately, it's a question of whether someone is trying to dictate to users how they use Core, or let them make an informed decision 19:57:21 it'd be one thing if nobody was willing to maintain the PPA at all; it's another to try to stop someone 19:57:59 well you're maintaining it, we're definitely not able to stop you doing that 19:58:28 or even interested in doing so 19:58:42 Filed an issue here: https://github.com/bitcoin-core/packaging/issues/36 19:58:43 wumpus: right, but it's also inappropriate to suddenly pretend it doesn't exist, or block users from finding it 19:59:02 the point is *if* you want 'official' recognition for it, you'll also have to have other people agree with you how to do things 19:59:23 if you do it your own way in your own ppa, fine, topic closed :) 19:59:37 #endmeeting