1 2015-10-18T00:04:53 *** d_t has joined #bitcoin-core-dev 2 2015-10-18T00:09:08 *** CodeShark has quit IRC 3 2015-10-18T00:15:40 *** midnightmagic has joined #bitcoin-core-dev 4 2015-10-18T00:23:37 *** midnightmagic has quit IRC 5 2015-10-18T00:24:39 *** midnightmagic has joined #bitcoin-core-dev 6 2015-10-18T00:27:37 *** Thireus has quit IRC 7 2015-10-18T01:54:18 *** Ylbam has quit IRC 8 2015-10-18T02:05:33 *** belcher has quit IRC 9 2015-10-18T02:43:21 *** alpalp has quit IRC 10 2015-10-18T02:45:15 *** alpalp has joined #bitcoin-core-dev 11 2015-10-18T02:49:01 *** d_t has quit IRC 12 2015-10-18T02:59:20 *** fkhan has quit IRC 13 2015-10-18T03:11:42 *** d_t has joined #bitcoin-core-dev 14 2015-10-18T03:12:15 *** fkhan has joined #bitcoin-core-dev 15 2015-10-18T04:54:51 *** PRab_ has joined #bitcoin-core-dev 16 2015-10-18T04:55:42 *** gribble has quit IRC 17 2015-10-18T04:57:54 *** helo_ has joined #bitcoin-core-dev 18 2015-10-18T04:58:07 *** gmaxwell_ has joined #bitcoin-core-dev 19 2015-10-18T04:58:21 *** gavinand1esen has joined #bitcoin-core-dev 20 2015-10-18T04:58:22 *** luke-jr_ has joined #bitcoin-core-dev 21 2015-10-18T04:58:24 *** aj__ has joined #bitcoin-core-dev 22 2015-10-18T04:58:31 *** gmaxwell_ is now known as Guest81501 23 2015-10-18T04:59:53 *** Guest81501 has quit IRC 24 2015-10-18T04:59:54 *** Guest81501 has joined #bitcoin-core-dev 25 2015-10-18T05:01:06 *** cfields_ has joined #bitcoin-core-dev 26 2015-10-18T05:01:32 *** phantomcircuit_ has joined #bitcoin-core-dev 27 2015-10-18T05:02:52 *** PRab has quit IRC 28 2015-10-18T05:02:53 *** aj has quit IRC 29 2015-10-18T05:02:55 *** Luke-Jr has quit IRC 30 2015-10-18T05:02:56 *** jonasschnelli has quit IRC 31 2015-10-18T05:02:56 *** baldur has quit IRC 32 2015-10-18T05:02:57 *** phantomcircuit has quit IRC 33 2015-10-18T05:02:57 *** GAit has quit IRC 34 2015-10-18T05:02:58 *** BlueMatt has quit IRC 35 2015-10-18T05:03:00 *** helo has quit IRC 36 2015-10-18T05:03:01 *** berndj has quit IRC 37 2015-10-18T05:03:03 *** gmaxwell has quit IRC 38 2015-10-18T05:03:03 *** cfields has quit IRC 39 2015-10-18T05:03:05 *** gavinandresen has quit IRC 40 2015-10-18T05:03:15 *** GAit has joined #bitcoin-core-dev 41 2015-10-18T05:03:39 *** GAit is now known as Guest13178 42 2015-10-18T05:03:40 *** phantomcircuit_ is now known as phantomcircuit 43 2015-10-18T05:03:41 *** berndj has joined #bitcoin-core-dev 44 2015-10-18T05:04:04 *** BlueMatt has joined #bitcoin-core-dev 45 2015-10-18T05:09:03 *** gribble has joined #bitcoin-core-dev 46 2015-10-18T05:09:51 *** baldur has joined #bitcoin-core-dev 47 2015-10-18T05:10:46 *** ProfMac has quit IRC 48 2015-10-18T05:12:15 *** luke-jr_ is now known as Luke-Jr 49 2015-10-18T05:22:19 *** d_t has quit IRC 50 2015-10-18T05:50:41 *** JoeLiu has joined #bitcoin-core-dev 51 2015-10-18T05:56:11 *** jonasschnelli has joined #bitcoin-core-dev 52 2015-10-18T06:40:15 *** d_t has joined #bitcoin-core-dev 53 2015-10-18T06:58:33 *** Guest81501 is now known as gmaxwell 54 2015-10-18T07:09:24 *** Ylbam has joined #bitcoin-core-dev 55 2015-10-18T07:26:34 *** maaku has quit IRC 56 2015-10-18T07:28:16 *** maaku has joined #bitcoin-core-dev 57 2015-10-18T07:28:40 *** maaku is now known as Guest88932 58 2015-10-18T07:31:35 *** Guest88932 is now known as maaku 59 2015-10-18T07:36:55 <JoeLiu> Is there any book for Bitcoin developping? 60 2015-10-18T07:36:56 *** d_t has quit IRC 61 2015-10-18T07:53:45 *** CodeShark has joined #bitcoin-core-dev 62 2015-10-18T07:54:52 <Luke-Jr> JoeLiu: bitcoin.org has some useful documentation 63 2015-10-18T08:04:23 *** dcousens has joined #bitcoin-core-dev 64 2015-10-18T08:04:34 <dcousens> gmaxwell: you around? 65 2015-10-18T08:04:52 <dcousens> Just had my node drop, was curious why 66 2015-10-18T08:04:53 <dcousens> bitcoind 67 2015-10-18T08:04:53 <dcousens> Killed 68 2015-10-18T08:04:59 <dcousens> Nothing more on the console 69 2015-10-18T08:05:43 <dcousens> last few messages on the debug.log are 2015-10-16 18:14:46 socket sending timeout: 37784s 70 2015-10-18T08:06:28 <phantomcircuit> dcousens, run dmesg 71 2015-10-18T08:06:32 <phantomcircuit> im guessing out of memory 72 2015-10-18T08:06:42 <dcousens> ta, ya OOM. 73 2015-10-18T08:07:00 <dcousens> Though shouldn't have bitcoind thrown an error std::bad_alloc etc? 74 2015-10-18T08:08:18 <dcousens> is there any way I can stop this from happening? 75 2015-10-18T08:08:22 <dcousens> I had a higher minrelaytxfee 76 2015-10-18T08:11:08 <phantomcircuit> dcousens, how much memory do you have? 77 2015-10-18T08:11:42 <dcousens> phantomcircuit: on this node? 2GB 78 2015-10-18T08:12:05 <phantomcircuit> drop the maxconnections limit is probably what you have to do 79 2015-10-18T08:12:07 <phantomcircuit> unfortunately 80 2015-10-18T08:12:18 <dcousens> would just setting an even higher relay fee work maybe? 81 2015-10-18T08:12:43 <dcousens> also, whats the easiest way to track this data over time? 82 2015-10-18T08:12:57 <dcousens> (like, say, process v mempool MB size) 83 2015-10-18T08:14:30 <phantomcircuit> dcousens, you can call getmempoolinfo and dump that to a file somewhere 84 2015-10-18T08:16:15 <Luke-Jr> 2 GB is plenty. Probably your relay policy is too broad and is storing spam. 85 2015-10-18T08:36:15 *** aj__ is now known as aj 86 2015-10-18T09:19:59 <dcousens> Luke-Jr: default policy, so probably 87 2015-10-18T09:20:08 <dcousens> 0.12 couldn't come sooner :) 88 2015-10-18T09:21:05 <Luke-Jr> software versions are not for policies. 89 2015-10-18T09:21:14 <Luke-Jr> you're supposed to configure that yourself 90 2015-10-18T09:24:10 <dcousens> Luke-Jr: if I were to configure this node for what it is being paid to do, it'd be a leech solely 91 2015-10-18T09:24:34 <dcousens> I don't have time to allocate to configuring policy, so, the defaults matter 92 2015-10-18T09:24:58 <dcousens> Maybe if policy was as simple as dropping in some pre-written CPP files that there were a library of somewhere 93 2015-10-18T09:25:15 <dcousens> But, I'm not aware (nor is it advertised) of that 94 2015-10-18T09:26:11 <dcousens> (by leech solely, I mean, it'd only download blocks, no relay whatsoever) 95 2015-10-18T09:28:52 <Luke-Jr> then you get to deal with the unlimited resource consumption. we don't have time to help you. 96 2015-10-18T09:30:18 <Luke-Jr> deciding and configuring policy is part of the job of running a node, *especially* if you're being paid to do it.. 97 2015-10-18T09:31:51 <dcousens> Luke-Jr: lol, conceptually I agree with you, but pragmatically things tend to be different 98 2015-10-18T09:32:16 <Luke-Jr> instead you get paid to do it, and then go insist others do your job on their unpaid (at least by you) time.. 99 2015-10-18T09:33:37 <dcousens> Luke-Jr: I wasn't insisting anything? 100 2015-10-18T09:33:53 <Luke-Jr> [09:20:08] <dcousens> 0.12 couldn't come sooner âº [09:24:34] <dcousens> I don't have time to allocate to configuring policy, so, the defaults matter 101 2015-10-18T09:33:57 <Luke-Jr> sure sounds like it 102 2015-10-18T09:34:11 <dcousens> I understand the implications of OSS, its all I do all day 103 2015-10-18T09:34:17 <Luke-Jr> pragmatically, you're the one left without a working node, and having to explain to whoever is paying you why you're not doing the job 104 2015-10-18T09:34:27 <dcousens> Doesn't mean I can't express interest in some of the changes that will be deployed as defaults in 0.12 105 2015-10-18T09:35:02 <Luke-Jr> dcousens: we adopted a "don't change default policy" principle a bit ago. maybe we should have stuck to it stronger.. 106 2015-10-18T09:36:46 * Luke-Jr goes to bed. 107 2015-10-18T09:37:24 <dcousens> Luke-Jr: night, sorry you took my comments the wrong way. phantomcircuit thanks for the help 108 2015-10-18T09:55:45 *** JoeLiu has quit IRC 109 2015-10-18T10:03:30 <GitHub28> [bitcoin] dcousens opened pull request #6846: bitcoind: alias -h for --help (master...aliash) https://github.com/bitcoin/bitcoin/pull/6846 110 2015-10-18T10:06:57 *** randy-waterhouse has joined #bitcoin-core-dev 111 2015-10-18T10:45:07 *** Thireus has joined #bitcoin-core-dev 112 2015-10-18T11:16:26 *** dcousens has quit IRC 113 2015-10-18T11:25:20 *** belcher has joined #bitcoin-core-dev 114 2015-10-18T15:03:49 *** Guest13178 is now known as GAit 115 2015-10-18T15:44:11 *** randy-waterhouse has quit IRC 116 2015-10-18T15:47:01 *** Thireus has quit IRC 117 2015-10-18T15:49:06 *** BananaLotus has quit IRC 118 2015-10-18T15:50:26 *** guruvan has quit IRC 119 2015-10-18T15:50:42 *** BananaLotus has joined #bitcoin-core-dev 120 2015-10-18T15:54:44 *** BananaLotus has joined #bitcoin-core-dev 121 2015-10-18T15:55:39 *** guruvan has joined #bitcoin-core-dev 122 2015-10-18T16:18:16 *** d_t has joined #bitcoin-core-dev 123 2015-10-18T16:18:56 *** d_t has joined #bitcoin-core-dev 124 2015-10-18T16:29:12 <GitHub58> [bitcoin] rnicoll opened pull request #6848: Add DERSIG transaction test cases (master...bip66-tests) https://github.com/bitcoin/bitcoin/pull/6848 125 2015-10-18T16:48:46 *** Thireus has joined #bitcoin-core-dev 126 2015-10-18T16:56:19 *** Thireus has quit IRC 127 2015-10-18T16:57:11 *** rrrandom has joined #bitcoin-core-dev 128 2015-10-18T16:57:15 *** d_t has quit IRC 129 2015-10-18T16:58:54 *** belcher has quit IRC 130 2015-10-18T17:00:31 *** rrrandom has quit IRC 131 2015-10-18T17:01:03 *** Thireus has joined #bitcoin-core-dev 132 2015-10-18T17:01:47 *** belcher has joined #bitcoin-core-dev 133 2015-10-18T17:11:31 *** d_t has joined #bitcoin-core-dev 134 2015-10-18T17:25:20 *** Thireus has quit IRC 135 2015-10-18T18:26:39 <GitHub31> [bitcoin] afk11 opened pull request #6849: Mention PHP bindings to libbitcoinconsensus (master...bitcoinconsensus-php-bindings) https://github.com/bitcoin/bitcoin/pull/6849 136 2015-10-18T19:20:26 *** ParadoxSpiral has joined #bitcoin-core-dev 137 2015-10-18T19:26:26 *** ParadoxSpiral has quit IRC 138 2015-10-18T19:26:58 *** JoeLiu has joined #bitcoin-core-dev 139 2015-10-18T19:28:31 *** ParadoxSpiral has joined #bitcoin-core-dev 140 2015-10-18T19:32:29 <GitHub197> [bitcoin] bittylicious opened pull request #6850: Improve AddToWallet performance when rescanning (master...master) https://github.com/bitcoin/bitcoin/pull/6850 141 2015-10-18T19:34:50 <gmaxwell> Luke-Jr: ^ 142 2015-10-18T20:00:27 *** paveljanik has joined #bitcoin-core-dev 143 2015-10-18T20:11:13 *** belcher has quit IRC 144 2015-10-18T20:11:28 *** belcher has joined #bitcoin-core-dev 145 2015-10-18T20:17:13 <gmaxwell> Luke-Jr: So I'd rather remove smart times completely than have rescans take 9.5 hours longer in that case. :P so you should help him figure out how to get the behavior right. 146 2015-10-18T20:17:41 <gmaxwell> we never would have merged smart times knowing that it added hours to the rescan of a 200k key wallet. 147 2015-10-18T20:18:38 <Luke-Jr> :/ 148 2015-10-18T20:19:12 <Luke-Jr> this is the first complaint of that nature, whereas we used to have regular complaints about tranasction times before smart-times got released.. 149 2015-10-18T20:19:27 <gmaxwell> Luke-Jr: we have had regular complaints about rescan taking forever for a long time. 150 2015-10-18T20:19:34 <Luke-Jr> O.o 151 2015-10-18T20:19:36 <gmaxwell> Just didn't know smarttimes were part of it until now. 152 2015-10-18T20:19:47 <gmaxwell> heck, even I've complained about it. :) 153 2015-10-18T20:19:49 <Luke-Jr> it's rare enough I assumed he meant reindex 154 2015-10-18T20:20:06 <gmaxwell> Luke-Jr: no, rescale! as in zapwallettx (which he mentioned specifically) 155 2015-10-18T20:20:12 <gmaxwell> er rescan. 156 2015-10-18T20:20:32 <Luke-Jr> I mean, rescan and zapwallettx are not daily tasks 157 2015-10-18T20:20:35 <Luke-Jr> reindex is getting to be :/ 158 2015-10-18T20:21:04 <gmaxwell> Luke-Jr: people are zaping frequently because of the malleation attacks. 159 2015-10-18T20:21:18 <gmaxwell> still, this also means reindex would be slow, as we run the same code there. 160 2015-10-18T20:23:39 <Luke-Jr> if it's really 9.5 hours longer, then any significant optimisation is likely to require changing the database non-trivially, which is dangerous. I consider slow better than dangerous, since we plan to go away from bdb someday anyway. So if bad times in day-to-day use is preferable to slow rescan, reverting it may be our best option. :| 161 2015-10-18T20:25:11 <Luke-Jr> I'll take a look and see if I'm wrong about the risk, but that's what 9.5 hours suggests to me. 162 2015-10-18T20:35:32 <Luke-Jr> ok, we can probably get a lot of improvement by caching the ordered tx list rather than sorting it every add 163 2015-10-18T20:35:40 <Luke-Jr> >_< 164 2015-10-18T20:38:16 <Luke-Jr> any simple way to benchmark? 165 2015-10-18T20:40:15 *** paveljanik has quit IRC 166 2015-10-18T20:45:01 *** ParadoxSpiral has quit IRC 167 2015-10-18T21:05:31 *** Thireus has joined #bitcoin-core-dev 168 2015-10-18T21:08:29 <Luke-Jr> gmaxwell: this would be easier if I could remove accounting first; thoughts? 169 2015-10-18T21:08:31 <Luke-Jr> wumpus: ^ 170 2015-10-18T21:12:28 *** Thireus1 has joined #bitcoin-core-dev 171 2015-10-18T21:14:40 *** Thireus has quit IRC 172 2015-10-18T21:20:03 *** moli has joined #bitcoin-core-dev 173 2015-10-18T21:22:59 *** molly has quit IRC 174 2015-10-18T21:35:45 *** JoeLiu has quit IRC 175 2015-10-18T22:31:30 *** CodeShark has quit IRC 176 2015-10-18T23:45:26 <gmaxwell> Luke-Jr: why do you need the sorted list? 177 2015-10-18T23:45:37 <gmaxwell> Luke-Jr: can you not cache a min or max?