GoldCoin Talk
Main Category => Technical Discussion => Topic started by: akumaburn on May 11, 2015, 02:51:23 PM
-
The purpose of this thread is to give you regular updates on what is going on behind the scenes.
I Intend to post to this thread myself, 6 days a week(hopefully) just about what is currently going on. Thus you will have a date mark and an idea of how things are progressing.
This applies to everything(patches, website/block explorer), not just the new client. (The progress thread for that is misleading with its percentages(percentages don't indicate the scope of technical problems), and so I'll be updating here until it is done).
I know a lot of times, I tell you something has been delayed for a technical reasons, it can be very frustrating as you may not completely understand why. Or if any progress is actually being made.
So the purpose of this thread is to address all that.
If you have any specific questions that you'd like answered, please post them to the "Daily(almost) Update Thread Q&A", as this thread will be locked for Dream Team use only.
PS - The large font size is for your viewing pleasure.
-
Yesterday's Updates(check post date):
- 64 Bit Linux and 32/64 Bit Windows clients compiled successfully.
- 32 Bit Linux needed re-setup of development environment.
- 32/64 Bit OSX development environment non-functional after macports update
- All development VMs rebuilt
- Attempts to compile client under OSX failed. Problem with QT libraries being 32 bit while all other dependencies are 64 bit
- Attempts to compile QT 4.8.6 under OSX for -arch x86_64 failed, problem with .pch being recognized as directory not a file.
- Further investigation reveals a problem with the QT everywhere source..
- Problem identified as unsolvable within given timeframe
- Recommended to compile all the other deps as 32 bit and simply compile the OSX client as -arch i386 instead
- 4 AM signing off
-
Today's Updates(check post date):
- Pondering to download sources for libboost, openssl, miniupnpc.. etc
- Trying to install via Qmake instead before trying to re-compile dependencies
- Qrencode.h not found.. Looking to rectify link
- Unable to rectify, item is set using a path variable, using EXPORT with the path to qrencode include's directory on proper variable had no effect
- Attempting to rectify using QT creator instead of command-line
- SUCCESS OSX build successfully created
- Checking for linking errors in executable..
- Build does not appear to be static according to otool -L.. dynamic links to openssl 0.98 found.. attempting to fix..
- Build option fix unsuccessful, attempting to manually transfer/link dependencies
- Success.. Building DMG file
- DMG build successful
- Mac Build complete, copying and proceeding to Linux build
- Compiling 32 bit Linux build
- 32 Bit Daemon compiled.. proceeding to GUI
- 32 Bit releases done. Updating 64 bit releases (last one before announcement)
- Opensslconf.h was missing.. perhaps its in /usr/include/x86_64-linux-gnu/openssl/opensslconf.h?
- Attempting to symlink multiarch pathing
- Success.. Compiling daemon..
- Library linking errors found.. troubleshooting..
- Fixed.. incorrect 32BIT=1 was set
- Daemon compiled, proceeding to GUI
- GUI compiled. All releases successful. Adding Docs and Zipping for release.
- Waiting for dropbox to sync. Attempting to find replacement for github client so that master branch contains only official releases
- Release Successful.
- 11PM signing off
-
Today's Updates(check post date):
- Thinking about how best to arrange the github
- Wondering if Mercurial would be a better option
- Mercurial would probably be hosted on a service like https://bitbucket.org/ , but this seems to only be free up to 5 developers
- The same company that owns bitbucket has made a DVCS client called SourceTree. I'll give this a try for git, before continuing on the thought of abandoning it.
- SourceTree performs well. Sticking to Git. Pondering Git procedure.
- Found problem with packaged version of daemon in Windows build during git experimentation.. uploading fixed version
- Uploaded and links updated
- Decided on Git Procedure
- Dev-0.7 branch will be worked on, changes will be pull-merged into master, barerepo will contain a carbon copy of the "src' directory in master
- Noticed "README.md" missing in barerepo.. adding
- Modified README.md
- 11:32PM Signing off.
-
Today's Updates(check post date):
- Exhausted - Taking a break.
- I need my sleep too you know ;)
-
Today's Updates(check post date):
- Feeling a little sick- Taking a break.
- Plan on returning to Java client development tomorrow.
-
Today's Updates(check post date):
- Lunch
- Getting Ready..
- Looking over MerkleTree Class
- Changing getTreeWidth call parameters to BigInteger using exact conversion
- Calls changed
- Building Merkle Traverse tree
- Signing off can't focus.. Intend to continue Sunday, post Saturday Sabbath
- Sign off 5:15PM
-
Today's Updates(check post date):
- Got drafted for family work..
- Sorry
-
Today's Updates(check post date):
- Pondering difficulty changes with latest fork.
- Formulating an idea regarding decaying difficulty.
-
Today's Updates(check post date):
- Trying to address a current situation with GoldCoin's current mining pattern.
- Someone or some pool is dumping 1.5GH/s of Scrypt hashing power at most in-opportune times.
- Making a Java based difficulty simulator to address this problem once and for all.
- Simulator built.. Need to parameterize and run test scenarios
- 6:30 PM - Signing off
-
Today's Updates(check post date):
- Resting a bit, as I'm not feeling well
-
Today's Updates(check post date):
- Pondering/Consulting with DreamTeam regarding timewarp nuances
- I'm still not ready to resume the simulation
- No Sign on for code related work today
-
Today's Updates(check post date):
- Trying to re-cooperate a bit..
- Sorry no new updates today..
-
Today's Updates(check post date):
- Troubleshooting an issue a user reported on Mac OSX 10.10.3 Yosemite
- OSX 10.10 uses libdns_services instead, libdnsinfo.dylib does not appear to be included.. troubling for OSX users as it would require two builds to fix..
- Looking for workaround
- Possible to Symlink usr/lib/libdns_services.dylib to /usr/lib/system/libdnsinfo.dylib ?
- Requires testing.. need to get a Yosemite OSX copy running
- Duplicating VM prior to upgrade to Yosemite...
- Upgrading to Yosemite.. Eta 5 hours?
- Upgrading complete.. there appears to be some issues with the OS.. investigating
- Black background and app scroller at the bottom of the screen is gone? Rebooting..
- No change..attempting to set compatibility level in vmware player to a higher level
- Somewhat better.. Safari still won't start? Might be a VM issue.. looking for 10.10 retail img
- Retail image found.. Download will take another ~5 hours.. signing off 7:19 PM
-
Today's Updates(check post date):
- Continuing to troubleshoot issue reported on Mac OSX 10.10.3 Yosemite
- Image of OSX download complete.. Converting image to VMDK format..
- Complete.. attempting to import into VMware...
- Import successful.. downloading Mac client for GLD to test on VM
- Mac Client does not run as reported.. attempting to symlink
- Symlink unsuccessful.. Attempting to copy library from 10.8 instead..
- Getting another linking error.. this time from libc.. perhaps this has something to do with https://github.com/bitcoin/bitcoin/issues/3228?
- Nope.. uncertain what is causing __bzero symbol not found error..
- Seems Yosemite's API has too many differences with the previous OSX versions... delegating a 10.10 build to Stouse49
- Heading off to lunch
-
Today's Updates(check post date):
-
Today's Updates(check post date):
Same thing.. Sunday I'll probably be forced to do some construction in the yard. Expect to be back in full on Monday.
-
Today's Updates(check post date):
- Scratch that.. I'm having some strange cold sensation inside my chest that is making it very difficult for me to concentrate.
- Going to try to address this today, so I can be back tomorrow morning.
-
Today's Updates(check post date):
- Going to resume work today on the difficulty simulator..
- Trying to locate an issue in the difficulty simulator that is resulting in non-variable block times.
- Potential issue located where Math.random() is being truncated.. rectifying..
- Issue fixed, another problem found in MedianDiff setting..
- Issue fixed? some static remnants still at top.. trying to find cause..
- Seems to be a problem with pre-loading of constants.. investigating..
- Found a problem with backup of median difficulty value
- Problem traced to confusion with variable name.. "MedianDiff" variable taken to mean Difficulty at the median block when in fact was the Median Difference of Time stamps.
- Problem found with old diff value persisting for 120 blocks instead of 60 blocks..
- Signing Off - 9:05PM
-
Today's Updates(check post date):
- Trying to find what is causing the duplicate values for old difficulty..
- Code was incorrectly using previous block to estimate difficulty for current block when client is setup to estimate difficulty ON current block
- Code was also shifted in its timestamp calculations..correcting
- Fixed.. Another problem found with infinitely increasing diff..
- Was setting target as difficulty.. rectifying
- Need to figure out how to bitshift a decimal value later..
- Need to convert target to compact version
- Signing off 10:00pm
-
Today's Updates(check post date):
- Feeling a bit under the weather guys.. that strange cold feeling is rebounding..
- Will update you tomorrow.
-
Today's Updates(check post date):
- N/a guys still out of it.. will update you Sunday
-
Today's Updates(check post date):
- Need to extend the break a bit guys..
- Planning to have a solution for the difficulty problems by the end of tomorrow, and a release out to you by Wednesday.
-
Today's Updates(check post date):
- Resuming work on difficulty simulator..
- Difficulty Simulator fixed.. Performing last adjustments..
- Added custom distributed probability
- Getting ready with graphing functionality
- Signing off 10:50PM
-
Today's Updates(check post date):
- Setting up Graphing in preparation for finding optimal difficulty curve..
- That feeling when something comes together.. :D
http://i59.tinypic.com/10gimfc.png
- Configuring some more things before finding optimal difficulty curve..
- Still a few more adjustments necessary..
https://www.dropbox.com/s/0nix23u59kzwbvw/Screenshot%202015-06-10%2002.03.47.png?dl=0
-
Today's Updates(check post date):
- Finishing up simulator adjustments..
- Adjustments complete.. plan to do test cases tomorrow
https://www.dropbox.com/s/stgii0iopu1ycx6/Screenshot%202015-06-10%2022.54.35.png?dl=0
Gold/Orange line is where our difficulty should be in the simulation.. if it was ideal.. but green line shows our actual difficulty adjustments.
-
Today's Updates(check post date):
- That strange cold feeling..
Will update you tomorrow.
-
Today's Updates(check post date):
- Still feeling a bit out of it you guys.. Sorry this is not something I can just ram through without thinking
- ETA on an update is Monday.
-
Today's Updates(check post date):
- Adding Test Case Evaluator code
- Signing off 2:53 AM.
-
Today's Updates(check post date):
- 27 Degrees and Humid in Ottawa.. no AC :|
- Update you tomorrow.
-
Today's Updates(check post date):
- Sorry guys I'm still under the weather.. Will update you tommorow
-
Today's Updates(check post date):
- 65% Humidity Grr...
- Should be better tomorrow though..
- Check Ottawa weather here: http://www.theweathernetwork.com/last-24-hours/canada/ontario/ottawa , Humidity up to 88% in last 24 hours..
-
Today's Updates(check post date):
- Continuing Test case evaluation code..
- Continuing on Sunday.. Logging off 8:18 PM
-
Today's Updates(check post date):
- Finishing up test case code.
- Generated randoms have lower bound bias. Fixing..
- Fixed issue. Was a problem with random value being rounded up which was causing the most probable scenario, id=0 for the probability set not being chosen.
- Finding optimal adjustment values..
As you can see below the goal is a curve that can drop quickly but rises slowly.. (see the behavior of the blue line). The gold line is ideal and green is what we currently have. Our current difficulty algorithm is actually on the spot but this is only for case like this where hashpower rises steadily. I'll do some tests with some fringe cases (like the one our network is currently experiencing).
(http://i62.tinypic.com/5y6tcm.png)
- Signing off.. 8:18PM doing fringe test cases tomorrow/also need to check for timing attack parameters
-
Today's Updates(check post date):
Today I finish up the algorithmn.
- I noticed some value locking.. investigating prior to doing fringe test cases.
- Found and fixed value locking issue.
- Doing fringe test cases
- Finished 3/4 fringe test cases.. It's getting late and there seems to be some issue simulating our current situation.. continuing later..
- Signing off 3:28AM
-
Today's Updates(check post date):
- Finishing up last fringe test case..
- Something strange is going on with my editor.. the test cases are done.. but for some strange reason I'm getting strange result sets. Bugs that don't make any sense and then when I trace them and find them to be virtually impossible.. and I run the client again.. suddenly the set changes to something that makes even less sense.(Like I've broken the potential result set in reality or something) I tried restarting my editor too.. Maybe some memory corruption? I dunno, everything else is running fine and I tested this system to be prime95 stable overnight.. In any case will continue tomorrow
- Signing off 2:55AM
-
Today's Updates(check post date):
- Continuing tweaking of fringe cases.
- Some unforeseen bugs need fixing.. continue later..
- Signing off 12:54 AM
-
Today's Updates(check post date):
- Taking a break.. Will be back Sunday.
-
Today's Updates(check post date):
- Entertaining guests.. sorry for the delay.
-
Today's Updates(check post date):
- Taking a little break.
- No worries I'll be back tomorrow.
-
Today's Updates(check post date):
- Something arrived that demanded my attention for most the day (9+ hours of work :|)
- Fret not over the difficulty change,the algorithm is done and needs a few more adjustments before release.
-
Today's Updates(check post date):
- Finished algorithm.. Planning to implement tomorrow/Sunday.
- Test case results below:
In these tests you will see a golden line which shows the difficulty under IDEAL situations (little to no randomization) under the CURRENT difficulty algorithm. It does not represent where the difficulty should be at any given hash-power(so don't be confused into thinking it means that).
These tests are performed with an initial difficulty and hash rate(to better model the switch) which is why you may see a little discrepancy at the beginning of the charts. The old difficulty algorithm performed a difficulty change every 60 blocks.. the new one performs a difficulty change on block. Further investigation on possible consensus issues with this will be investigated(if I have time to spare).
The blue line is the NEW algorithm with probable block times and the green line is the CURRENT difficulty algorithm with probable block times.
(IE: try to compare Blue vs Green)
First on the list is our current predicament.
Here you can see the new algorithm resists the attack's attempt to increase the difficulty artificially whereas the old algorithm ramps the difficulty up.
(http://t2po.com/Fringe Cases/AttackScenario.png)
Next you may see the case where we have a fast linear drop. Here you can see that the difficulty does stutter a bit under the new algorithmn but remains BELOW what it would be with the current algorithm and then stabilizes with the hashpower.
(http://t2po.com/Fringe Cases/Fast Linear Drop.png)
Next you may see how the difficulty stabilizes well under a constant hashrate
(http://t2po.com/Fringe Cases/flatline.png)
Now you may see how the difficulty stays at the ideal level or below with a steady gain of hashrate.
The downward spikes are a very interesting property. These groups of <100 blocks of low difficulty can help ease network congestion and remove the current block size issue bitcoin is facing.
(http://t2po.com/Fringe Cases/Linear Gain.png)
Now you may see that with sinusoidal gain, even with vast difficulty changes, it manages to match the hash power curve as the old difficulty algorithm did.
(http://t2po.com/Fringe Cases/Sinusodial gain.png)
Now you may see that a slow linear drop handles much in the same way as a fast one. No strange deviations noted here imo.
(http://t2po.com/Fringe Cases/Slow Linear Drop.png)
Now you may see that in a step gain scenario, the new difficulty algorithm matches or beats the old one(on average) at any given hashpower for block solving time probability target time of 2 minutes.
(http://t2po.com/Fringe Cases/Step gain.png)
-
Today's Updates(check post date):
- Taking a breather, be back on Sunday.
-
Today's Updates(check post date):
- Doing some curve adjustments that are taking unusually long.
- I'll update you tomorrow.
-
Today's Updates(check post date):
- No updates today.. didn't get any sleep.
-
Today's Updates(check post date):
- So hot.. :|
- Update you tomorrow.
-
Today's Updates(check post date):
- Cooling off.. check in tomorrow.
-
Today's Updates(check post date):
- Cooling off.. check in tomorrow.
-
Today's Updates(check post date):
- A little sick.
- Plan to finish this up Sunday.. (last time hopefully).
-
Today's Updates(check post date):
- Tweaking..
- Done tweaking.. doing implementation tomorrow(last time I delay I hope, its VERY hot and humid here)..
- See the results of the optimization below and compare to the screens above..
(http://t2po.com/Fringe Cases/Tweaked/0.png)
(http://t2po.com/Fringe Cases/Tweaked/1.png)
(http://t2po.com/Fringe Cases/Tweaked/2.png)
(http://t2po.com/Fringe Cases/Tweaked/3.png)
(http://t2po.com/Fringe Cases/Tweaked/4.png)
(http://t2po.com/Fringe Cases/Tweaked/5.png)
Done for today.. signing off sometime later though in case people have questions..
-
Today's Updates(check post date):
- Checked a few last things before implementation.
- Tomorrow morning implementation begins for sure.
- Signing off 11:04PM
-
Today's Updates(check post date):
- Implementing..
- Signing off 10:06 PM
-
Today's Updates(check post date):
- Exhausted taking a break.
- Should be fully implemented by tomorrow night.. I'll have the builds ready on Friday.
-
Today's Updates(check post date):
- Implementing..
- Done implementing! Doing builds tomorrow.
- Signing off 9:56PM
-
Today's Updates(check post date):
- Preparing to do builds.. Testing/Screening for possible bugs.
- Test build successful. Looking over code one more time before doing final builds..
- Windows and Linux builds done, Repo updated.. but OSX build remains.. will continue on Sunday.
- Logging off 12:13AM
-
Today's Updates(check post date):
- Doing Mac OSX Build
- Problems found with OSX Dev environment.. Rectifying..
- Fixed issues.. build successful.. Uploading various files
- Signing off.. 2:08 AM have some strange computer troubles to fix..
-
Today's Updates(check post date):
- Sorry for the lack of updates the past two days.
- We have guests tonight. I'll update you on the new client tomorrow.
-
Today's Updates(check post date):
- Did rebuild/change of fork number
- Setting up full fledged block explorer here http://miningpool.net/explorer/gld
-
Today's Updates(check post date):
- Signed off yesterday around 11PM (forgot to update)
- Resuming work on block explorer
- Rudimentary API done here: http://miningpool.net/explorer/gld/api.php?
- Example usage: http://miningpool.net/explorer/gld/api.php?nethash=1&totalmint=1&difficulty=1&getheight=1
- Please note, not ready for production yet..
- Tired.. Signing off 9:31PM.. will update you on Sunday
-
Today's Updates(check post date):
(http://3.bp.blogspot.com/-vM2Sug4MD9w/UoGprjdud7I/AAAAAAABRPE/UkpJ5wT9yDA/s1600/Happy+Birthday+11.jpg)
-
Today's Updates(check post date):
- Staving off heat exhaustion..
-
Today's Updates(check post date):
- Confirmed with Stouse49 that the android client is getting the 7.2.0 update.
- Resuming work on new client...
- Signing off 10:03 PM
-
Today's Updates(check post date):
- Migrating to Windows 10
- Will update you after I'm done.
-
- Confirmed with Stouse49 that the android client is getting the 7.2.0 update.
I am working on the android app. I decided to start from scratch on the difficulty adjustment code since it is rather complicated and there is a bug with the previous fork.
-
Today's Updates(check post date):
- Migration complete
- Re-setup of dependencies being done.
- Work on new client to resume tomorrow
-
Today's Updates from Stouse49
- Translated and Debugged the Golden Wave in java for the android app
- Uploaded Android app to Google Play.
-
Today's Updates(check post date):
- Taking a breather, will update you tomorrow.
- Plan is to get the new client Alpha out on or before August 20th. (Don't quote me)
-
Today's Updates(check post date):
- Taking a breather, will update you tomorrow.
-
Today's Updates(check post date):
- One last rest before the coding marathon.
-
Today's Updates(check post date):
- Coding Marathon begins..
- Continuing Merkle Tree Class implementation
- Checking helper functions..
- Signing off 9:01 PM
-
Today's Updates(check post date):
- Block Explorer vamping to happen on Sunday.
- Coding Marathon continues on Monday.
-
Today's Updates(check post date):
- Re-Vamping block explorer.
- Re-Vamp complete, check it out: http://miningpool.net/explorer/gld/index.php
- Signing off 10:26 PM
-
Today's Updates(check post date):
- Lightning took out power.
- Been busy configuring/troubleshooting windows. Will continue programming tommorow.
-
Today's Updates(check post date):
- Too tired. Will get to it tommorow I'm sure.
-
Today's Updates(check post date):
- Getting preped.
- Continuing work on helper functions..
- MerkleTree helper functions checked..
- Continuing checks of BloomFilter class..
- Continuing tommorow.
- Signing off 8:10 PM
-
(http://i62.tinypic.com/f5bldw.png)
I need AC.
Update on Sunday.
-
Today's Updates(check post date):
- Continuing checks of BloomFilter class..
- Putting together natural Logarithm function for BigDecimal
- Found better open source alternative.. switching to save time
- Skype call with DreamTeam/Workers
- Finished for the night
-
Today's Updates(check post date):
- Took care of some IRL stuff.
- Coding continues tomorrow.
-
Today's Updates(check post date):
- Heat Warning in effect.. AC isn't working well enough.. waiting for later in the day to continue coding.
- Still hot.. shoot.. Even with the AC I didn't get below 25 C...
- One more day I guess (sorry for the delay.. I truly am)
-
Today's Updates(check post date):
- Continuing work on BloomFilter class..
- Continuing tomorrow.. looks like I wont meet the August 20th goal. Sorry folks.
-
Today's Updates(check post date):
- Taking care of some personal work
- Will update you tomorrow
-
Today's Updates(check post date):
- Still taking care of some personal work.
- I'll get back to the client soon, hopefully.
-
Today's Updates(check post date):
- Sorry for the lack of updates, I have to take a few more days off to do some IRL stuff
- I'll get back to the client in a few days at most is my estimate.
-
Today's Updates(check post date):
- Sorry for the delay..
- I have some serious IRL business to take care of. I will be back to code on Monday September 14th, 2015
-
Today's Updates(check post date):
- And I'm back.. sorry for the delay.
- Coding starts again tomorrow.
- Edit(had one more thing to take care of), coding starts on Wednesday..
-
Today's Updates(check post date):
- Had some phone issues and internet issues today..
- Will get back to work tomorrow. Sorry for the additional delay, this will be the last time I hope.
-
Today's Updates(check post date):
- Troubleshooting a BSOD issue with Windows 10.. See here: http://answers.microsoft.com/en-us/windows/forum/windows_10-hardware/daily-bsod-kernel-security-check-failure/719439d6-493c-42b7-bb27-2ed1d0b0ebb8 (http://answers.microsoft.com/en-us/windows/forum/windows_10-hardware/daily-bsod-kernel-security-check-failure/719439d6-493c-42b7-bb27-2ed1d0b0ebb8)
- Waiting for it to be resolved before continuing as I don't want to lose my work randomly.
-
Today's Updates(check post date):
- BSOD issue resolved.
- System functioning within normal parameters.
- Returning to code soon. Taking care of some IRL stuff and I'll be back.
-
Today's Updates(check post date):
- Bit of a cold today.. But I am planning to resume work on the client tomorrow evening.
-
Today's Updates(check post date):
- Sorry for the large delay. I've been busy doing consulting work/looking for investors.
- Plan to resume on Monday November 23, 2015
-
Today's Updates(check post date):
I realize I haven't given you guys much to go on. So here is an explanation of my current situation.
I'm in financial trouble IRL(not life ending but something serious enough to take up my time), I've been mainly doing contract work, but that work has taken up for more of my time than I had planned.
I will pop-in here and there to help with things and attend meetings.
Being able to predict my hours is important because the new client is too complex to code piecemeal.
Thanks for your understanding,
Regards,
Amir aka Akumaburn
-
Today's Updates(check post date):
- Finishing up test case code.
- Generated randoms have lower bound bias. Fixing..
- Fixed issue. Was a problem with random value being rounded up which was causing the most probable scenario, id=0 for the probability set not being chosen.
- Finding optimal adjustment values..
As you can see below the goal is a curve that can drop quickly but rises slowly.. (see the behavior of the blue line). The gold line is ideal and green is what we currently have. Our current difficulty algorithm is actually on the spot but this is only for case like this where hashpower rises steadily. I'll do some tests with some fringe cases (like the one our network is currently experiencing).
(http://i62.tinypic.com/5y6tcm.png)
- Signing off.. 8:18PM doing fringe test cases tomorrow/also need to check for timing attack parameters
In your simulation, what was the average block time after the GoldenRiver code stabilized?