RE: Fake STEEM, SBD, witness, market, condencer and so on: Let's test steem for real from now on! by timcliff

View this thread on steempeak.com

Viewing a response to: @develcuy/fake-steem-sbd-witness-market-condencer-and-so-on-let-s-test-steem-for-real-from-now-on

· @timcliff · (edited)
$0.07
What you describe as far as the testnet was pretty much what was done for hardfork 20. We had a working testnet that was a clone of the mainnet, did not have the full historical set of data (to keep the block_log size low), and was even getting a copy of the new mainnet transactions mirrored over in real time. There was also a testnet condenser: https://condensertestnet.steemitdev.com.
πŸ‘  , ,
properties (23)
post_id63,673,191
authortimcliff
permlinkre-develcuy-fake-steem-sbd-witness-market-condencer-and-so-on-let-s-test-steem-for-real-from-now-on-20181005t014139756z
categorysteemit
json_metadata{"tags":["steemit"],"app":"steemit\/0.1","links":["https:\/\/condensertestnet.steemitdev.com"]}
created2018-10-05 01:41:48
last_update2018-10-05 01:42:03
depth1
children15
net_rshares39,817,147,206
last_payout2018-10-12 01:41:48
cashout_time1969-12-31 23:59:59
total_payout_value0.050 SBD
curator_payout_value0.015 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length388
author_reputation262,354,724,187,317
root_title"Fake STEEM, SBD, witness, market, condencer and so on: Let's test steem for real from now on!"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (3)
@bobinson ·
$0.06
> and was even getting a copy of the new mainnet transactions mirrored over in real time.

How was this done ? Is there any code or documentation available ?
πŸ‘  
properties (23)
post_id63,682,953
authorbobinson
permlinkre-timcliff-re-develcuy-fake-steem-sbd-witness-market-condencer-and-so-on-let-s-test-steem-for-real-from-now-on-20181005t055251884z
categorysteemit
json_metadata{"tags":["steemit"],"app":"steemit\/0.1"}
created2018-10-05 05:52:15
last_update2018-10-05 05:52:15
depth2
children12
net_rshares39,123,136,916
last_payout2018-10-12 05:52:15
cashout_time1969-12-31 23:59:59
total_payout_value0.048 SBD
curator_payout_value0.016 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length157
author_reputation18,620,871,366,628
root_title"Fake STEEM, SBD, witness, market, condencer and so on: Let's test steem for real from now on!"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (1)
@timcliff ·
I don’t know much about it other than what is here: https://github.com/steemit/tinman

@inertia may be able to explain more.
πŸ‘  
properties (23)
post_id63,684,833
authortimcliff
permlinkre-bobinson-re-timcliff-re-develcuy-fake-steem-sbd-witness-market-condencer-and-so-on-let-s-test-steem-for-real-from-now-on-20181005t064023636z
categorysteemit
json_metadata{"tags":["steemit"],"links":["https:\/\/github.com\/steemit\/tinman"],"app":"steemit\/0.1","users":["inertia"]}
created2018-10-05 06:40:24
last_update2018-10-05 06:40:24
depth3
children4
net_rshares11,411,148,593
last_payout2018-10-12 06:40:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length124
author_reputation262,354,724,187,317
root_title"Fake STEEM, SBD, witness, market, condencer and so on: Let's test steem for real from now on!"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (1)
@bobinson ·
$0.06
Thank you @timcliff Do you think the witnesses can help to increase the number of users and test cases + code coverage on the official TESTNET ?
πŸ‘  
properties (23)
post_id63,686,713
authorbobinson
permlinkre-timcliff-re-bobinson-re-timcliff-re-develcuy-fake-steem-sbd-witness-market-condencer-and-so-on-let-s-test-steem-for-real-from-now-on-20181005t073031515z
categorysteemit
json_metadata{"users":["timcliff"],"tags":["steemit"],"app":"steemit\/0.1"}
created2018-10-05 07:30:33
last_update2018-10-05 07:30:33
depth4
children3
net_rshares36,381,598,306
last_payout2018-10-12 07:30:33
cashout_time1969-12-31 23:59:59
total_payout_value0.046 SBD
curator_payout_value0.014 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length144
author_reputation18,620,871,366,628
root_title"Fake STEEM, SBD, witness, market, condencer and so on: Let's test steem for real from now on!"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (1)
@inertia ·
$1.16
The official Steemit, Inc. testnet was originally announced here: 

https://steemit.com/hardfork20/@steemitdev/hardfork-20-testnet-details

It bootstrapped and activated HF20 the same day.

> I'm not against it but some people stated (some top20 witnesses included) that it is almost impossible to fully test a hardfork upfront, and I want to say contrary, it is perfectly possible and we can start right away.

There were specific things that we were looking for with the original testnet deploy.  We wanted to know how it transitioned from HF19 to HF20, and that looked good.  We wanted to know how transactions from mainnet copied over to testnet would fair, and that looked good too:

https://github.com/steemit/tinman#gatling-transactions-from-mainnet

One of the things we could have probably tested in the month prior to HF20 was to delay transition between the bootstrap of the testnet on HF19 to HF20.  Maybe a 5 or 7 day HF20 activation delay would have revealed a hint about the difficulty in the new features, but we didn't test that scenario.

So, there was possibly a lack of imagination.  But at least we have that knowledge moving forward.

> Let's prefix everything "fake-", so that we have: Fake-STEEM(fsteem), Fake-SBD(fsbd), Fake-witness(fwitness), Fake-market(fmarket), fake-steem.com, fake-steemconnect.com, fake-you-name-it. If we make everything functional, we can have a working simulation, where we can freely experiment without the worries.

That's pretty much what we do by using a `chain-id` (without the prefix, just using different asset symbols instead).  We use a unique `chain-id` for the testnet so that transactions cannot be mixed up between blockchains.  Have a look:

https://condensertestnet.steemitdev.com/
πŸ‘  , ,
properties (23)
post_id63,685,202
authorinertia
permlinkre-bobinson-re-timcliff-re-develcuy-fake-steem-sbd-witness-market-condencer-and-so-on-let-s-test-steem-for-real-from-now-on-20181005t065006401z
categorysteemit
json_metadata{"tags":["steemit"],"links":["https:\/\/steemit.com\/hardfork20\/@steemitdev\/hardfork-20-testnet-details","https:\/\/github.com\/steemit\/tinman#gatling-transactions-from-mainnet","https:\/\/condensertestnet.steemitdev.com\/"],"app":"steemit\/0.1"}
created2018-10-05 06:50:06
last_update2018-10-05 06:50:06
depth3
children6
net_rshares684,054,087,738
last_payout2018-10-12 06:50:06
cashout_time1969-12-31 23:59:59
total_payout_value0.870 SBD
curator_payout_value0.288 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length1,747
author_reputation227,335,189,892,062
root_title"Fake STEEM, SBD, witness, market, condencer and so on: Let's test steem for real from now on!"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (3)
@bobinson ·
Thank you @inertia and @timcliff

@inertia : Tinman  has under gone lots of changes from the last time we were using it! We had reported an issue in May ( https://github.com/steemit/tinman/issues/59 ) 

Syncing the transactions is a wonderful feature you guys have added. I will revert with comments/doubts after going through the all "wizarded-up Tinman! "
properties (22)
post_id63,686,514
authorbobinson
permlinkre-inertia-re-bobinson-re-timcliff-re-develcuy-fake-steem-sbd-witness-market-condencer-and-so-on-let-s-test-steem-for-real-from-now-on-20181005t072516585z
categorysteemit
json_metadata{"users":["inertia","timcliff"],"links":["https:\/\/github.com\/steemit\/tinman\/issues\/59"],"tags":["steemit"],"app":"steemit\/0.1"}
created2018-10-05 07:25:18
last_update2018-10-05 07:25:18
depth4
children0
net_rshares0
last_payout2018-10-12 07:25:18
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length357
author_reputation18,620,871,366,628
root_title"Fake STEEM, SBD, witness, market, condencer and so on: Let's test steem for real from now on!"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
@develcuy ·
$0.14
Indeed @inertia, the concept of testnet is very similar but it still needed some adjustments IMHO. More than the technical aspects, my proposal is about how to involve all the steem community on the testing process. That is even why I use an easy word for the non-tech savvy: "fake". Also, we should actively invite people to participate in testing, don't let it pass unseen, it should be a testing party or festival actually (easy words again). Otherwise, it makes no sense to open source the project, let's make it easy for regular people to contribute something! Testing is a great opportunity.
πŸ‘  
properties (23)
post_id63,687,077
authordevelcuy
permlinkre-inertia-re-bobinson-re-timcliff-re-develcuy-fake-steem-sbd-witness-market-condencer-and-so-on-let-s-test-steem-for-real-from-now-on-20181005t073959191z
categorysteemit
json_metadata{"users":["inertia"],"tags":["steemit"],"app":"steemit\/0.1"}
created2018-10-05 07:40:06
last_update2018-10-05 07:40:06
depth4
children1
net_rshares80,497,216,148
last_payout2018-10-12 07:40:06
cashout_time1969-12-31 23:59:59
total_payout_value0.102 SBD
curator_payout_value0.033 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length597
author_reputation4,847,921,239,423
root_title"Fake STEEM, SBD, witness, market, condencer and so on: Let's test steem for real from now on!"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars0
author_curate_reward""
vote details (1)
@yuriks2000 ·
Thanks @inertia, this will help us a lot. Working on creating public environment for testing hard forks with @bobinson and on ways to motivate steemians to help with testing.
πŸ‘  
properties (23)
post_id63,692,721
authoryuriks2000
permlinkre-inertia-re-bobinson-re-timcliff-re-develcuy-fake-steem-sbd-witness-market-condencer-and-so-on-let-s-test-steem-for-real-from-now-on-20181005t100814491z
categorysteemit
json_metadata{"app":"steemit\/0.1","users":["inertia","bobinson"],"tags":["steemit"]}
created2018-10-05 10:08:06
last_update2018-10-05 10:08:06
depth4
children0
net_rshares10,724,918,821
last_payout2018-10-12 10:08:06
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length174
author_reputation46,297,288,412,649
root_title"Fake STEEM, SBD, witness, market, condencer and so on: Let's test steem for real from now on!"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (1)
@bobinson · (edited)
@intertia we have few doubts and giving them below. I hope this will help to do a RCA.

cc: @timcliff @ura-soul @yuriks2000 @yehey @develcuy

## Questions

- Date on which TESTNET was live ? ( 2018-08-25 as per the @steemitdev [post](https://steemit.com/hardfork20/@steemitdev/hardfork-20-testnet-details))
- what is the version of the offiical TESTNET ?
- How many transactions are happening in the MAINNET per week ? (7 x 86400 seconds)
- How many transactions happened in the official TESTNET ?
- What was the highest TPS on the ofifcial TESTNET ?
- Can we create scenarios like upvote which will test the official testnet ?
- Do we have a list of scenarios and transactions that cannot be effectively tested on the TESTNET ?
-  so can we identify the difficult areas like RC and test them ?

- Which are the difficult scenarios  that was not tested by the automated test environment ?
properties (22)
post_id63,745,483
authorbobinson
permlinkre-inertia-re-bobinson-re-timcliff-re-develcuy-fake-steem-sbd-witness-market-condencer-and-so-on-let-s-test-steem-for-real-from-now-on-20181006t083415369z
categorysteemit
json_metadata{"tags":["steemit"],"app":"steemit\/0.1","links":["https:\/\/steemit.com\/hardfork20\/@steemitdev\/hardfork-20-testnet-details"],"users":["intertia","timcliff","ura-soul","yuriks2000","yehey","develcuy","steemitdev"]}
created2018-10-06 08:34:18
last_update2018-10-06 08:36:00
depth4
children1
net_rshares0
last_payout2018-10-13 08:34:18
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length888
author_reputation18,620,871,366,628
root_title"Fake STEEM, SBD, witness, market, condencer and so on: Let's test steem for real from now on!"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
@develcuy ·
$0.12
Yes @timcliff, you are right, so I should elaborate my proposal a bit more. To be more specific, I'm against straight dumping content from mainnet into the testnet, that is why I suggested AI and I should add statistical analysis as well, which should mimic human behavior with an smaller database of content  "recycled" (statistically down-scaled) from the mainnet. In means that we should end up with a lightweight fake steem blockchain that can still provide meaningful feedback. I know that it might sound very complicated, but let the big data experts debunk this alternative. I still prefer to let the community play with fake steem freely, AI can come later.
πŸ‘  ,
properties (23)
post_id63,686,381
authordevelcuy
permlinkre-timcliff-re-develcuy-fake-steem-sbd-witness-market-condencer-and-so-on-let-s-test-steem-for-real-from-now-on-20181005t072131258z
categorysteemit
json_metadata{"users":["timcliff"],"tags":["steemit"],"app":"steemit\/0.1"}
created2018-10-05 07:21:36
last_update2018-10-05 07:21:36
depth2
children1
net_rshares70,667,883,240
last_payout2018-10-12 07:21:36
cashout_time1969-12-31 23:59:59
total_payout_value0.089 SBD
curator_payout_value0.028 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length665
author_reputation4,847,921,239,423
root_title"Fake STEEM, SBD, witness, market, condencer and so on: Let's test steem for real from now on!"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars0
author_curate_reward""
vote details (2)
@timcliff ·
I get what you are going for, but I still don’t think it would generate the conditions we need to simulate a β€œreal” test.

The community had access to test hardfork 20.
properties (22)
post_id63,698,553
authortimcliff
permlinkre-develcuy-re-timcliff-re-develcuy-fake-steem-sbd-witness-market-condencer-and-so-on-let-s-test-steem-for-real-from-now-on-20181005t123134052z
categorysteemit
json_metadata{"app":"steemit\/0.1","tags":["steemit"]}
created2018-10-05 12:31:33
last_update2018-10-05 12:31:33
depth3
children0
net_rshares0
last_payout2018-10-12 12:31:33
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length168
author_reputation262,354,724,187,317
root_title"Fake STEEM, SBD, witness, market, condencer and so on: Let's test steem for real from now on!"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000