Lessons Learned from Curation Rewards Discussion by dantheman

View this thread on steempeak.com
· @dantheman · (edited)
$454.02
Lessons Learned from Curation Rewards Discussion
I would like to thank everyone who has participated in the curation rewards discussion!  Many of you have provided incredibly useful insights. I would like to take an opportunity to summarize those insights for everyone who doesn't have time to read through the entire discussion as well as add new thoughts of my own.

## 1. Curation Rewards Attract Users

One thing is abundantly clear, curation rewards have had a major impact in attracting users to Steem. Removing curation rewards all together would have a negative impact on a meaningful part of our community. These rewards are one thing that sets Steem apart from the competition.

## 2. People and Bots will Play the Game

With the advent of advanced AI algorithms it is clear that computer models can provide high quality estimates of the value of a post and do so faster than any human could. This means that bots will always have an advantage in this game and they cannot be prevented. 

Assuming we have the right incentives, the participation of bots is a good thing. It rewards those who invest time and money improving how new content is discovered.  If we don't have the right incentives, then the same power will be applied to destroy us.  In other words, blockchain incentives are a powerful weapon that needs to be pointed in the right direction to avoid shooting ourselves in the foot.

## 3. Curation Rewards Discourage Voting 

People have repeatedly expressed that they withhold from voting to "save their power" for future use. What this implies is that "good content" is being ignored because people are saving for "great content".  This implies that there is less total information (links between users and content).  In some ways this is good, it means the votes that are cast have a higher quality.

## 4. Curation Rewards Impact Culture 

When people are paid to curate they start to adapt strategies. Votes are cast for personal gain rather than for the benefit of  the person they are voting for. This makes voting a selfish act rather than a generous act. The spirit of the site changes from one of rewarding content to one of "playing the game". 

## 5. Rewarding the Little Guy 

Someone with little Steem Power is just as *human* as someone with a lot of Steem Power. Their opinion carries a certain amount of weight simply because they are a person. Under Steem everything is weighted by Steem Power to prevent Sybil attacks.  This means that people with just $3 of free Steem Power are currently unable to earn curation rewards because their weight is so small compared to larger players. 

Any attempt to give advantage to smaller accounts will result in large users dividing their balance into many accounts. This in and of itself is not a reason to stop looking for more democratic solutions.

## 6. Designing a Better System

Some quality suggestions have been made on how to defeat the auto-upvote bots that have come out. One of the best ideas is discounting curation rewards for authors that have a history of earning high payouts. This means that the reward someone would receive for upvoting my posts will be less than the reward you would receive for upvoting a new user's post that is of equal quality.

The generalization of this algorithm is to implement our own on-chain AI for predicting the value of a post on a scale between 0 and 1.  A high prediction will mean low curation rewards, a low prediction will mean high curation rewards. Looking at an author's history is just a simplistic form of such an AI.  A more advanced form would consider the existing voters, the time of day, the tags, links, images, and even the content.

The goal of the curation rewards would be to discover *unexpected results*.  Those who upvote things that our algorithm wouldn't expect to get upvoted should be rewarded.  It is the unexpected results that add the most value and are the hardest to automate. 

## 7. An Arms Race 

Any algorithm we implement to estimate votes can be improved upon. The curation rewards are kind of like the [Netflix Prize](http://www.netflixprize.com/) for blogging.  Those who can write bots that are more effective than our own on-blockchain prediction will make money.  The blockchain will have to constantly evolve its algorithms to incorporate the best known 'bot algorithms' and reduce the rewards for those who use them.  Through iterative releases of the post-prediction algorithms the quality and speed of the curation on Steem will advance. User's who identify quality posts that are not recognized by Steem's algorithms or the bots will earn the most. Those who follow predictable patterns will earn the least.

## 8. Constant Tweaking may be Necessary

What I have concluded from this is that we must be prepared to tweak the curation rewards algorithm in response to advances in automated curation. Through this tweaking we can continuously re-bias the curation rewards toward human curators.  We should welcome bots that figure out how to game the system, they only make us stronger.  Perhaps there is an algorithm that can automatically "learn" and "adapt" to advancements in upvote bots.

## Proposed Solution

In an [earlier post I suggested rewarding those who who accurately predict the final payout](/steem/@steemitblog/curation-by-prediction-market-proposal). This kind of prediction market is harder for most people to use, but ultimately the hardest to abuse. I believe that if bot's were the ones to play the prediction market game, then the outcome of the prediction market could impact the weight of the existing curation rewards.  

If the prediction market were to estimate a post to earn $1000, then the voting rewards would be small for that post. If the prediction market predicts $1.00 then voting rewards could be much higher.  This creates a tension between making high predictions and rewarding the votes that make the prediction come true.  The higher the prediction, the less financial incentive there is for voters to vote and therefore, the less likely for it to become a self fulfilling prophesy.  The opposite would also be true: a low prediction would financially incentivise voters to prove it wrong.

The majority of the rewards should be allocated toward accurate predictions in order to advance research into bots that curate content. A token amount should be rewarded to those who vote.  To maximize the perceived value of voting, the rewards may have to be in the form of raffle tickets. Most voters get nothing, but all voters get a chance to win $1000! 

I believe with the right incentives we can motivate the community to produce the best curated content on the internet.
👍  , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , and 19 others
👎  ,
properties (23)
post_id15,641
authordantheman
permlinklessons-learned-from-curation-rewards-discussion
categorysteem
json_metadata"{"links": ["http://www.netflixprize.com/", "/steem/@steemitblog/curation-by-prediction-market-proposal"], "tags": ["steem", "curation"]}"
created2016-06-02 14:46:12
last_update2016-06-02 16:28:45
depth0
children19
net_rshares73,416,696,382,884
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value227.012 SBD
curator_payout_value227.006 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length6,641
author_reputation240,497,801,758,545
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (85)
@tuck-fheman ·
> 6. Designing a Better System

![](http://s20.postimg.org/3tp07aknx/steem_ripple50x50.gif)

> A token amount should be rewarded to those who vote. To maximize the perceived value of voting, the rewards may have to be in the form of raffle tickets. Most voters get nothing, but all voters get a chance to win $1000!

![](http://s20.postimg.org/3tp07aknx/steem_ripple50x50.gif)

Excellent idea! :)

https://steemit.com/games/@tuck-fheman/upvote-this-post-and-earn-an-equal-amount-of-the-rewards-from-this-post
👍  
properties (23)
post_id15,655
authortuck-fheman
permlinkre-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t150802763z
categorysteem
json_metadata"{"image": ["http://s20.postimg.org/3tp07aknx/steem_ripple50x50.gif"], "tags": ["steem"]}"
created2016-06-02 15:08:06
last_update2016-06-02 15:08:06
depth1
children7
net_rshares5,795,039,466
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length508
author_reputation326,086,885,911,893
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (1)
@streemian ·
This bot detected images from a legacy source and decided autonomously
to upload them to the InterPlanetary FileSystem (IPFS)! The upload was
successfull and the pictures can be found here:

```
orig: http://s20.postimg.org/3tp07aknx/steem_ripple50x50.gif
desc: 
hash: QmY8KBqKUfik8hsDRoWsYf9wevs3HcAPRY4SfSDFgBNxLL/steem_ripple50x50.gif
```

```
orig: http://s20.postimg.org/3tp07aknx/steem_ripple50x50.gif
desc: 
hash: QmPdKa6CkBQ9BEQSxHWU1yCcSVGrYdZAVyoP18rxtKdChb/steem_ripple50x50.gif
```
👎  
properties (23)
post_id15,656
authorstreemian
permlinkre-re-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t150802763z-20160602t150813
categorysteem
json_metadata{}
created2016-06-02 15:08:12
last_update2016-06-02 15:08:12
depth2
children4
net_rshares-464,770,269
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length495
author_reputation6,830,373,373,021
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (1)
@tuck-fheman ·
You think you've won streemian bot, but what you don't know is that I'm intentionally making you spam this place until everyone else get's annoyed with you too and the owner removes your posting ability or makes you post in your own damn topic! =b
properties (22)
post_id15,668
authortuck-fheman
permlinkre-streemian-re-re-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t150813-20160602t152350389z
categorysteem
json_metadata"{"tags": ["steem"]}"
created2016-06-02 15:23:54
last_update2016-06-02 15:23:54
depth3
children1
net_rshares0
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length247
author_reputation326,086,885,911,893
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
@dantheman ·
Your bot needs to de-duplicate.
👍  
properties (23)
post_id15,674
authordantheman
permlinkre-streemian-re-re-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t150813-20160602t153409123z
categorysteem
json_metadata"{"tags": ["steem"]}"
created2016-06-02 15:34:09
last_update2016-06-02 15:34:09
depth3
children1
net_rshares11,334,315,650
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length31
author_reputation240,497,801,758,545
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (1)
@ned ·
$1.49
>but all voters get a chance to win $1000!

Even with the randomness involved, I believe the payout would still need stake weighted .. otherwise .. sybil attack from bots that predict the payout.
👍  
properties (23)
post_id15,680
authorned
permlinkre-tuck-fheman-re-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t154408181z
categorysteem
json_metadata"{"tags": ["steem"]}"
created2016-06-02 15:44:06
last_update2016-06-02 15:44:06
depth2
children1
net_rshares2,764,472,587,734
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.746 SBD
curator_payout_value0.746 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length195
author_reputation94,526,930,487,415
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (1)
@arhag ·
Yes, I agree. But no need to make it superlinear, please!
properties (22)
post_id15,683
authorarhag
permlinkre-ned-re-tuck-fheman-re-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t155138291z
categorysteem
json_metadata"{"tags": ["steem"]}"
created2016-06-02 15:51:36
last_update2016-06-02 15:51:36
depth3
children0
net_rshares0
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length57
author_reputation52,480,746,024,977
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
@pal ·
I was thinking about different bot strategies and how they could impact steem.  There could be such variety of successful algorithms that will be hard to make blockchain AI to adapt quickly to all of them.

Here my example:
https://steemit.com/steem/@pal/sniper-whale-vote-bot-strategy
👍  ,
properties (23)
post_id15,681
authorpal
permlinkre-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t154505475z
categorysteem
json_metadata"{"tags": ["steem"]}"
created2016-06-02 15:45:06
last_update2016-06-02 15:45:06
depth1
children0
net_rshares235,566,594,087
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length285
author_reputation12,208,622,540,590
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (2)
@abit ·
The proposed solution in this article is not clear. The link of detailed proposal is https://steemit.com/steem/@steemitblog/curation-by-prediction-market-proposal
👍  , ,
properties (23)
post_id15,687
authorabit
permlinkre-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t160856942z
categorysteem
json_metadata"{"tags": ["steem"]}"
created2016-06-02 16:08:54
last_update2016-06-02 16:08:54
depth1
children1
net_rshares58,876,081,446
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length162
author_reputation111,629,191,115,088
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (3)
@abit ·
$34.96
Better if the link is included in OP. Not too easy to find it because it's posted by another account.
👍  ,
properties (23)
post_id15,689
authorabit
permlinkre-abit-re-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t161050358z
categorysteem
json_metadata"{"tags": ["steem"]}"
created2016-06-02 16:10:48
last_update2016-06-02 16:10:48
depth2
children0
net_rshares19,016,652,422,100
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value17.482 SBD
curator_payout_value17.481 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length101
author_reputation111,629,191,115,088
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (2)
@cyrano.witness ·
> With the advent of advanced AI algorithms it is clear that computer models can provide high quality estimates of the value of a post and do so faster than any human could. 
> Assuming we have the right incentives, the participation of bots is a good thing. 

The problem with AI bots is that you don't know what they'll learn. Remember the Microsoft chatbot that turned into a Nazi within a couple of days?
Voting bots would learn to vote for posts with high rewards, which could mean posts for which many bots vote - not necessarily posts with good content.
👍  
properties (23)
post_id15,778
authorcyrano.witness
permlinkre-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t184137213z
categorysteem
json_metadata"{"tags": ["steem"]}"
created2016-06-02 18:41:36
last_update2016-06-02 18:41:36
depth1
children3
net_rshares12,229,130,044
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length560
author_reputation4,478,278,630,502
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (1)
@dantheman ·
This is exactly the challenge we face. When we reward voting with a share in the result, voters will start predicting voters in a circular prediction. With enough "predictable agents" in the system the outcome is everyone votes on one thing.
👍  
properties (23)
post_id15,788
authordantheman
permlinkre-cyranowitness-re-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t185451584z
categorysteem
json_metadata"{"tags": ["steem"]}"
created2016-06-02 18:54:51
last_update2016-06-02 18:54:51
depth2
children0
net_rshares11,632,587,115
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length241
author_reputation240,497,801,758,545
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (1)
@liondani ·
NSFW content for example
properties (22)
post_id15,806
authorliondani
permlinkre-cyranowitness-re-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t193544288z
categorysteem
json_metadata"{"tags": ["steem"]}"
created2016-06-02 19:35:45
last_update2016-06-02 19:35:45
depth2
children0
net_rshares0
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length24
author_reputation91,903,771,336,326
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
@cryptogee ·
Ha, I just Googled 
[Microsoft Nazi AI](http://www.telegraph.co.uk/technology/2016/03/24/microsofts-teen-girl-ai-turns-into-a-hitler-loving-sex-robot-wit/); pure class :)
properties (22)
post_id15,849
authorcryptogee
permlinkre-cyranowitness-re-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t222158538z
categorysteem
json_metadata"{"links": ["http://www.telegraph.co.uk/technology/2016/03/24/microsofts-teen-girl-ai-turns-into-a-hitler-loving-sex-robot-wit/"], "tags": ["steem"]}"
created2016-06-02 22:22:12
last_update2016-06-02 22:22:12
depth2
children0
net_rshares0
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length170
author_reputation371,535,229,097,172
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
@steemship ·
Good recap of the discussion and food for thought. I especially like the honesty of concluding that the voting algos will need constant revision and refinement. So true.
👍  
properties (23)
post_id15,830
authorsteemship
permlinkre-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t212117886z
categorysteem
json_metadata"{"tags": ["steem"]}"
created2016-06-02 21:21:18
last_update2016-06-02 21:21:18
depth1
children1
net_rshares12,229,130,044
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length169
author_reputation70,073,781,649,061
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (1)
@liondani ·
>  everything flows and nothing stands still, everything gives way and nothing stands still 

(Heraclitus via Plato, "Cratylus" 402a)
properties (22)
post_id15,840
authorliondani
permlinkre-steemship-re-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t215738068z
categorysteem
json_metadata"{"tags": ["steem"]}"
created2016-06-02 21:57:36
last_update2016-06-02 21:57:36
depth2
children0
net_rshares0
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length133
author_reputation91,903,771,336,326
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
@treeleaves ·
Some amazing ideas.
properties (22)
post_id18,893
authortreeleaves
permlinkre-dantheman-lessons-learned-from-curation-rewards-discussion-20160608t171133287z
categorysteem
json_metadata"{"tags": ["steem"]}"
created2016-06-08 17:11:33
last_update2016-06-08 17:11:33
depth1
children0
net_rshares0
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length19
author_reputation3,841,001,214,129
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
@smooth ·
I downvoted the post not because I disagree with the post or think it is not a quality post but because I do not think that the interests of Steem are served by every platform or devteam update or request for community feedback pulling thousands of dollars from the reward pools that go to ordinary users. The reward consensus algorithm also disproportionately rewards these posts since they are the only thing that 100% of Steem users have in common (aside from being human, etc.).
properties (22)
post_id24,958
authorsmooth
permlinkre-dantheman-lessons-learned-from-curation-rewards-discussion-20160617t031147400z
categorysteem
json_metadata"{"tags": ["steem"]}"
created2016-06-17 03:11:48
last_update2016-06-17 03:11:48
depth1
children0
net_rshares0
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length482
author_reputation119,002,354,889,508
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000