RE: Q-Filter: A Supplementary Content Discovery Network And Rewards System [STEEMPAPER] by lextenebris

View this thread on steempeak.com

Viewing a response to: @greer184/q-filter-a-supplementary-content-discovery-network-and-rewards-system-steempaper

· @lextenebris ·
$0.14
This is definitely interesting content and I've done my own writing over the last several months regarding discovery methods, ways and means, to turn up content which is more useful to a given user.

My problem with your system isn't mechanical, though – it's philosophical and algorithmic.

I approach these problems from the perspective of someone who has been involved in game design, one way or another, for most of his life. Game theory in both the mathematical sense and in the game design sense is what I'm all about. It's that last which creates a problem here.

You describe what you accurately name as a human-driven neural network algorithm which has one purpose: to create an overall metric for "quality" of a post to the steem blockchain. Individual choices go into creating a consensus response.

The problem is that you create one metric. One number. One output. There is one measure of quality. In the system is not geared to discover "quality" in content but rather designed specifically to act as a predictor of what the algorithm will give the highest rating to. As a result, individual actors within the ecosystem aren't actually engaged in a way which is intended to maximize the value they get out of content but instead is intended to attempt to sway the prediction of the Q-system and maximize the profits therefrom.

This is not a system which is going to return the "best quality content" from the blockchain because, in a real sense, it's orthogonal to the issue of content. It shares with the original steem voting system a vast indifference to the desires of the individual and augments it with just another betting pool trying to maximize rewards predicting what the behavior of those who are deliberately choosing to game the system will do.

The biggest vulnerability of the Q-filter isn't the danger of exploitation by bots, it's the conscious or unconscious collusion by those participating to act in ways which are contrary to their interests as regards content but in line with their interests as regards profit. Moreover, the longer the system runs, the more likely collusion among the participants becomes and the more isolated the actions of the actors (who aren't even necessarily bad actors) become from what you really want, determining "good content" which is posted to the ecosystem.

It's effectively the same problem that we have with Trending and Hot, just with some different decorations on it.

My personal issue with the design is that the assumption of consensus is invalid. You assume that things are voted up by enough people are good, but that's not actually the truth. If anything, the things that are voted up by enough people are the homogenously mediocre, because individuals have individual interests and desires, which may be vastly at odds with the consensus but which are far more valid as a measure of quality. Ignoring the individual, pushing the individual out of the cycle and instead rewarding consensus drives consensus-thinking instead of individuated-thinking, where, in this case, votes happen because the consumer believes that the consensus will vote a certain way rather than voting because that signal rewards them by getting them more things that they want. You are pushing, just like the steem voting system already does, the idea that your vote will be most rewarded by trying to predict what everyone else will do, simultaneously as everyone else does just that.

The problem should be obvious, right?

At root, before we even get to interpreting votes and what they mean (which is what this is all about), we have a serious breakage of what voting is intended to communicate and how it communicates.

- Does up voting represent a desire to see the creator rewarded because they have made something you like?

- Or have they just made something that was difficult to make and you want to respect that and reward them, even if it's not for you?

- Or do you vote things up because you like them and want to signal to the system to encourage people to make more things like that?

- Or do votes happen as a pure signal of liking a thing?

- Or do you just vote up everything that your friend does because your friends?

- Or do you just vote up everything that is posted to your community of friends who share similar but not necessarily overlapping tastes?

- Or do you just vote up everything that a few other taste leaders vote up because you hope to get curation value out of the reward system?

- Or do you just vote down everything that a certain person posts because you don't like them?

All of these things are happening, right now, this very moment, in the blockchain, and they are truly indistinguishable. There is no way for us to know after the fact which of these things is true. You will note that most of these voting motivations have nothing to do with the content itself, but instead are about playing the game, trying to maximize reward because the system has absolutely no interest in showing you more things that you signal that you like because you like them, and no ability to.

At heart, any system which is predicated on assuming that consensus speaks for the individual is going to be broken in very essential ways. Unless it specifically lenses the content based on the expressed interest of a given user it's not saying anything about the quality of content. All it's doing is testing whether individuals in its purview can successfully guess what other people are going to do, and that has nothing to do with the content in question.

The neural network here is going the wrong way 'round. Instead of being a human-operated neural network algorithm geared to predict the outcome of the network, it needs to be a neural network algorithm geared to predict what a human, a specific human, will do.

Otherwise the assumption is that you and I like exactly the same things and if we don't – we are wrong when we differ.

I categorically object to that position.

Otherwise, this is some pretty cool stuff and I encourage you to continue.
👍  ,
properties (23)
post_id40,033,706
authorlextenebris
permlinkre-greer184-q-filter-a-supplementary-content-discovery-network-and-rewards-system-steempaper-20180322t223617073z
categoryq-filter
json_metadata"{"app": "steemit/0.1", "tags": ["q-filter"]}"
created2018-03-22 22:36:21
last_update2018-03-22 22:36:21
depth1
children2
net_rshares47,732,460,813
last_payout2018-03-29 22:36:21
cashout_time1969-12-31 23:59:59
total_payout_value0.104 SBD
curator_payout_value0.031 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length6,039
author_reputation15,727,752,514,706
root_title"Q-Filter: A Supplementary Content Discovery Network And Rewards System [STEEMPAPER]"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (2)
@greer184 ·
$0.08
I'm not really assuming that everyone likes the same thing, as everything has different interests, but am rather looking at an alternative approach to build a "trending" page and building something that is more attached to the content than the current system (which with bidding bots is nearly completely deattached). But you are indeed correct that a single metric won't give the best results for individuals and other models would be necessary to act as predictors of desirable content to a specific individual.

There are definitely limitations with the model and limitations that will not be overcome with a one-size-fits-all approach. Not everybody likes popular content and not all great content is popular or viewed in such a positive manner.

The Q-Metric serves as a fancy rating metric which has more connection with the content than stake attached to it. Let's consider movies. The current system is like organizing films by box office output. Sure, that might have some relationship to quality, but there are always those shallow films that do well in the box, but everyone agrees isn't a great movie. The metric is an upgrade to something resembling that of an IMDB score (although there are differing incentives). That score still might not translate to an individual's preferences, but it gives us additional information and something we can use to make decisions.

Sure, if you really boil it down, that it does end up working in a similar way to Steem, but in such a way that mitigates the effects of gaming the system in a way that is orthogonal to the user base consensus. The most obvious example is using bid bots to gain attention. Also, the effects of apathetic users are reduced. So, the universally mediocre won't automatically float to the top. 

Lastly, assuming that everything I said fails and turns out to be completely useless, such a way of organizing and distributing rewards does make things more decentralized. When gives some tangible benefit of using this filter to some manner.

But giving an individual what they want is probably a better target for an ideal filter. But I'm not sure I see a good way of achieving such ends that are also harmonious with some of Steem's stated goals and treating content as something that generates value.
👍  
properties (23)
post_id40,045,337
authorgreer184
permlinkre-lextenebris-re-greer184-q-filter-a-supplementary-content-discovery-network-and-rewards-system-steempaper-20180323t002450987z
categoryq-filter
json_metadata"{"app": "steemit/0.1", "tags": ["q-filter"]}"
created2018-03-23 00:24:51
last_update2018-03-23 00:24:51
depth2
children1
net_rshares29,733,139,711
last_payout2018-03-30 00:24:51
cashout_time1969-12-31 23:59:59
total_payout_value0.064 SBD
curator_payout_value0.020 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length2,277
author_reputation7,566,392,895,503
root_title"Q-Filter: A Supplementary Content Discovery Network And Rewards System [STEEMPAPER]"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (1)
@lextenebris ·
$0.07
> But you are indeed correct that a single metric won't give the best results for individuals and other models would be necessary to act as predictors of desirable content to a specific individual.

I would put it to you that specific individuals are the only kinds of individuals that use any system. Which is a problem when we're talking about creating a single metric that derives the consensus position of all specific individuals seeking their individual goals across an entire operation.

If we could be assured that their goals are at least parallel, we could have some degree of surety that the metric so derived would communicate something meaningful. Consider any online auction house in any MMO that you care to mention. People are there to trade goods for currency. All of their votes/buys are intended to foster that aim. As such, a market price for a product gathered from the consensus position is meaningful. Thus why markets work at all. The consensus intent is meaningful.

Go back to Steemit. The intent of an up vote isn't consistent across in her actors. It means different things to different people – and part of that problem is poor on boarding education, but part of that problem is encouraged by the design of the system. There is no consistent reason to vote things up and because the immediate effect of the vote isn't anything that changes the experience for the voter in any real sense, they have no reason to vote as if it did.

So we can't even accept that discovery methods based on votes are going to really turn up content which users think is good, because good content isn't really the motivator for most up votes. We would like to think it is, and I know I would like to think it is, but it's not.

> Not everybody likes popular content and not all great content is popular or viewed in such a positive manner.

It may even be that content which receives the most votes isn't even near the top of the content that any individuals would like to see. Taken in aggregate, it could just be "not the worst thing," rather than "the best thing," even if everyone was engaged with voting as a signal of content they approve of.

Consider the case in which you have two communities using the same platform. One of them really likes to talk about cryptocurrencies and the other really likes to talk about role-playing games. Not only do they prefer to read about those things, they prefer to write about those things. The majority of the content is focused on that of the community.

You let them vote up content that they like. The communities are roughly the same size. What happens? Well, content which is far enough outside the bounds of either community finds that it has the most votes overall as long as it's at least remotely interesting. This is how you get the Internet overrun by pictures of cats. Pictures of cats are definitely not the best content on the platform, it's just the content which everyone finds least objectionable.

Again, this is in a situation where everyone is actually voting in good faith. As you get further from that possibility, consensus becomes even less meaningful.

> That score still might not translate to an individual's preferences, but it gives us additional information and something we can use to make decisions.

Let's try a little experiment.

Imagine that IMDb scores were set by trying to guess what the final IMDb score in a week after release. How useful would that signal end up being?

For the signal to be useful, it has to originate from a place which is not apathetic but is also not activist. The signal needs to be earnest.

With the overall consensus-derived signal then be useful? Well, no – because all it represents is the consensus of what everyone believes the consensus should be, not what the consensus is. We've already violated the expectation of the signal.

That is what the Q-filter will end up emitting. It will be a more nuanced signal compared to the standard steem voting protocol, but it will still be based on assumptions about the input signal which aren't the case or at least aren't sufficiently guaranteed to be meaningful.

> Also, the effects of apathetic users are reduced. So, the universally mediocre won't automatically float to the top.

But what else can? I mean that in a literal sense. Given that individuals and communities have preferences and even if we assume they vote those preferences, the signals they emit at best are going to be sufficiently fragmented that only the least offensive, most broadly not objectionable content is going to find its way to the top. It has to.

The universally mediocre is the only thing that can float to the top.

Effectively, the Q-filter replaces the tyranny of SP-holders with the tyranny of the majority, but it's still tyranny. But worse, it doesn't give us a signal that we can actually truly interpret as that of quality.

> Lastly, assuming that everything I said fails and turns out to be completely useless, such a way of organizing and distributing rewards does make things more decentralized. When gives some tangible benefit of using this filter to some manner.

The system badly needs decentralization, in a huge way. For all that the rhetoric about the blockchain focuses on its decentralized, impossible to eradicate nature, the entire thing is built around an authoritarian assumption of power and control. I don't even particularly mind that everything on the platform is scaled by your stake. It provides an obvious means of manipulating the commodity, but as a useful platform I can ignore those parts and still continue to leverage the bits that it gets right.

(Giving up the expectation that you will get paid in any significant way for what you create is very freeing for people who have been on this platform a little too long, apparently. I came in with that assumption firmly in place over decades of being an online pundit, so there wasn't much to unlearn.)

> But giving an individual what they want is probably a better target for an ideal filter. But I'm not sure I see a good way of achieving such ends that are also harmonious with some of Steem's stated goals and treating content as something that generates value.

There's no real reason that providing a user content that they are likely to want to engage with breaks steem's stated goals and treating content is something that generates value. Quite the opposite.

If you want content to be earning value, you want that content to be put in front of people who are willing and actively able to provide that value. Burying content in masses of crap, making it hard to discover, is a very aggressive way of making sure that content doesn't earn. Brutally so.

[I wrote a bit on distributed web of trust systems as a means of generating metrics for looking at streams of content on Steemit several months ago,](https://steemit.com/steemit/@lextenebris/steemit-and-the-web-of-trust-a-potential-love-story) and I still think that sort of thing is probably the best way to find and present data to the user. It's completely compatible with things like communities and other self organizing groups. It facilitates rather than impedes.

Unfortunately, it's probably a little too individualist for the folks around here. And it would require another layer on top of the steem blockchain in order to actually record and manage webs of trust.

In fact, [I wrote another article about distributed webs of trust implemented as representative tokens which were issued by every individual user, giving everyone their own currency,](https://steemit.com/steemit/@lextenebris/steemit-and-the-ultimate-recourse-blockchains-for-everyone) but that might actually be too far for anyone to actually comprehend, much less embrace.

But it would be fun.
👍  
properties (23)
post_id40,163,664
authorlextenebris
permlinkre-greer184-re-lextenebris-re-greer184-q-filter-a-supplementary-content-discovery-network-and-rewards-system-steempaper-20180323t163023119z
categoryq-filter
json_metadata"{"app": "steemit/0.1", "links": ["https://steemit.com/steemit/@lextenebris/steemit-and-the-web-of-trust-a-potential-love-story", "https://steemit.com/steemit/@lextenebris/steemit-and-the-ultimate-recourse-blockchains-for-everyone"], "tags": ["q-filter"]}"
created2018-03-23 16:30:27
last_update2018-03-23 16:30:27
depth3
children0
net_rshares26,712,588,260
last_payout2018-03-30 16:30:27
cashout_time1969-12-31 23:59:59
total_payout_value0.056 SBD
curator_payout_value0.018 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length7,776
author_reputation15,727,752,514,706
root_title"Q-Filter: A Supplementary Content Discovery Network And Rewards System [STEEMPAPER]"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (1)