Upcoming: Hive DB by furion

View this thread on steempeak.com
steem · @furion · (edited)
$154.27
Upcoming: Hive DB
### What is Hive?
Hive (short for Hivemind) is an extension of *sbds*. While *sbds* is concerned about storing raw blockchain operations, *hive* focuses on caching the state.

**Immediately useful to us is:**
 - account state
 - post state
 - followers/following data
 - reblogs, blogs and feeds

*Hive will also contain data needed for the upcoming communities, but we need not concern ourselves with it at this time*.

Source: https://github.com/steemit/hivemind

### SteemData hosted Hive DB
[SteemData](https://steemdata.com) is providing *sbds* and *hive* services for free on a completely open basis (no signup required).

You can access the Hive MySQL database at:
```
mysql://steemit:steemit@mysql.steemdata.com:3306/hive
```

### Why is some of the data missing?
I've decided to make MySQL a first-class citizen between services offered by SteemData, and as such I've re-deployed *sbds* and *hive* on a much more powerful i7/64gb/1tb-ssd server.

*Syncing with remote steemd is a bit slow, and it will take a while to have all data.*


### SteemData Redesign
As the number of SteemData apps and services grew, the website started getting a bit messy. I've re-organized it into logical sections.

![](https://i.imgur.com/zlAUjXU.png)

<center> <h4> https://steemdata.com </h4> </center>
πŸ‘  , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , and 185 others
properties (23)
post_id13,134,253
authorfurion
permlinkupcoming-hive-db
categorysteem
json_metadata"{"app": "steemit/0.1", "format": "markdown", "links": ["https://github.com/steemit/hivemind", "https://steemdata.com"], "image": ["https://i.imgur.com/zlAUjXU.png"], "tags": ["steem", "steemdev", "sbds", "hive"]}"
created2017-09-18 12:15:06
last_update2017-09-18 12:20:09
depth0
children22
net_rshares60,156,949,031,196
last_payout2017-09-25 12:15:06
cashout_time1969-12-31 23:59:59
total_payout_value130.249 SBD
curator_payout_value24.023 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length1,294
author_reputation116,591,440,117,983
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (249)
@stakuza · 
i`ve follow and upvoted u :) waiting for u :)
πŸ‘Ž  
properties (23)
post_id13,134,339
authorstakuza
permlinkre-furion-upcoming-hive-db-20170918t121615653z
categorysteem
json_metadata"{"app": "steemit/0.1", "tags": ["steem"]}"
created2017-09-18 12:16:18
last_update2017-09-18 12:16:18
depth1
children0
net_rshares-3,273,122,518
last_payout2017-09-25 12:16:18
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length45
author_reputation22,791,755,523
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (1)
@neander-squirrel ·
$2.12
It seems i'll have to learn mySQL after all:)

When you said "post state" do you mean hiveDB will tell me if a post was edited or not? That would be useful because sometimes `get_content` doesn't show this info, even the post was edited.

How much delay hiveDB has compared to the head block?
πŸ‘  ,
properties (23)
post_id13,135,100
authorneander-squirrel
permlinkre-furion-upcoming-hive-db-20170918t122830472z
categorysteem
json_metadata"{"app": "steemit/0.1", "tags": ["steem"]}"
created2017-09-18 12:28:33
last_update2017-09-18 12:28:33
depth1
children1
net_rshares828,802,263,622
last_payout2017-09-25 12:28:33
cashout_time1969-12-31 23:59:59
total_payout_value2.077 SBD
curator_payout_value0.042 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length292
author_reputation416,869,383,470
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (2)
@furion · 
No, for the post history you would still have to query sbds or SteemData Mongo, and compare the diffs between posts with the matching author/permlink.
properties (22)
post_id13,135,230
authorfurion
permlinkre-neander-squirrel-re-furion-upcoming-hive-db-20170918t123042098z
categorysteem
json_metadata"{"app": "steemit/0.1", "tags": ["steem"]}"
created2017-09-18 12:30:42
last_update2017-09-18 12:30:42
depth2
children0
net_rshares0
last_payout2017-09-25 12:30:42
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length150
author_reputation116,591,440,117,983
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
@mian290 · 
Great work very informative post like it and upvoted!!
keep it up!!
properties (22)
post_id13,136,112
authormian290
permlinkre-furion-upcoming-hive-db-20170918t124409777z
categorysteem
json_metadata"{"app": "steemit/0.1", "tags": ["steem"]}"
created2017-09-18 12:44:12
last_update2017-09-18 12:44:12
depth1
children0
net_rshares0
last_payout2017-09-25 12:44:12
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length67
author_reputation163,012,993,324
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
@steemreports · (edited)
$1.99
This looks great! Is part of the idea to take some of the load off the RPC nodes?
πŸ‘  ,
properties (23)
post_id13,136,330
authorsteemreports
permlinkre-furion-upcoming-hive-db-20170918t124648155z
categorysteem
json_metadata"{"app": "steemit/0.1", "tags": ["steem"]}"
created2017-09-18 12:46:48
last_update2017-09-18 13:02:54
depth1
children3
net_rshares777,175,203,598
last_payout2017-09-25 12:46:48
cashout_time1969-12-31 23:59:59
total_payout_value1.490 SBD
curator_payout_value0.495 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length81
author_reputation26,984,297,179,214
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (2)
@furion · (edited)
$0.04
Yeah, it certainly will, and it already does. Several apps already use SteemData rather than steemd directly, which is much faster for many use cases and allows for powerful queries.
πŸ‘  
properties (23)
post_id13,142,013
authorfurion
permlinkre-steemreports-re-furion-upcoming-hive-db-20170918t140353412z
categorysteem
json_metadata"{"app": "steemit/0.1", "tags": ["steem"]}"
created2017-09-18 14:03:54
last_update2017-09-18 14:04:06
depth2
children2
net_rshares16,940,847,043
last_payout2017-09-25 14:03:54
cashout_time1969-12-31 23:59:59
total_payout_value0.032 SBD
curator_payout_value0.010 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length182
author_reputation116,591,440,117,983
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (1)
@steemreports ·
$1.90
I've just investigated the schema and installed mysqlclient for Python. I'm currently maintaining a sqlite db for our stuff, but you're already doing the consolidation so edits etc. are merged into hive_posts_cache (if I'm not mistaken?), which I'm not so sure how to do easily. I look forward to investigating further once it has synced! Thanks very much for this work.
πŸ‘  ,
properties (23)
post_id13,142,969
authorsteemreports
permlinkre-furion-re-steemreports-re-furion-upcoming-hive-db-20170918t141613474z
categorysteem
json_metadata"{"app": "steemit/0.1", "tags": ["steem"]}"
created2017-09-18 14:16:12
last_update2017-09-18 14:16:12
depth3
children0
net_rshares744,302,662,715
last_payout2017-09-25 14:16:12
cashout_time1969-12-31 23:59:59
total_payout_value1.423 SBD
curator_payout_value0.472 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length370
author_reputation26,984,297,179,214
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (2)
@steemreports · 
From what I can see it has currently just got 56% of the blocks. Will it take more than a week to be up to date? Is this because getting old blocks over RPC is really slow, and it will speed up as the blocks get more recent? I presume hive_posts_cache starts filling only once we're in the last 7 days of blocks?
properties (22)
post_id13,384,198
authorsteemreports
permlinkre-furion-re-steemreports-re-furion-upcoming-hive-db-20170921t091649070z
categorysteem
json_metadata"{"app": "steemit/0.1", "tags": ["steem"]}"
created2017-09-21 09:16:48
last_update2017-09-21 09:16:48
depth3
children0
net_rshares0
last_payout2017-09-28 09:16:48
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length312
author_reputation26,984,297,179,214
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
@nutritionhealth · 
Great work veryπŸ‘ŒπŸ‘ŒπŸ‘ŒπŸ‘Œ informative post like πŸ‘πŸ‘πŸ‘πŸ‘it and upvotedπŸ’πŸ’πŸ’πŸ’
properties (22)
post_id13,136,876
authornutritionhealth
permlinkre-furion-upcoming-hive-db-20170918t125411364z
categorysteem
json_metadata"{"app": "steemit/0.1", "tags": ["steem"]}"
created2017-09-18 12:54:33
last_update2017-09-18 12:54:33
depth1
children0
net_rshares0
last_payout2017-09-25 12:54:33
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length64
author_reputation-36,775,243,377
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
@fabien ·
$1.93
Wow this is awesome! The future is now with you @furion :)
πŸ‘  ,
properties (23)
post_id13,142,643
authorfabien
permlinkre-furion-upcoming-hive-db-20170918t141156087z
categorysteem
json_metadata"{"app": "busy/2.0.0", "community": "busy", "tags": ["steem"]}"
created2017-09-18 14:11:57
last_update2017-09-18 14:11:57
depth1
children0
net_rshares758,423,949,599
last_payout2017-09-25 14:11:57
cashout_time1969-12-31 23:59:59
total_payout_value1.450 SBD
curator_payout_value0.481 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length58
author_reputation16,638,382,769,448
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (2)
@andrewramdas · 
Very interesting @furion ...upvoted... blessings from me in Jamaica
properties (22)
post_id13,147,820
authorandrewramdas
permlinkre-furion-upcoming-hive-db-20170918t151859917z
categorysteem
json_metadata"{"app": "steemit/0.1", "users": ["furion"], "tags": ["steem"]}"
created2017-09-18 15:17:24
last_update2017-09-18 15:17:24
depth1
children0
net_rshares0
last_payout2017-09-25 15:17:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length67
author_reputation2,442,180,604,341
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
@wayforhappiness · 
resteemit SERVICE! We're offering resteems to over 3300 followers for only 0.25 SBD or 0.25 STEEM per resteem. Our resteems generally do better than Promoted Posts. you can simply send 0.25 SBD or 0.25 STEEM now and the link to your post to @wayforhappiness and we'll resteem it right away. Resteems get you more views, more followers, more engagement on your post, and usually more money. We've had several repeat buyers who love the service. Thanks!
πŸ‘  
πŸ‘Ž  , , ,
properties (23)
post_id13,153,724
authorwayforhappiness
permlinkre-furion-upcoming-hive-db-20170918t163413423z
categorysteem
json_metadata"{"app": "steemit/0.1", "users": ["wayforhappiness"], "tags": ["steem"]}"
created2017-09-18 16:34:18
last_update2017-09-18 16:34:18
depth1
children0
net_rshares-318,568,493,507
last_payout2017-09-25 16:34:18
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length451
author_reputation-940,444,851,726
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (5)
@bitgeek ·
comment
Congratulations @furion, this post is the forth most rewarded post (based on pending payouts) in the last 12 hours written by a Hero account holder (accounts that hold between 10 and 100 Mega Vests). The total number of posts by Hero account holders during this period was 239 and the total pending payments to posts in this category was $4469.29. To see the full list of highest paid posts across all accounts categories, [click here](www.steemit.com/steemit/@bitgeek/payout-stats-report-for-18th-september-2017--part-i). 

If you do not wish to receive these messages in future, please reply stop to this comment.
properties (22)
post_id13,163,956
authorbitgeek
permlinkre-upcoming-hive-db-20170918t185201
categorysteem
json_metadata{}
created2017-09-18 18:52:03
last_update2017-09-18 18:52:03
depth1
children1
net_rshares0
last_payout2017-09-25 18:52:03
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length616
author_reputation13,048,348,742,603
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
@valued-customer · 
Fourth.  It was the fourth most rewarded post.  ;)
properties (22)
post_id13,194,330
authorvalued-customer
permlinkre-bitgeek-re-upcoming-hive-db-20170918t185201-20170919t035805023z
categorysteem
json_metadata"{"app": "steemit/0.1", "tags": ["steem"]}"
created2017-09-19 03:58:12
last_update2017-09-19 03:58:12
depth2
children0
net_rshares0
last_payout2017-09-26 03:58:12
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length50
author_reputation48,231,784,822,393
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
@muhammadbadawi · 
hello 
This is awesome !
Please check my last post and share your opinion
@muhammadbadawi
properties (22)
post_id13,164,644
authormuhammadbadawi
permlinkre-furion-upcoming-hive-db-20170918t190136252z
categorysteem
json_metadata"{"app": "steemit/0.1", "users": ["muhammadbadawi"], "tags": ["steem"]}"
created2017-09-18 19:01:36
last_update2017-09-18 19:01:36
depth1
children0
net_rshares0
last_payout2017-09-25 19:01:36
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length89
author_reputation-11,248,927,328
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
@optimisticguy · 
https://www.youtube.com/watch?v=kZoz_ssC8i8

The Hive Mind in the Real World (Because Science w/ Kyle Hill)
πŸ‘  
πŸ‘Ž  
properties (23)
post_id13,166,819
authoroptimisticguy
permlinkre-furion-upcoming-hive-db-20170918t193102721z
categorysteem
json_metadata"{"app": "steemit/0.1", "links": ["https://www.youtube.com/watch?v=kZoz_ssC8i8"], "image": ["https://img.youtube.com/vi/kZoz_ssC8i8/0.jpg"], "tags": ["steem"]}"
created2017-09-18 19:31:03
last_update2017-09-18 19:31:03
depth1
children0
net_rshares3,911,321,147
last_payout2017-09-25 19:31:03
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length107
author_reputation-898,117,860,960
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (2)
@therealwolf · (edited)
$0.31
wow - that's pretty cool! Especially for development when you don't want to output everything just to get the variable name.

But I will def. check it out for the data parsing purpose. Thanks a lot!
πŸ‘  
properties (23)
post_id13,169,707
authortherealwolf
permlinkre-furion-upcoming-hive-db-20170918t201222971z
categorysteem
json_metadata"{"app": "steemit/0.1", "tags": ["steem"]}"
created2017-09-18 20:12:24
last_update2017-09-18 20:27:21
depth1
children0
net_rshares123,509,940,464
last_payout2017-09-25 20:12:24
cashout_time1969-12-31 23:59:59
total_payout_value0.310 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length198
author_reputation371,535,229,097,172
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (1)
@abdulrahman24 · 
Hi .. I'm new Here, I need a push , thank you for up vote this post
πŸ‘  
properties (23)
post_id13,265,787
authorabdulrahman24
permlinkre-furion-upcoming-hive-db-20170919t231145948z
categorysteem
json_metadata"{"app": "steemit/0.1", "tags": ["steem"]}"
created2017-09-19 23:11:42
last_update2017-09-19 23:11:42
depth1
children0
net_rshares924,277,935
last_payout2017-09-26 23:11:42
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length67
author_reputation10,102,862,550
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (1)
@dehenne ·
$0.02
thanks for the post! i have some questions :-)

will it cost in the future?
how long are the delay? i mean how long does it need from steemd into the mysql db? how often is the db updated?

Can i use this for our notifications in steempi? that would be awesome. Are there any limits? query limits, time limits etc?

at the moment i made a bad hack to get reblogs for our giveaway :D so hive would help, too!!
πŸ‘  
properties (23)
post_id13,295,328
authordehenne
permlinkre-furion-upcoming-hive-db-20170920t085335135z
categorysteem
json_metadata"{"app": "steemit/0.1", "tags": ["steem"]}"
created2017-09-20 08:53:33
last_update2017-09-20 08:53:33
depth1
children0
net_rshares8,829,780,220
last_payout2017-09-27 08:53:33
cashout_time1969-12-31 23:59:59
total_payout_value0.017 SBD
curator_payout_value0.004 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length408
author_reputation8,024,988,975,286
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
author_curate_reward""
vote details (1)
@donchate · 
We are loving the MongoDB steemdata service. Very much appreciated. Hope it stays around for a while.
properties (22)
post_id13,444,658
authordonchate
permlinkre-furion-upcoming-hive-db-20170922t012314147z
categorysteem
json_metadata"{"app": "steemit/0.1", "tags": ["steem"]}"
created2017-09-22 01:23:21
last_update2017-09-22 01:23:21
depth1
children0
net_rshares0
last_payout2017-09-29 01:23:21
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length101
author_reputation596,424,610,422
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
@aftabkhan10 · 
Dnt know much about programmng but I appreciate your services dude.
properties (22)
post_id13,565,814
authoraftabkhan10
permlinkre-furion-upcoming-hive-db-20170923t135413725z
categorysteem
json_metadata"{"app": "steemit/0.1", "tags": ["steem"]}"
created2017-09-23 13:48:57
last_update2017-09-23 13:48:57
depth1
children0
net_rshares0
last_payout2017-09-30 13:48:57
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length67
author_reputation35,210,052,016,845
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
@kenhudoy · 
@furion
just saw this post and am happy for steemians like you ho dedicate time creatin options for us to teem better and have an excellent experience... thanks for all your efforts...really appreciate
properties (22)
post_id13,794,085
authorkenhudoy
permlinkre-furion-upcoming-hive-db-2017926t104946249z
categorysteem
json_metadata"{"tags": [], "format": "markdown+html", "app": "chainbb/0.3"}"
created2017-09-26 09:49:18
last_update2017-09-26 09:49:18
depth1
children0
net_rshares0
last_payout2017-10-03 09:49:18
cashout_time1969-12-31 23:59:59
total_payout_value0.000 SBD
curator_payout_value0.000 SBD
pending_payout_value0.000 SBD
promoted0.000 SBD
body_length203
author_reputation10,770,161,662,981
root_title"Upcoming: Hive DB"
beneficiaries
0.
accountchainbb
weight1,500
max_accepted_payout1,000,000.000 SBD
percent_steem_dollars10,000
Help/Feedback