I just saw, that fedidb now has data for the biggest fediverse accounts, so I did a little plotting with it. Here is a graphic of the scattering of the 100 biggest accounts by the instance they are on. 38 of them are on mastodon.social https://fedidb.org/popular-fediverse-accounts (the data is in the alt text) #mastodon #chart #fedidb #fediverse
While this chart certainly shows how dominant mastodon.social in the Fediverse is, I like this chart. It also shows how diverse the Fediverse is. For any other social network this graph would be a simple circle. For the Fediverse it shows 38 different servers, and apart from mastodon.social, the distribution seems quite fair.
Very good!
Absolutely. I mean yeah 30-45% of the biggest accounts are on mastodon.social but it is the only one with a huge share. The rest is pretty diversely scattered among instances
Made a little script and raked almost 1800 servers and over 40.000 communities.
If someone has the http api call for messages and posts I’d love continuing and maybe set up some sort of search engine… Or maybe I should go with the soap(?) one but I don’t know how to do it in python, any information greatly appreciated!
oh, Good luck with that. Make sure however to respect the users privacy and indexing preferences. People in the Fediverse are very privacy consious and not everyone likes their post scraped and indexed.
I’d start with the Mastodon docs, it’s a solid resource to get started.
Hmm… I’d only index public data (I’m not totally there yet of course), which can be found by anyone, but if there is some way for people, posts, communities, servers, to opt out then ok. Serious question: is there though? Second question, I’m wanting to do this open source, which means anybody can take it, remove the check and scan everything. What are your thoughts about that?
If you know how to query servers, communities, posts or comments on that topic I’m all ears, I’m only doing 50% of that today BTW.
On a side note, where is your 0xCAFE come from? Is it like the stack overflow/ memory error checks like 0xDEAD(or 0xDEADBEEF) and so?
Cheers!
Hey, how’s it going? Are you still working on it?
Sorry for this huge delay, sometimes RL takes over… I don’t know how relevant it still is. I’ll try anyway.
but if there is some way for people, posts, communities, servers, to opt out then ok.
I think this could pose an issue. Many people in the Fediverse are very sensitive about informed consent — which cannot be satisfied by any opt-out mechanism. This is an issue for every bridge/search service, because with opt-in you will have way less users. I strongly recommend to go for opt-in however, you will be starkly criticized otherwise.
I’m wanting to do this open source, which means anybody can take it, remove the check and scan everything. What are your thoughts about that?
Yes, anybody could do that, or build something from scratch, but will meet strong opposition in the Fediserve, as we’ve seen more than once.
If you know how to query servers, communities, posts or comments on that topic I’m all ears, I’m only doing 50% of that today BTW.
Can’t help here, sorry.
On a side note, where is your 0xCAFE come from? Is it like the stack overflow/ memory error checks like 0xDEAD(or 0xDEADBEEF) and so?
Nope, just a nerd who likes computery stuff like hex numbers and, obviously, coffee. No technical magic number I know of (maybe there still is…?).
Hello cafe !
The project is on ice atm, if I get the hang on the API calls for communities and messages I’d probably continue.
I know some people think you shouldn’t scan messages, but they’re free to see out there in the open already? I mean a search engine could actually do wonders for unknown communities, and I’d gladly filter out by some tag or whatever if needed. I mean if I get down to do it :-)
Cheers!
see federated network
looks inside
mastodon.social
Perfection is the enemy of good, I guess. The point is that you can federate, even though most will not know or care. mastodon.social could lock itself down for new users harder, but that would most likely just stop people from signing up to Mastodon at all.
It’s like people who complain about energy efficient lighting because now they have to go knock the snow off the light instead of letting excess heat melt it.
seems very microblog specific. not terribly useful for people who dont give a shit about followers. ‘fediverse’ not ‘tweetoverse’
Well, yes. On Lemmy you cannot follow accounts. However groups (communities, magazines, etc.) do not count as an “account” I think. A chart about the biggest groups would certainly be very interesting as well. And that lemmy does only support a subgroup of the fediverse is imo not a reason to not post this here
To be fair, their are in the Fediverse.
I always think we should have another community called Threadiverse for Lemmy, Kbin, Mbin, Lotide and soon Sublinks. Probably too late now as most people would prefer to stay here, but maybe at a later point we could.
