Are you the author @Blaze?

I think that the metrics that the author is looking at, while easily accessible, are the wrong metrics to be considering on impact.

First, we need a way of quantifying the quality of users, rather than quantity. Specifically, we know that no ‘apparent’ material dent was made in the user numbers, and actually probably wasn’t. But that doesn’t mean that critical players in the system didn’t hit the eject button. I think its a widely held belief that it was more of the ‘power’ user types that left and went to lemmy. We need to test that specific belief. This work doesn’t do that.

There are however metrics that could test that belief. For example, posts/ user and comments/ user both can be representative of engagement. Log interactions/ log system interactions can be used to identify power users (like @thepicardmaneuver). This can also be done at the community level (we’ll have to do some matching), to compare individual communities.

I think also a classification of “S-tier” engaged users, “A-teir” engaged users, users, and bots; calculating a ratio of them, then plotting them against log engagement is likely the best way to describe ‘overall’ engagement. My hypothesis is that Lemmy has a significantly higher ratio of S and A tier, while Reddit has a higher ratio of lurking users who never posts (shadow accounts) or comment, and bots. The ratio of these factors together create a metric of ‘quality’, which is a dynamic expression related to quantity ~ engagement. To determine quality, we need to know how engaged are users with the community, and how often.

I’ve been working separately from this different approach but am obviously not close to publishing. I wasn’t even necessarily planning for peer review outside of the lemmy community. I was thinking more of a bot to gather and present these metrics at regular intervals.