wasteof.money was crawled and compiled into a dataset of ~1000 profiles with posts and comments for statistical purposes.
comments
what are the average stats of a post and user (average likes, reposts, comments, edits, and following, followers, and total posts), just curious
Was planning to tally that up next
wait you should open source the data
you mean make it public? or open source the scraper?
Like release data to public
Nobody would want to scrape themselves when they have the data
Before scraping the site, I had consulted with Jeffalo and agreed to a number of terms that would prohibit me from publicizing the raw dataset in the interests of keeping deleted posts / comments private. As for open sourcing the crawler, I am keeping it closed for the moment in the best interests of Jeffalo.
Ok nice