Premia questo post
Segnala
Reddit Top20K search and download
Hi guys. I have download the archive torrent and split it by subreddit, make a simple website, https://reddit-top20k.cworld.ai/
It includes submissions and comments, and compressed in zst format
You can search and download the archieve data
Segnala
Informazioni su questo annuncio
Sezione commenti
Clearly you’re missing some subreddits. r Drugs is ranked 793 place but not found in the search results.
that's because drugs are illegal
Caffeine is a drug but not illegal. Just like alcohol.
Your argument doesn’t make any sense.
R/drugs is NOT a marketplace.
Can you tell me the start and end dates for this data?
Thanks for this effort btw.
from 2005-06 to 2022-12
Thanks
Also I train some Machine Learning model based on different subreddit.
It can generate different posts
You can experience it on https://docs.cworld.ai/tutorial-app/reddit-simplify
You can found model on https://cworld.ai/
After I unzip the file what is the file type to push this into python/pandas?
Is there a way to download a deleted subreddit? When camas unddit was working I could search for old comments
Your best bet is this if your desired sub was in the top 20k of subreddits (which it probably is). If not, this data dump of all of reddit submissions might be your only option.
Commento eliminato dall'utente
No, almost certainly not.
yes, it's something I've been working on: http://redarc.basedbin.org
How are u planning to circumvent the API lock
Have they archived more than the 20k subreddits?
How to pass a .zst file into a pandas df?
Thank you for this:) I'm an artist and used the camas API search for inspiration (and laughs). It felt like I'd been murdered when they shut down the 3rd party apps; Nowhere to go to find anything easily and no 'old data' to shift through. Thank you very, very, very much for doing this:) I'm hoping the things I can't find now are in your data and I can still use it all somehow for my work:)