this post was submitted on 18 Jun 2023
60 points (100.0% liked)

Reddit Migration

145 readers
1 users here now

### About Community Tracking and helping #redditmigration to Kbin and the Fediverse. Say hello to the decentralized and open future. To see latest reeddit blackout info, see here: https://reddark.untone.uk/

founded 1 year ago
 

I just spent all day today fighting with reddit, trying to get all my comments deleted/overwritten: https://kbin.social/m/RedditMigration/t/45417/Anyone-have-experience-with-deleting-comments-to-see-older-comments#entry-comment-190482

It's not just me, someone else reported the same, though using a different tool: https://kbin.social/m/RedditMigration/t/46805/Strange-phenomenon-while-deleting-my-comments

Basically, reddit has the most ridiculous api ever! A 1000 limit on viewing .. well basically anything. Try to go further back, and you can't.

The tools and scripts and websites we are using to delete, they are hitting that limit and can't go past it. My own reddit is only 5 years old and I hit this. I imagine that many folks where, the ex-redditors who had 12, 17 year old accounts, you probably didn't get everything on your way out.

Unless of course, you had a data retrieval request made to reddit, and reddit responded with your data. Only then are tools like shreddit and websites like shreddit.com able to completely wipe out your history. Or else you knew about this somehow already and used an external manager like eternity - https://github.com/jc9108/eternity - to save a copy of your posts before they got lost to the 1k limit.

Worst of all, it's explained that deleting items does not rebuild the list - so you can't see the older stuff by deleting newer stuff.

I'm hoping that private/public transition is an exception to this and it'll rebuild my lists when that happens. Maybe then I can go far back enough to delete everything.

Edit: Nope, someone confirmed in a comment below that this doesn't happen.

Also looks like pushshift is not an option, as pushshift was shut down last month, https://old.reddit.com/r/pushshift/comments/13mhuzq/api_has_been_taken_down/ - and under the new deal, regular users won't be able to use it when it opens up for business again, only approved moderators can (and likely only for approved reasons) if i'm understanding https://old.reddit.com/r/pushshift/comments/13w6j20/advancing_communityled_moderation_an_update_on/ correctly.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 3 points 1 year ago (1 children)

500 posts is under the limit so that makes sense.

For the comments, since the oldest ones don’t show up in your profile anywhere, how did you verify that PDS deleted them?

[–] [email protected] 2 points 1 year ago (1 children)

I have not deleted the account. I can login. I’m awaiting my pushshift confirmation and going through manually scrubbing saved posts and comments. Saving some recipes and other shit. I’m keeping an eye out for the reinstatement of comments if it happens.

[–] [email protected] 1 points 1 year ago (1 children)

I’m awaiting my pushshift confirmation

Can you elaborate more on this? If there's a way to get pushshift access, even if just temporarily and for a short time, this would be really great! I could finish running the PSAW script and wipe everything now.

I have not deleted the account. I can login.

I know, you said this.

I’m keeping an eye out for the reinstatement of comments if it happens.

Sorry to be a bit thick here. This makes it sound like you didn't have a way to verify the older 2000 comments are gone and were just assuming that they are gone because your profile doesn't show anything.

Again, sorry to be a bit pushy here. It's just that, if PDS can really do this, bypass the 1000 index limits, then I am willing to give it another try (and maybe share some fixes since it seems to be broken on my browser).

But I'd rather not waste my time if that's not the case. So a confirmation (about the ability of PDS to bypass the 1k limit) would be super helpful!

After plan B (pushshift) failed (due to pushshift being down), my plan C also failed (I saw the pushshift torrent on archive.org but it's too huge for me to grab).

But I found a plan D - my earliest comments were restricted to just three or four relatively small subs across six months, and someone posted on how to download just the dumps for specific subs in specific year-months.

https://news.ycombinator.com/item?id=36038684
https://academictorrents.com/details/c398a571976c78d346c325bd75c47b82edf6124e/tech&filelist=1

So I'm going to try and download the relevant files (much smaller, only teens of MB compressed), search for my own comments, and feed them to a script for overwriting.. With this I think I'll have even my oldest comments covered.

and going through manually scrubbing saved posts and comments. Saving some recipes and other shit.

How many of these did you have? I never saved anything (didn't really know about the feature until after the blackout) but supposedly it has a 1000 index limit as well.

[–] [email protected] 1 points 1 year ago (1 children)

Go to the r/pushshift sub and the stickied post for deleting your pushshift content. Follow the directions in there.

I had pds copy and report all comments before overwriting them and have a csv file of all the comments deleted. PDS ran for 45 minutes on my largest account.

[–] [email protected] 1 points 1 year ago

I think there's been a misunderstanding - you're just trying to delete your data from pushshift itself by following https://teddit.adminforge.de/r/pushshift/comments/10yj803/removal_request_form_please_put_your_removal/ right?

I thought maybe you had a confirmation to access their API directly. Oh well.

BTW, you can run a line count on the CSV from PDS. If you really had 3000 comments and 500 posts, the CSV should have at least 3500 lines (one per post/comment). Probably will have a lot more as PDS uses quotes to make multi CSV records. But if you have less then that's a red flag that PDS might not have saved everything or erased everything.

For my much smaller account, PDS also ran for longer - over an hour. But maybe internet speeds has something to do with that as well.