dramaticcat@sh.itjust.works to Lemmy Shitpost@lemmy.world · 11 months agoChad scrapersh.itjust.worksimagemessage-square99fedilinkarrow-up11.06Karrow-down129
arrow-up11.03Karrow-down1imageChad scrapersh.itjust.worksdramaticcat@sh.itjust.works to Lemmy Shitpost@lemmy.world · 11 months agomessage-square99fedilink
minus-squarecamr_on@lemmy.worldlinkfedilinkarrow-up28·11 months agoI loved scraping until my ip was blocked for botting lol. I know there’s ways around it it’s just work though
minus-squarePennomi@lemmy.worldlinkfedilinkEnglisharrow-up42·11 months agoI successfully scraped millions of Amazon product listings simply by routing through TOR and cycling the exit node every 10 seconds.
minus-squarecamr_on@lemmy.worldlinkfedilinkarrow-up15·11 months agoThat’s a good idea right there, I like that
minus-squareferret@sh.itjust.workslinkfedilinkEnglisharrow-up5·11 months agolmao, yeah, get all the exit nodes banned from amazon.
minus-squarePennomi@lemmy.worldlinkfedilinkEnglisharrow-up12·11 months agoThat’s the neat thing, it wouldn’t because traffic only spikes for 10s on any particular node. It perfectly blends into the background noise.
minus-squarenilloc@discuss.tchncs.delinkfedilinkEnglisharrow-up3·11 months agoQueue Office Space style error and scrape for 10 hours on each node.
minus-squareTouching_Grass@lemmy.worldlinkfedilinkarrow-up8arrow-down1·edit-211 months agoYou guys use IP’s?
minus-squaresynae[he/him]@lemmy.sdf.orglinkfedilinkEnglisharrow-up7·11 months agoToken ring for me baybeee
minus-squarecamr_on@lemmy.worldlinkfedilinkarrow-up7·11 months agoI’m coding baby’s first bot over here lol, I could probably do better
I loved scraping until my ip was blocked for botting lol. I know there’s ways around it it’s just work though
I successfully scraped millions of Amazon product listings simply by routing through TOR and cycling the exit node every 10 seconds.
That’s a good idea right there, I like that
This guy scrapes
lmao, yeah, get all the exit nodes banned from amazon.
That’s the neat thing, it wouldn’t because traffic only spikes for 10s on any particular node. It perfectly blends into the background noise.
Queue Office Space style error and scrape for 10 hours on each node.
You guys use IP’s?
Token ring for me baybeee
I’m coding baby’s first bot over here lol, I could probably do better