Anti- Web scraping

Discussion in 'Tech Discussion' started by Wujigege, Sep 23, 2017.

Tags:
  1. Wujigege

    Wujigege *Christian*SIMP*Comedian

    Joined:
    Oct 6, 2016
    Messages:
    16,265
    Likes Received:
    15,755
    Reading List:
    Link
    I saw a comment on rebirth online world Nidome Yusha chapter.
    It talked about how a reader using reading mode on Firefox had porn inserted into the chapter as he was treated as a scraper.
    It's pretty hilarious and I was wondering on it is done.
    Since its selective and doesn't show fake content to all readers
    http://www.rebirth.online/novel/nidome-no-yuusha/31#comment-3486749173
     
    Last edited: Sep 23, 2017
  2. canaria23

    canaria23 『  』

    Joined:
    Oct 21, 2015
    Messages:
    9,488
    Likes Received:
    10,955
    Reading List:
    Link
    Lol
     
    AliceShiki and Wujigege like this.
  3. J-Mitch

    J-Mitch ⚖ Tipping the Scales of the World

    Joined:
    Mar 11, 2016
    Messages:
    1,922
    Likes Received:
    3,759
    Reading List:
    Link
    *Cough*
     
    udangmayones and Wujigege like this.
  4. Kaminomi

    Kaminomi Well-Known Member

    Joined:
    Aug 16, 2017
    Messages:
    123
    Likes Received:
    93
    Reading List:
    Link
    Man you have a pretty big ear to hear that news
     
  5. Wujigege

    Wujigege *Christian*SIMP*Comedian

    Joined:
    Oct 6, 2016
    Messages:
    16,265
    Likes Received:
    15,755
    Reading List:
    Link
    AliceShiki likes this.
  6. udangmayones

    udangmayones A proffesional fallen-to-the-floor cuisine

    Joined:
    Feb 1, 2017
    Messages:
    117
    Likes Received:
    44
    Reading List:
    Link
    *cough cough*
     
    Wujigege likes this.
  7. TamaSaga

    TamaSaga Well-Known Member

    Joined:
    Oct 11, 2016
    Messages:
    1,726
    Likes Received:
    2,173
    Reading List:
    Link
    Shouldn't be too hard. Just have the previous page load with a key. If it doesn't submit the key when you bring up the new chapter, then assume that a non-compliant "browser" is on the end and provide special serving.
     
  8. kkchaitu

    kkchaitu Well-Known Member

    Joined:
    Nov 4, 2016
    Messages:
    304
    Likes Received:
    253
    Reading List:
    Link
    You can ask the translation nation folks as well. They are also using something similar, just not porn stuff - either garbled text in FireFox or just a quarter or half the chapter in Safari
     
  9. J-Mitch

    J-Mitch ⚖ Tipping the Scales of the World

    Joined:
    Mar 11, 2016
    Messages:
    1,922
    Likes Received:
    3,759
    Reading List:
    Link
    "I choked her to death then cut her in small pieces so I could take my
    meat to my rooms, cook and eat it. How sweet and tender her little ass
    was roasted in the oven. It took me 9 days to eat her entire body. I did
    not fuck her, though, I could of had I wished. She died a virgin."
    Albert Fish said.

    Oh, wow. That is some text to place in white for scrapers....
     
    Hahhaa and Eternal Liar like this.
  10. J-Mitch

    J-Mitch ⚖ Tipping the Scales of the World

    Joined:
    Mar 11, 2016
    Messages:
    1,922
    Likes Received:
    3,759
    Reading List:
    Link
    Sounds like another language. Gonna need step-by-step instructions
     
  11. TamaSaga

    TamaSaga Well-Known Member

    Joined:
    Oct 11, 2016
    Messages:
    1,726
    Likes Received:
    2,173
    Reading List:
    Link
    Step 1: Reverse-Engineer anti-ad-blocking software
    Step 2: Adjust for enemy thief bots and change "ad-block software detected" to something else.
    Step 3: ???
    Step 4: Profit
     
    AliceShiki, Wujigege and Kaminomi like this.
  12. GekkoZockt

    GekkoZockt Well-Known Member

    Joined:
    Apr 25, 2017
    Messages:
    43
    Likes Received:
    32
    Reading List:
    Link
    Reminds me of that anti piracy thing in the settlers, where the blacksmith's produced pigs but because of a bug some legit users also had the same problem.
    It's exactly 1 line of code to prevent a scraping tool getting detected in most cases.
     
    Wujigege likes this.
  13. Wujigege

    Wujigege *Christian*SIMP*Comedian

    Joined:
    Oct 6, 2016
    Messages:
    16,265
    Likes Received:
    15,755
    Reading List:
    Link
    I dont have the expertise so I will give up on it
     
  14. SaltatorMortis

    SaltatorMortis Well-Known Member

    Joined:
    Nov 30, 2015
    Messages:
    135
    Likes Received:
    59
    Reading List:
    Link
    idk this level of "watermarking" is only annoying nothing more
    because 2 lines of code and we have again plain text...
    didnt take toolong to adjust to it.

    i hate if they fiddle with my reader view...
    i dont run an adblocker on the websites and this is the thanks...
     
    noisypixy and Wujigege like this.
  15. Zhaernon

    Zhaernon Well-Known Member

    Joined:
    Jan 7, 2016
    Messages:
    93
    Likes Received:
    96
    Reading List:
    Link
    Hello there,
    I'm sorry to be replying just now, but my presence on NUF is still fairly fresh.
    Our Anti-Theft Measure at the time of the creation of this Thread was still fairly fresh and we just put whatever our Staff Members came up with in the spur of the moment in the substitute texts visible whenever the Measure is triggered.

    This issue has been amended since then, and in fact most of the more offensive texts appearing previously have been removed from the site within a few days of the comment being the main topic of discussion here.
    I'm fairly confident that, judging by the post dates, the issue was no longer there by the last message posted in here.

    You can find our official statement with the exact details on the Measure in here:
    http://forum.novelupdates.com/threads/rebirth-online-our-anti-theft-measure.48656/

    Thank you for the patience, and please do mention me next time there is an issue like this one that would possibly require my attention :)
    I will try to cater to it at my earliest convenience.

    Best Regards,
    Zhaernon, Rebirth.Online Manager
     
  16. Anastrisha

    Anastrisha Well-Known Member

    Joined:
    Oct 30, 2016
    Messages:
    66
    Likes Received:
    48
    Reading List:
    Link
    A well since Z already went on relpying to this thread might as well add something in this thread...
    Do you like it? I was the one who asked Lumi to add it. :X3:
    I'm happy to see that priceless face/comment of yours~
    HAHAHAHA #StillNoRegrets

    AND IT'S NOT PORN IT'S CARNIVORE! It's based on real events, that a certain boogeyman is doing. *and that my friend is one of the reason why the boogeyman is born* it was never meant to "...stimulating a compulsive interest in their audience." well unless of course you got a kink for that. ;) I don't judge.
     
    Wujigege likes this.
  17. Wujigege

    Wujigege *Christian*SIMP*Comedian

    Joined:
    Oct 6, 2016
    Messages:
    16,265
    Likes Received:
    15,755
    Reading List:
    Link
    I would like to implement it on my website just for kicks
     
  18. Anastrisha

    Anastrisha Well-Known Member

    Joined:
    Oct 30, 2016
    Messages:
    66
    Likes Received:
    48
    Reading List:
    Link
    Well ask the late Albert Fish. XD
     
    Wujigege likes this.
  19. Wujigege

    Wujigege *Christian*SIMP*Comedian

    Joined:
    Oct 6, 2016
    Messages:
    16,265
    Likes Received:
    15,755
    Reading List:
    Link
    Well I will pass then. Thanks anyway