Here are IPs from agregrators crawlers and bots that I discovered

Discussion in 'Translator's Corner' started by OurPrinceNiki, Jul 3, 2021.

  1. OurPrinceNiki

    OurPrinceNiki Well-Known Member

    Joined:
    Oct 17, 2020
    Messages:
    118
    Likes Received:
    113
    Reading List:
    Link
    I made another experiment yesterday before sleeping in order to pinpoint the agregrators IP and I thought it will take at least a few days to find their IPs because I blocked many of them like the one tried to hack my website, inject SQL and ddos.
    Because I focused myself to find them, I didn't bother to unblock the one that put harm on my website so I unblock first the one using VPN.
    I made my moderator release 20 chapters from my website yesterday and in less than 2 hours the agregrators website took the translations.

    So I concluded that their IPs must be among these:
    159.89.123.131
    128.199.35.132
    2400:8907::f03c:92ff:fe5a:ea17
    2400:8904::f03c:92ff:fe5a:9ff8
    140.238.94.137
    85.25.218.100
    54.198.61.5
    18.206.90.86
    114.119.148.105
    52.6.243.18
    132.145.15.209
    209.126.117.23
    44.226.159.159
    3.223.4.49
    147.78.141.191
    185.191.171.20
    185.191.171.13
    185.191.171.15
    185.191.171.21
    185.191.171.16
    185.191.171.4
    185.191.171.5
    3.237.80.14
    185.191.171.44
    185.191.171.33
    185.191.171.12
    185.191.171.22
    94.155.33.88
    185.191.171.3
    5.165.73.48
    85.25.217.104
    206.223.226.35
    148.72.152.180
    3.88.150.184
    54.209.60.63
    132.145.9.5
    132.145.11.125
    152.67.128.219
    192.171.237.33
    54.196.158.141
    54.175.74.27
    52.90.249.11
    209.190.81.231
    185.191.171.11
    191.96.56.154
    185.191.171.41
    109.245.241.89
    117.222.60.99
    185.191.171.9
    103.155.88.26
    181.214.108.90
    54.167.217.59
    140.238.95.47

    Let's block all of them so we aren't rob of our translations anymore.

    But there is a risk with everyone blocking them obviously.
    1.) Buy new VPN. Like I said, I unblocked the IPs from VPN yesterday so obviously they are using VPN.

    2.) Change internet provider. By changing Internet provider, they change their IPs.

    Honestly they could have used Proxy but because I have a firewall that block proxy I am okay with it.

    But the best way to block these is to redirect them to a website unrelated so they will not use up website resources or try to hack the website.

    I also kind of discover the agregrators system, if one has new translation they will just steal from that. So if you block the main provider of translations, you block them all.
    Just so you know the main sources of translation stuff of every agregrator is just one website honestly, Wuxiaworld. Site
    If you focus yourself in blocking them it will result to a chain reaction and the other agregrators will stop stealing.

    I can't block Asian novel because that site is user base, it's their users that copy paste the content and make them EPUB or PDF.

    NOTE: These are the IPs of them using VPN meaning they still have their original IP, will try to pinpoint their true IP (without VPN) in the future soon.
     
  2. UnGrave

    UnGrave ななひ~^^

    Joined:
    Jun 27, 2016
    Messages:
    4,076
    Likes Received:
    12,856
    Reading List:
    Link
    I feel like this is a fruitless bit of effort that won't actually do anything for you really.
     
    WinByDying and Westeller like this.
  3. OurPrinceNiki

    OurPrinceNiki Well-Known Member

    Joined:
    Oct 17, 2020
    Messages:
    118
    Likes Received:
    113
    Reading List:
    Link
    It's worth it to block the bots. Those are the main cause why websites goes down by taking up many resources.
    Also by blocking agregrators, my translators would not worry about their hard work being steal. That's one of the worries a translator has.
     
  4. Westeller

    Westeller Smokin' Sexy Style!! Staff Member

    Joined:
    Apr 3, 2016
    Messages:
    8,176
    Likes Received:
    24,960
    Reading List:
    Link
    It's one of the things translators simply have to get used to. You simply can't block piracy. Billion dollar companies have tried for decades, continue to try today, and fail. Constantly. You're not going to end piracy by blocking a few IPs. And if you're not careful, you'll block the IPs of common VPN services or similar things and just frustrate legitimate readers who use those services.

    Aggregators are a fact of life. Don't ruin things for yourselves and your readers.
     
    WinByDying likes this.
  5. OurPrinceNiki

    OurPrinceNiki Well-Known Member

    Joined:
    Oct 17, 2020
    Messages:
    118
    Likes Received:
    113
    Reading List:
    Link
    I block the IPs from VPN that harmed my website but I did not use the firewall that completely block VPN. Only those VPNs with 50% risk. (The firewall I put on the website can manipulate to which risk VPN should I block. Those VPNs with above 50% risk are completely blocked. These are mostly bad bots that slows down the website or steal users data.)

    I know there are good VPN because I also use them but if there are VPN that tried to hack or inject in mySQL, I blocked them completely without any hesitation.
    As for proxy, those who access xmlrpc are blocked immediately.

    For Agregrators... There aren't many agregrators that steals novel translations unlike manga or manhwa ,there are just like 5 Major website and honestly some of their crawlers are easy to block while on one I had a hard time.

    Those agregrators don't even bother to write the whole post completely because they have other translations to steal.
     
  6. seife

    seife Member

    Joined:
    Mar 1, 2021
    Messages:
    52
    Likes Received:
    34
    Reading List:
    Link
    I've got no clue why they're trying to inject SQL when there are other more simple ways. I also find it quite stupid that they don't add delays between the get requests.
     
  7. dark_king92345

    dark_king92345 Member

    Joined:
    May 31, 2021
    Messages:
    23
    Likes Received:
    9
    Reading List:
    Link
    Put a cloudflare on your website and put it on I'm under attack mode to prevent crawlers and ddos attack. Cloudflare is free and it can make your website load fast. It can prevent crawlers 100%