MTL Sites, How do they work?

Discussion in 'Tech Discussion' started by SectlessJosh, Oct 1, 2018.

Tags:
  1. SectlessJosh

    SectlessJosh Member

    Joined:
    Apr 10, 2018
    Messages:
    26
    Likes Received:
    9
    Reading List:
    Link
    Hello! I want to create a site like
    https://lnmtl.com/
    And
    https://comrademao.com/

    They automatically get the raws translates them to automatically post the chapter, how do they work? No matter how difficult it is, I want to have it for my language.

    Thanks your very much!!!
     
  2. rei_hunter

    rei_hunter Well-Known Member

    Joined:
    Jan 18, 2016
    Messages:
    848
    Likes Received:
    646
    Reading List:
    Link
    they usually just throw it into a google translate and name replace script (before google translate).
    at least that's what LNMTL does.
    as for raw procurement, no idea.
     
    Cutter Masterson likes this.
  3. raitei

    raitei ⟪Procyon lotor paronomasiaabsentii⟫

    Joined:
    Sep 8, 2017
    Messages:
    678
    Likes Received:
    989
    Reading List:
    Link
    How, you ask?

    [​IMG]

    Real answer:

    Like what rei said.

    Basically, use script to extract the content of the chapter, dump the extracted raw texts to any machine translator (with some exceptions like names/places/terms), fetch the result, and post it. But to do it automatically... You have to think of some workaround for sites that blocks such script tho.
     
  4. Sederance

    Sederance Well-Known Member

    Joined:
    Jun 6, 2016
    Messages:
    82
    Likes Received:
    46
    Reading List:
    Link
    Also not all translated stuff comes out in easy to read sentences, im sure they have to reorder or reword them to fit
     
  5. Rumby

    Rumby Rumbly Tumbly

    Joined:
    Feb 23, 2017
    Messages:
    1,097
    Likes Received:
    1,018
    Reading List:
    Link
    both are like rei said ^^

    You can suggest novels on comrademao's discord or lnmtl's through donations or survey polls.
    lnmtl though have a section for suggesting better names for words/phrases though, so novels on there get updated with new suggestions based on votes^^

    You can probably pop in their discord to ask them though? Since dunno how they get raws and make the site
     
  6. CripplingDepression

    CripplingDepression 『Professional Loli Appraiser』

    Joined:
    Jun 24, 2018
    Messages:
    297
    Likes Received:
    357
    Reading List:
    Link
    You need a basement and a batch of slaves.
     
    Sannnnn likes this.
  7. XFLAX

    XFLAX Well-Known Member

    Joined:
    Apr 8, 2019
    Messages:
    25
    Likes Received:
    26
    Reading List:
    Link
    I've done this before on a blogger website which is quite hard.
    1-get the raws
    2- make a python script to split the raws into chapters using regular expression
    3- another script to translate the whole thing and also replace some words
    4- another script to convert chapters to html
    5-script to send them to my blogger
    6- script to make table of contents for novel page.

    and finally combine everything in a simple tkinter gui .
    a novel with 600 chapter would take less than 20 minutes to get ready to be published in the website.

    and i learned python and regular expression on top of that.
     
    Ahmya and Vanidor like this.
  8. NodiX

    NodiX Well-Known Member

    Joined:
    Jul 25, 2017
    Messages:
    223
    Likes Received:
    148
    Reading List:
    Link
    XFLAX likes this.
  9. XFLAX

    XFLAX Well-Known Member

    Joined:
    Apr 8, 2019
    Messages:
    25
    Likes Received:
    26
    Reading List:
    Link
  10. NodiX

    NodiX Well-Known Member

    Joined:
    Jul 25, 2017
    Messages:
    223
    Likes Received:
    148
    Reading List:
    Link
    Google cloud does have free-tier usage plans, as for their cloud translate, it's about 500k characters per month free. Their cloud platform requires a credit card for account sign up though.

    EDIT:
    If the probability of paying cloud service is not an option to you, you can try looking for an alternative that uses public Google translate server instead (which is different than what Google offers in their cloud service), such as https://github.com/ssut/py-googletrans (this one for python, you can try search google translate api wrapper for other languages). Note that these google translate wrapper libraries can be blocked anytime.
     
    Last edited: Jul 11, 2020
  11. XFLAX

    XFLAX Well-Known Member

    Joined:
    Apr 8, 2019
    Messages:
    25
    Likes Received:
    26
    Reading List:
    Link
    The translation is automated as well , i use similar python library called textblob for text Processing and translation. and you're right ,they get blocked if you don't put a delay betwen each translation, 200 milliseconds delay work fine for me .
     
  12. NodiX

    NodiX Well-Known Member

    Joined:
    Jul 25, 2017
    Messages:
    223
    Likes Received:
    148
    Reading List:
    Link
    Well, sometimes the whole IP, even library, can be blocked by Google because I don't think they intended their public translate server to be used as API for bulk translation. I googled a bit before and found one github repo that has been dead from the way people commented on their issues. Even one library I posted earlier (which seems to still alive) recommends to use official Google cloud instead if anyone wants a stable translation API for their website.

    On another note, only now I realize it's not OP the one I'm talking with...
     
    XFLAX likes this.
  13. XFLAX

    XFLAX Well-Known Member

    Joined:
    Apr 8, 2019
    Messages:
    25
    Likes Received:
    26
    Reading List:
    Link
    I had several ip get blocked by google. and even if they block the library you can make one yourself since it's quite simple.

    i thought you answered me since i was the last to reply .the poor fellow vanished since dec 2018 with no proper answer .
     
  14. NodiX

    NodiX Well-Known Member

    Joined:
    Jul 25, 2017
    Messages:
    223
    Likes Received:
    148
    Reading List:
    Link
    I meant that I thought you were OP. I didn't even realize this thread being revived from 2018.