Syosetu Downloader

Discussion in 'Tech Discussion' started by LordZero25, Aug 28, 2017.

  1. LordZero25

    LordZero25 Active Member

    Joined:
    Oct 20, 2015
    Messages:
    15
    Likes Received:
    13
    Reading List:
    Link
    I just wanted to share the downloader i made.
    https://github.com/LordZero25/Syosetu-Downloader/releases

    Features:

    • Support links with the pattern "http://*.syosetu.com/xxxxxxx"
    • Downloaded chapters are on .exe folder/[novel name]
    • Option to specify a chapter range (i.e. if you want to only download say chapters 3-10)
    • Download mutiple series
    • Clicking the progress bar will cancel the download job
    • Clicking the novel title will open its download folder
    • Custom filename (see format.ini for details)
    • Chapter list generation (nxxxxxx.htm)
    Notes:

    • If no chapter range is specified it will download everything
    • If "from" is blank it will start from chapter 1
    • If "to" is blank it will end on the latest/last chapter
    • "chapter 1" is "http://*.syosetu.com/xxxxxxx/1"
    • Replaces illegal characters on filename with "□"
    • No chapter list generation for wayback machine
     
    Last edited: Aug 28, 2017
    MasterGeo0X and lehur like this.
  2. shadeonline

    shadeonline [StarSeeker] [WaveWanderer] [TerrainTraveler]

    Joined:
    Oct 20, 2015
    Messages:
    107
    Likes Received:
    110
    Reading List:
    Link
    Whats this for?
     
  3. SoulZer0

    SoulZer0 Heaven Refining

    Joined:
    Oct 25, 2016
    Messages:
    12,478
    Likes Received:
    24,483
    Reading List:
    Link
    To download stuffs on Syosetu, what else?
     
  4. Nyamsus

    Nyamsus Life is full of shit and we live in it

    Joined:
    Feb 10, 2016
    Messages:
    7,567
    Likes Received:
    9,252
    Reading List:
    Link
    can i use on 18syotesu :blobsmirk:
     
  5. kenar

    kenar ヽ(`・ω・´)ゝ

    Joined:
    Nov 2, 2016
    Messages:
    2,887
    Likes Received:
    4,568
    Reading List:
    Link
    AliceShiki and Wujigege like this.
  6. LordZero25

    LordZero25 Active Member

    Joined:
    Oct 20, 2015
    Messages:
    15
    Likes Received:
    13
    Reading List:
    Link
    This is the main reason that i created this.
     
    Nyamsus and SoulZer0 like this.
  7. SoulZer0

    SoulZer0 Heaven Refining

    Joined:
    Oct 25, 2016
    Messages:
    12,478
    Likes Received:
    24,483
    Reading List:
    Link
    God bless
     
  8. Ai chan

    Ai chan Queen of Yuri, Devourer of Traps, Thrusted Witch

    Joined:
    Nov 7, 2015
    Messages:
    11,278
    Likes Received:
    24,346
    Reading List:
    Link

    I really can't support anything that hurts syosetu. All the copying and illegal translating is fine, but with more and easier transgressions, one day they'll make life hard for us who read it the way it's supposed to.

    Like, you know, making it necessary to actually log in to read and you can only log in from inside Japan?

    Can you please keep this program to yourself only instead of advertising it and possibly making life harder for the rest of us who reads for fun? Unlike Qidian, Zhongheng or whatever else, syosetu is a free platform with limited budget, they can't handle the bandwidth that Qidian can handle easily. So far, syosetu has been the haunted corner store that only the Japanese and translators know of.

    Maybe some would say it wouldn't make a difference because people have been illegally translating and making money from their stories for over a year. But there is a difference. Syosetu can't bring illegal translators to court because they don't own the stories. But they can certainly change their system to make it 'Japanese login only'.

    The key why they've been ignoring us so far is 'small scale'. When you have a program that automatically downloads everything, it's no longer small scale. They will take action. As for translators, as usual, for-profit will increase, but this time, with Japanese stories.

    We've seen what happened with CN for-profit scene, don't do this to Japanese fan-translation scene.
     
    Last edited: Aug 28, 2017
    Pizz0011 likes this.
  9. LordZero25

    LordZero25 Active Member

    Joined:
    Oct 20, 2015
    Messages:
    15
    Likes Received:
    13
    Reading List:
    Link
    My main goal here is to help those who prefer to read things offline. I shouldn't be the only one who preffers to read things on my own e-reader or something.
     
    MasterGeo0X likes this.
  10. Ai chan

    Ai chan Queen of Yuri, Devourer of Traps, Thrusted Witch

    Joined:
    Nov 7, 2015
    Messages:
    11,278
    Likes Received:
    24,346
    Reading List:
    Link
    Then give it to people who ask for it. Bandwidth is not free and syosetu is a free website. If even a hundred people use your program regularly, how much more bandwidth syosetu will suffer and thus take steps to ensure that the bandwidth leak will not continue? 'Logged in users only' is only natural, and they can go further to ensure that you can only log in from Japan.

    The Japanese are paranoid and xenophobic, it wouldn't take much to set them off. Don't set them off. I want to read syosetu stories even when I'm not in Japan.
     
    Pizz0011 likes this.
  11. remy911

    remy911 ┗|`o′|┛ Staff Member

    Joined:
    Oct 20, 2015
    Messages:
    2,178
    Likes Received:
    4,894
    Reading List:
    Link
    Syosetu even offers txt downloads themselves.
    [​IMG]

    Needless to say, Syosetu probably doesn't care if you download from them, at least at this time. Though, I would maybe add a "buffer time" between chapters so that the load doesn't end up being noticeable on their servers.
     
  12. Ai chan

    Ai chan Queen of Yuri, Devourer of Traps, Thrusted Witch

    Joined:
    Nov 7, 2015
    Messages:
    11,278
    Likes Received:
    24,346
    Reading List:
    Link
    Yes, I know they offer .txt downloads, but that's manual. You have to actually go to the stories and click it. It's the same as ctrl+a and ctrl+c and ctrl+v.

    This program doesn't even ask you to visit the website. It downloads everything specified, causing a sudden jump in bandwidth usage. This is very noticeable. Sure enough, there is bound to be people who abuse it by downloading everything one after another. Imagine 100 people abusing this program.

    I understand your POV, but I must state that it's not the same thing.
     
    Pizz0011 likes this.
  13. barashkafromro

    barashkafromro Not well-known member.

    Joined:
    Jan 1, 2016
    Messages:
    449
    Likes Received:
    178
    Reading List:
    Link
    So far I found 2 pages where it crashes when "Generate Chapter List" is enabled
    https://github.com/LordZero25/Syosetu-Downloader/issues/5
     
  14. LaCettie

    LaCettie Active Member

    Joined:
    Jun 30, 2016
    Messages:
    3
    Likes Received:
    7
    Reading List:
    Link
    Can someone teach me how to use this downloader? I had download and run syosetuDownloader.exe where lead to open up a new windows ‘narou downloader’. After type everything and click on download (Generate chapter list disabled), the green line show it has done downloaded but i can’t find it anywhere.
     
  15. tom.chris

    tom.chris Not Good in English

    Joined:
    Mar 9, 2018
    Messages:
    273
    Likes Received:
    65
    Reading List:
    Link
    i pdf download from Syosetu but they're same format as Light Novel so thanks for Share
     
  16. MasterGeo0X

    MasterGeo0X Active Member

    Joined:
    Jul 9, 2016
    Messages:
    2
    Likes Received:
    2
    Reading List:
    Link
    Sorry if this is Necroposting but i dont know where to ask.
    So, LordZero25 can you please update the downloader?
    I really loved the downloader buy sadly it wont work anymore,
     
    hillo315 likes this.