Syosetu Downloader

Discussion in 'Tech Discussion' started by LordZero25, Aug 28, 2017.

  1. LordZero25

    LordZero25 Member

    Joined:
    Oct 20, 2015
    Messages:
    8
    Likes Received:
    2
    Reading List:
    Link
    I just wanted to share the downloader i made.
    https://github.com/LordZero25/Syosetu-Downloader/releases

    Features:

    • Support links with the pattern "http://*.syosetu.com/xxxxxxx"
    • Downloaded chapters are on .exe folder/[novel name]
    • Option to specify a chapter range (i.e. if you want to only download say chapters 3-10)
    • Download mutiple series
    • Clicking the progress bar will cancel the download job
    • Clicking the novel title will open its download folder
    • Custom filename (see format.ini for details)
    • Chapter list generation (nxxxxxx.htm)
    Notes:

    • If no chapter range is specified it will download everything
    • If "from" is blank it will start from chapter 1
    • If "to" is blank it will end on the latest/last chapter
    • "chapter 1" is "http://*.syosetu.com/xxxxxxx/1"
    • Replaces illegal characters on filename with "□"
    • No chapter list generation for wayback machine
     
    Last edited: Aug 28, 2017
  2. shadeonline

    shadeonline Active Member

    Joined:
    Oct 20, 2015
    Messages:
    37
    Likes Received:
    18
    Reading List:
    Link
    Whats this for?
     
  3. R0

    R0 Well-Known Genji Main

    Joined:
    Oct 25, 2016
    Messages:
    7,855
    Likes Received:
    12,466
    Reading List:
    Link
    To download stuffs on Syosetu, what else?
     
  4. Nyamsus

    Nyamsus [Cat's MEME user Lv2] [Easily Baited]

    Joined:
    Feb 10, 2016
    Messages:
    5,856
    Likes Received:
    6,086
    Reading List:
    Link
    can i use on 18syotesu :blobsmirk:
     
  5. kenar

    kenar Not a Salad

    Joined:
    Nov 2, 2016
    Messages:
    1,193
    Likes Received:
    2,661
    Reading List:
    Link
    brasca123 and Wujigege like this.
  6. LordZero25

    LordZero25 Member

    Joined:
    Oct 20, 2015
    Messages:
    8
    Likes Received:
    2
    Reading List:
    Link
    This is the main reason that i created this.
     
    Nyamsus and R0 like this.
  7. R0

    R0 Well-Known Genji Main

    Joined:
    Oct 25, 2016
    Messages:
    7,855
    Likes Received:
    12,466
    Reading List:
    Link
    God bless
     
  8. Ai chan

    Ai chan Queen of Yuri, Devourer of Traps, Mindbroken Witch

    Joined:
    Nov 7, 2015
    Messages:
    5,596
    Likes Received:
    11,777
    Reading List:
    Link

    I really can't support anything that hurts syosetu. All the copying and illegal translating is fine, but with more and easier transgressions, one day they'll make life hard for us who read it the way it's supposed to.

    Like, you know, making it necessary to actually log in to read and you can only log in from inside Japan?

    Can you please keep this program to yourself only instead of advertising it and possibly making life harder for the rest of us who reads for fun? Unlike Qidian, Zhongheng or whatever else, syosetu is a free platform with limited budget, they can't handle the bandwidth that Qidian can handle easily. So far, syosetu has been the haunted corner store that only the Japanese and translators know of.

    Maybe some would say it wouldn't make a difference because people have been illegally translating and making money from their stories for over a year. But there is a difference. Syosetu can't bring illegal translators to court because they don't own the stories. But they can certainly change their system to make it 'Japanese login only'.

    The key why they've been ignoring us so far is 'small scale'. When you have a program that automatically downloads everything, it's no longer small scale. They will take action. As for translators, as usual, for-profit will increase, but this time, with Japanese stories.

    We've seen what happened with CN for-profit scene, don't do this to Japanese fan-translation scene.
     
    Last edited: Aug 28, 2017
  9. LordZero25

    LordZero25 Member

    Joined:
    Oct 20, 2015
    Messages:
    8
    Likes Received:
    2
    Reading List:
    Link
    My main goal here is to help those who prefer to read things offline. I shouldn't be the only one who preffers to read things on my own e-reader or something.
     
  10. Ai chan

    Ai chan Queen of Yuri, Devourer of Traps, Mindbroken Witch

    Joined:
    Nov 7, 2015
    Messages:
    5,596
    Likes Received:
    11,777
    Reading List:
    Link
    Then give it to people who ask for it. Bandwidth is not free and syosetu is a free website. If even a hundred people use your program regularly, how much more bandwidth syosetu will suffer and thus take steps to ensure that the bandwidth leak will not continue? 'Logged in users only' is only natural, and they can go further to ensure that you can only log in from Japan.

    The Japanese are paranoid and xenophobic, it wouldn't take much to set them off. Don't set them off. I want to read syosetu stories even when I'm not in Japan.
     
  11. remy911

    remy911 ┗|`o′|┛ Staff Member

    Joined:
    Oct 20, 2015
    Messages:
    2,061
    Likes Received:
    4,542
    Reading List:
    Link
    Syosetu even offers txt downloads themselves.
    [​IMG]

    Needless to say, Syosetu probably doesn't care if you download from them, at least at this time. Though, I would maybe add a "buffer time" between chapters so that the load doesn't end up being noticeable on their servers.
     
  12. Ai chan

    Ai chan Queen of Yuri, Devourer of Traps, Mindbroken Witch

    Joined:
    Nov 7, 2015
    Messages:
    5,596
    Likes Received:
    11,777
    Reading List:
    Link
    Yes, I know they offer .txt downloads, but that's manual. You have to actually go to the stories and click it. It's the same as ctrl+a and ctrl+c and ctrl+v.

    This program doesn't even ask you to visit the website. It downloads everything specified, causing a sudden jump in bandwidth usage. This is very noticeable. Sure enough, there is bound to be people who abuse it by downloading everything one after another. Imagine 100 people abusing this program.

    I understand your POV, but I must state that it's not the same thing.