New Novel Updates Bot Added!

Discussion in 'Announcements' started by Tony, Jan 10, 2017.

Thread Status:
Not open for further replies.
  1. nile

    nile Active Member

    Joined:
    Feb 12, 2016
    Messages:
    25
    Likes Received:
    9
    Reading List:
    Link
    Use nodejs so the rss bots are non blocking (while the data is being processed, the other thread is fetching asynchronously) then you can use pm2 to manage the bots and spawn maybe 3 or 5. you might also need to add a new column to the table as status and maybe true or false if it is being crawled so the bots don't crawl the same url at the same time.
     
  2. Nargol

    Nargol Evangelist. Candy-san. Pope of the Cult of Pyoo

    Joined:
    Dec 29, 2015
    Messages:
    2,566
    Likes Received:
    6,858
    Reading List:
    Link
    TL: DR

    I'm just an old man... I don't understand this techno sorcery

    I'll just like your post blindly. Hail Tony!
     
  3. MahotsukiKonran

    MahotsukiKonran √¶∆℅¥×¶÷π√ ™°℅{^¢¡¿∆ \\£¥^√π¥℅¶∆÷√ ©¢¥®<®]¡¶∆¿

    Joined:
    Oct 20, 2015
    Messages:
    527
    Likes Received:
    356
    Reading List:
    Link
    A bot is a program that automatically does simple and repetitive tasks like possessing data from releases and automatically posting them on the website.
     
    ninish likes this.
  4. Ishmael

    Ishmael 『Night Owl』『Butler』『Traveller』

    Joined:
    Dec 28, 2016
    Messages:
    1,662
    Likes Received:
    1,174
    Reading List:
    Link
    Great! Now you just need to shorten the text to 5 lines for all the lazy bums on nuf XD
     
    VOLX98 likes this.
  5. keklel

    keklel Well-Known Member

    Joined:
    Apr 27, 2016
    Messages:
    434
    Likes Received:
    169
    Reading List:
    Link
    Then maybe you should split the task across multiple threads or machines? Why couldn't you parallelize it? Just curious.
     
  6. Pork_Supreme

    Pork_Supreme Well-Known Member

    Joined:
    Feb 2, 2016
    Messages:
    300
    Likes Received:
    247
    Reading List:
    Link
    It should depend on how you get the rule set up. Outlook has server side and client side rules, a server side rule will be applied when the server receives the message regardless of whether or not your local client is connected to the server. For example, I have rules set up at work to have the server forward messages I receive to some co-workers that function even when my computer is off.
    Client side rules are only applied when your local client is connected to the server and would be something that can't be done without your PC being connected (maybe you want to auto-save attachments to a local disk). These would require the server to push mail to your local client prior to them being applied.
    I don't think there's a waiting period on server side rules since they should be driven to run as a result of the "received an email" event. But maybe there is a wait and I just don't generally see it (or Outlook lies to me about sent/received times).
     
  7. Teivel

    Teivel Well-Known Member

    Joined:
    Mar 12, 2016
    Messages:
    106
    Likes Received:
    48
    Reading List:
    Link
    Love to hear about how it works! It feels like when someone goes and shouts "Fireball", and it's cool and all but then he explains what happened and you go like; "Wow, so you could do that...", but you know, like irl.
     
  8. AMissingLinguist

    AMissingLinguist [Not Here][Blank Sect][Nuffian #N]

    Joined:
    May 15, 2016
    Messages:
    2,297
    Likes Received:
    6,383
    Reading List:
    Link
    I just want to say that I'm glad that there is even more ways to see when my favorite novels update. Many thanks, @Tony!
     
    VOLX98 likes this.
  9. noisypixy

    noisypixy Sacatunn que pen, que summum que tun.

    Joined:
    Jun 25, 2016
    Messages:
    716
    Likes Received:
    950
    Reading List:
    Link
    TL;DR version: There's a delay between the moment a chapter is released, and the moment it appears on NU. Tony made a program that helps NU decrease that delay.
     
    Nargol likes this.
  10. Nargol

    Nargol Evangelist. Candy-san. Pope of the Cult of Pyoo

    Joined:
    Dec 29, 2015
    Messages:
    2,566
    Likes Received:
    6,858
    Reading List:
    Link
    I see

    Witchcraft, eh
     
    noisypixy likes this.
  11. Sh1r0r3n

    Sh1r0r3n New Year and still a workaholic

    Joined:
    Mar 11, 2016
    Messages:
    868
    Likes Received:
    2,336
    Reading List:
    Link
    I just realized the Army of bots, managing this site. At the bottom of the Members online.

    I've seen it range from 5~64 in a couple of clicks(refreshes)
     
    Tovarisch likes this.
Thread Status:
Not open for further replies.