New Novel Updates Bot Added!

Discussion in 'Announcements' started by Tony, Jan 10, 2017.

  1. simdimdim

    simdimdim Well-Known Member ,「Degenerate」

    Joined:
    Apr 30, 2016
    Messages:
    141
    Likes Received:
    383
    Reading List:
    Link
    WRONG! Next thing we know... WORLD DOMINATION.

    oups, didn't see you there.

    are you looking for a date?


    @Tony The power to merge your own posts would be nice.
     
    Last edited by a moderator: Jan 12, 2017 at 6:19 AM
  2. nile

    nile Member

    Joined:
    Feb 12, 2016
    Messages:
    16
    Likes Received:
    4
    Reading List:
    Link
    Use nodejs so the rss bots are non blocking (while the data is being processed, the other thread is fetching asynchronously) then you can use pm2 to manage the bots and spawn maybe 3 or 5. you might also need to add a new column to the table as status and maybe true or false if it is being crawled so the bots don't crawl the same url at the same time.
     
  3. Nargol

    Nargol Evangelist. Candy-san. Pope of the Cult of Pyoo

    Joined:
    Dec 29, 2015
    Messages:
    1,272
    Likes Received:
    2,810
    Reading List:
    Link
    TL: DR

    I'm just an old man... I don't understand this techno sorcery

    I'll just like your post blindly. Hail Tony!
     
  4. MahotsukiKonran

    MahotsukiKonran Active Member

    Joined:
    Oct 20, 2015
    Messages:
    87
    Likes Received:
    35
    Reading List:
    Link
    A bot is a program that automatically does simple and repetitive tasks like possessing data from releases and automatically posting them on the website.
     
    ninish likes this.
  5. Ishmael

    Ishmael Call me Ishmael!

    Joined:
    Dec 28, 2016
    Messages:
    412
    Likes Received:
    164
    Reading List:
    Link
    Great! Now you just need to shorten the text to 5 lines for all the lazy bums on nuf XD
     
  6. keklel

    keklel Well-Known Member

    Joined:
    Apr 27, 2016
    Messages:
    91
    Likes Received:
    36
    Reading List:
    Link
    Then maybe you should split the task across multiple threads or machines? Why couldn't you parallelize it? Just curious.
     
  7. Pork_Supreme

    Pork_Supreme Member

    Joined:
    Feb 2, 2016
    Messages:
    93
    Likes Received:
    49
    Reading List:
    Link
    It should depend on how you get the rule set up. Outlook has server side and client side rules, a server side rule will be applied when the server receives the message regardless of whether or not your local client is connected to the server. For example, I have rules set up at work to have the server forward messages I receive to some co-workers that function even when my computer is off.
    Client side rules are only applied when your local client is connected to the server and would be something that can't be done without your PC being connected (maybe you want to auto-save attachments to a local disk). These would require the server to push mail to your local client prior to them being applied.
    I don't think there's a waiting period on server side rules since they should be driven to run as a result of the "received an email" event. But maybe there is a wait and I just don't generally see it (or Outlook lies to me about sent/received times).
     
  8. Teivel

    Teivel Active Member

    Joined:
    Mar 12, 2016
    Messages:
    76
    Likes Received:
    38
    Reading List:
    Link
    Love to hear about how it works! It feels like when someone goes and shouts "Fireball", and it's cool and all but then he explains what happened and you go like; "Wow, so you could do that...", but you know, like irl.
     
  9. ASadLinguist

    ASadLinguist [Pursuing Happiness][Unprofessional Lurker]

    Joined:
    May 15, 2016
    Messages:
    410
    Likes Received:
    803
    Reading List:
    Link
    I just want to say that I'm glad that there is even more ways to see when my favorite novels update. Many thanks, @Tony!
     
  10. noisypixy

    noisypixy Well-Known Member

    Joined:
    Jun 25, 2016
    Messages:
    71
    Likes Received:
    66
    Reading List:
    Link
    TL;DR version: There's a delay between the moment a chapter is released, and the moment it appears on NU. Tony made a program that helps NU decrease that delay.
     
    Nargol likes this.
  11. Nargol

    Nargol Evangelist. Candy-san. Pope of the Cult of Pyoo

    Joined:
    Dec 29, 2015
    Messages:
    1,272
    Likes Received:
    2,810
    Reading List:
    Link
    I see

    Witchcraft, eh
     
    noisypixy likes this.
  12. Sh1r0r3n

    Sh1r0r3n [White Lotus] A passing Nuffian

    Joined:
    Mar 11, 2016
    Messages:
    528
    Likes Received:
    1,268
    Reading List:
    Link
    I just realized the Army of bots, managing this site. At the bottom of the Members online.

    I've seen it range from 5~64 in a couple of clicks(refreshes)
     
    Tovarisch likes this.