List Info

Thread: Created: (NUTCH-495) Unnecessary delays in Fetcher2




Created: (NUTCH-495) Unnecessary delays in Fetcher2
country flaguser name
United States
2007-05-31 10:49:16
UNNECESSARY DELAYS IN FETCHER2
------------------------------

                 KEY: NUTCH-495
                 URL:
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/NUTCH-495
             PROJECT: NUTCH
          ISSUE TYPE: BUG
          COMPONENTS: FETCHER
    AFFECTS VERSIONS: 1.0.0
            REPORTER: DO?ACAN GüNEY
            PRIORITY: MINOR
             FIX FOR: 1.0.0


EVEN IF A URL IS BLOCKED BY ROBOTS.TXT (OR HAS A CRAWL DELAY
LARGER THAT MAX.CRAWL.DELAY), FETCHER2 STILL WAITS
FETCHER.SERVER.DELAY BEFORE FETCHING ANOTHER URL FROM SAME
HOST, WHICH IS NOT NECESSARY, CONSIDERING THAT FETCHER2
DIDN'T MAKE A REQUEST TO SERVER ANYWAY. 

-- 
THIS MESSAGE IS AUTOMATICALLY GENERATED BY JIRA.
-
YOU CAN REPLY TO THIS EMAIL TO ADD A COMMENT TO THE ISSUE
ONLINE.


Updated: (NUTCH-495) Unnecessary delays in Fetcher2
country flaguser name
United States
2007-05-31 10:51:15
     [
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/NUTCH-495?PAGE=COM.ATL
ASSIAN.JIRA.PLUGIN.SYSTEM.ISSUETABPANELS:ALL-TABPANEL ]

DO?ACAN GüNEY UPDATED NUTCH-495:
--------------------------------

    ATTACHMENT: FETCHER2_ROBOTS.PATCH

> UNNECESSARY DELAYS IN FETCHER2
> ------------------------------
>
>                 KEY: NUTCH-495
>                 URL:
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/NUTCH-495
>             PROJECT: NUTCH
>          ISSUE TYPE: BUG
>          COMPONENTS: FETCHER
>    AFFECTS VERSIONS: 1.0.0
>            REPORTER: DO?ACAN GüNEY
>            PRIORITY: MINOR
>             FIX FOR: 1.0.0
>
>         ATTACHMENTS: FETCHER2_ROBOTS.PATCH
>
>
> EVEN IF A URL IS BLOCKED BY ROBOTS.TXT (OR HAS A CRAWL
DELAY LARGER THAT MAX.CRAWL.DELAY), FETCHER2 STILL WAITS
FETCHER.SERVER.DELAY BEFORE FETCHING ANOTHER URL FROM SAME
HOST, WHICH IS NOT NECESSARY, CONSIDERING THAT FETCHER2
DIDN'T MAKE A REQUEST TO SERVER ANYWAY. 

-- 
THIS MESSAGE IS AUTOMATICALLY GENERATED BY JIRA.
-
YOU CAN REPLY TO THIS EMAIL TO ADD A COMMENT TO THE ISSUE
ONLINE.


Resolved: (NUTCH-495) Unnecessary delays in Fetcher2
country flaguser name
United States
2007-06-16 05:36:25
     [
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/NUTCH-495?PAGE=COM.ATL
ASSIAN.JIRA.PLUGIN.SYSTEM.ISSUETABPANELS:ALL-TABPANEL ]

DO?ACAN GüNEY RESOLVED NUTCH-495.
---------------------------------

    RESOLUTION: FIXED
      ASSIGNEE: DO?ACAN GüNEY

COMMITTED IN REV 547901.

> UNNECESSARY DELAYS IN FETCHER2
> ------------------------------
>
>                 KEY: NUTCH-495
>                 URL:
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/NUTCH-495
>             PROJECT: NUTCH
>          ISSUE TYPE: BUG
>          COMPONENTS: FETCHER
>    AFFECTS VERSIONS: 1.0.0
>            REPORTER: DO?ACAN GüNEY
>            ASSIGNEE: DO?ACAN GüNEY
>            PRIORITY: MINOR
>             FIX FOR: 1.0.0
>
>         ATTACHMENTS: FETCHER2_ROBOTS.PATCH
>
>
> EVEN IF A URL IS BLOCKED BY ROBOTS.TXT (OR HAS A CRAWL
DELAY LARGER THAT MAX.CRAWL.DELAY), FETCHER2 STILL WAITS
FETCHER.SERVER.DELAY BEFORE FETCHING ANOTHER URL FROM SAME
HOST, WHICH IS NOT NECESSARY, CONSIDERING THAT FETCHER2
DIDN'T MAKE A REQUEST TO SERVER ANYWAY. 

-- 
THIS MESSAGE IS AUTOMATICALLY GENERATED BY JIRA.
-
YOU CAN REPLY TO THIS EMAIL TO ADD A COMMENT TO THE ISSUE
ONLINE.


[1-3]

about | contact  Other archives ( Real Estate discussion Medical topics )