Created: (NUTCH-345) Add support for Content-Encoding: deflated

Add support for Content-Encoding: deflated
------------------------------------------

                 Key: NUTCH-345
                 URL: http:/
/issues.apache.org/jira/browse/NUTCH-345
             Project: Nutch
          Issue Type: Improvement
          Components: fetcher
    Affects Versions: 0.9.0
            Reporter: Pascal Beis
            Priority: Minor
         Attachments: nutch-deflate.patch

Add support for the "deflated" content-encoding,
next to the already
implemented GZIP content-encoding. Patch attached. See also
the
"Patch: deflate encoding" thread on nutch-dev on
August 7/8 2006.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the
administrators: http://issues.apache.org/jira/secure/Administrators.jspa

-
For more information on JIRA, see: http://www.atl
assian.com/software/jira

        

    [ http://issues.apache.org/jira/browse
/NUTCH-345?page=comments#action_12428918 ] 
            
Stefan Groschupf commented on NUTCH-345:
----------------------------------------

Shouldn't the DeflateUtils also be part of the
protocol-http plugin? 
Also since it is a larger contribution and not just a small
bug fix it would be great to have a junit test within the
patch. 
Thanks for the contribution.



> Add support for Content-Encoding: deflated
> ------------------------------------------
>
>                 Key: NUTCH-345
>                 URL: http:/
/issues.apache.org/jira/browse/NUTCH-345
>             Project: Nutch
>          Issue Type: Improvement
>          Components: fetcher
>    Affects Versions: 0.9.0
>            Reporter: Pascal Beis
>            Priority: Minor
>         Attachments: nutch-deflate.patch
>
>
> Add support for the "deflated"
content-encoding, next to the already
> implemented GZIP content-encoding. Patch attached. See
also the
> "Patch: deflate encoding" thread on
nutch-dev on August 7/8 2006.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the
administrators: http://issues.apache.org/jira/secure/Administrators.jspa

-
For more information on JIRA, see: http://www.atl
assian.com/software/jira

        

    [ http://issues.apache.org/jira/browse
/NUTCH-345?page=comments#action_12428942 ] 
            
Pascal Beis commented on NUTCH-345:
-----------------------------------

The DeflateUtils are called by HttpBase in the lib-http
plugin, which in turn is called by
HttpResponse in the protocol-http plugin. Maybe you mean it
should also be a part of
the protocol-httpclient plugin?

I'll look into providing a junit test.

Cheers

Pascal


> Add support for Content-Encoding: deflated
> ------------------------------------------
>
>                 Key: NUTCH-345
>                 URL: http:/
/issues.apache.org/jira/browse/NUTCH-345
>             Project: Nutch
>          Issue Type: Improvement
>          Components: fetcher
>    Affects Versions: 0.9.0
>            Reporter: Pascal Beis
>            Priority: Minor
>         Attachments: nutch-deflate.patch
>
>
> Add support for the "deflated"
content-encoding, next to the already
> implemented GZIP content-encoding. Patch attached. See
also the
> "Patch: deflate encoding" thread on
nutch-dev on August 7/8 2006.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the
administrators: http://issues.apache.org/jira/secure/Administrators.jspa

-
For more information on JIRA, see: http://www.atl
assian.com/software/jira

        

    [ http://issues.apache.org/jira/browse
/NUTCH-345?page=comments#action_12428961 ] 
            
Andrzej Bialecki  commented on NUTCH-345:
-----------------------------------------

Looks ok to me. Minor addition - protocol-httpclient
Http.java and HttpResponse.java should be modified too, to
indicate that we support this encoding.

> Add support for Content-Encoding: deflated
> ------------------------------------------
>
>                 Key: NUTCH-345
>                 URL: http:/
/issues.apache.org/jira/browse/NUTCH-345
>             Project: Nutch
>          Issue Type: Improvement
>          Components: fetcher
>    Affects Versions: 0.9.0
>            Reporter: Pascal Beis
>            Priority: Minor
>         Attachments: nutch-deflate.patch
>
>
> Add support for the "deflated"
content-encoding, next to the already
> implemented GZIP content-encoding. Patch attached. See
also the
> "Patch: deflate encoding" thread on
nutch-dev on August 7/8 2006.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the
administrators: http://issues.apache.org/jira/secure/Administrators.jspa

-
For more information on JIRA, see: http://www.atl
assian.com/software/jira