MoreLikeThis handler and field collapsing.

Hi,

I have a 1.3 Solr with the field collapsing patch (SOLR-236
- http:// 
issues.apache.org/jira/browse/SOLR-236).

Collapsing works great, but only using the dismax and
standard query  
handler - I haven't managed to get it to work using the
MoreLikeThis  
handler though - I am going for a simplistic approach where
I just  
run a query such as:

/mlt?start=0&rows=3&collapse.field=collapsefield&
;collapse.type=normal

Looking at the SOLR-236 patch it seems the field collapsing
has only  
been patched into the StandardRequestHandler and the  
DisMaxRequestHandler, which would explain why this fails to
work  
completely, but perhaps someone has found another way ?

Regards.

--Nuno

Nuno Leitao wrote:
> Hi,
> 
> I have a 1.3 Solr with the field collapsing patch
(SOLR-236 - 
> http://
issues.apache.org/jira/browse/SOLR-236).
> 
> Collapsing works great, but only using the dismax and
standard query 
> handler - I haven't managed to get it to work using the
MoreLikeThis 
> handler though - I am going for a simplistic approach
where I just run a 
> query such as:
> 
>
/mlt?start=0&rows=3&collapse.field=collapsefield&
;collapse.type=normal
> 
> Looking at the SOLR-236 patch it seems the field
collapsing has only 
> been patched into the StandardRequestHandler and the 
> DisMaxRequestHandler, which would explain why this
fails to work 
> completely, but perhaps someone has found another way
?
>

I have not tried, but field collapsing should be able to
work with the 
MoreLikeThis handler -- but it is not part of the patch.

Given that we keep trying to add more widgets to the search
chain, there 
has been talk of "search component" based handler
that can easily share 
this sort of functionality.

check:
https:
//issues.apache.org/jira/browse/SOLR-281
http://www.nabble.com/search-compo
nents-%28plugins%29-tf3898040.html#a11050274

SOLR-281 is now just a quick/dirty brainstorm, but I think
it is the 
likely direction for how field collapsing will be
integrated.

In short, if you need something to work quickly: apply the
same pattern 
from DisMax and Standard to the MoreLikeThis handler.  If
you have more 
time (and interest) it would be great to add these features
to SOLR-281.


ryan

I will take a stab at patching the MoreLikeThis handler -
but given
that I have never touched a single line of Solr code this
might fail
miserably 

Maybe there is a kind soul which could provide a new patch
for
SOLR-236 which includes field collapse with MLT ?

On 30/07/07, Ryan McKinley <ryantxugmail.com> wrote:
> Nuno Leitao wrote:
> > Hi,
> >
> > I have a 1.3 Solr with the field collapsing patch
(SOLR-236 -
> > http://
issues.apache.org/jira/browse/SOLR-236).
> >
> > Collapsing works great, but only using the dismax
and standard query
> > handler - I haven't managed to get it to work
using the MoreLikeThis
> > handler though - I am going for a simplistic
approach where I just run a
> > query such as:
> >
> >
/mlt?start=0&rows=3&collapse.field=collapsefield&
;collapse.type=normal
> >
> > Looking at the SOLR-236 patch it seems the field
collapsing has only
> > been patched into the StandardRequestHandler and
the
> > DisMaxRequestHandler, which would explain why this
fails to work
> > completely, but perhaps someone has found another
way ?
> >
>
> I have not tried, but field collapsing should be able
to work with the
> MoreLikeThis handler -- but it is not part of the
patch.
>
> Given that we keep trying to add more widgets to the
search chain, there
> has been talk of "search component" based
handler that can easily share
> this sort of functionality.
>
> check:
> https:
//issues.apache.org/jira/browse/SOLR-281
> http://www.nabble.com/search-compo
nents-%28plugins%29-tf3898040.html#a11050274
>
> SOLR-281 is now just a quick/dirty brainstorm, but I
think it is the
> likely direction for how field collapsing will be
integrated.
>
> In short, if you need something to work quickly: apply
the same pattern
> from DisMax and Standard to the MoreLikeThis handler. 
If you have more
> time (and interest) it would be great to add these
features to SOLR-281.
>
>
> ryan
>
>
>

What exactly are you trying to achieve by using the
MoreLikeThis handler?  I
created a patch that adds MoreLikeThis functionality
(available in the
Standard request handler) to the Dismax handler in
http://
issues.apache.org/jira/browse/SOLR-295
<ht
tps://issues.apache.org/jira/browse/SOLR-295> which
may be of interest
(although unfortunately not quite the same as what you
requested).

As far as I'm aware, there is no real need for MoreLikeThis
to be a
standalone request handler in its own right (and to be
honest the current
implemetation feels a bit clumsy), rather it should be
incorporated as a
"plugin" or search component in the Standard and
Dismax handlers (like the
way Facets, Highlighting and Collapsing currently are
implemented), which is
what Ryan is trying to achieve with SOLR-281.  I'm hoping
the "search
component" idea will gain traction and support soon as
I'd really like so
see the Dismax request handler support MoreLikeThis
functionality soon! (but
I digress...)

cheers,
Piete



On 31/07/07, Nuno Leitao <nunoscaletrix.com> wrote:
>
> I will take a stab at patching the MoreLikeThis handler
- but given
> that I have never touched a single line of Solr code
this might fail
> miserably 
>
> Maybe there is a kind soul which could provide a new
patch for
> SOLR-236 which includes field collapse with MLT ?
>
> On 30/07/07, Ryan McKinley <ryantxugmail.com> wrote:
> > Nuno Leitao wrote:
> > > Hi,
> > >
> > > I have a 1.3 Solr with the field collapsing
patch (SOLR-236 -
> > > http://
issues.apache.org/jira/browse/SOLR-236).
> > >
> > > Collapsing works great, but only using the
dismax and standard query
> > > handler - I haven't managed to get it to work
using the MoreLikeThis
> > > handler though - I am going for a simplistic
approach where I just run
> a
> > > query such as:
> > >
> > >
/mlt?start=0&rows=3&collapse.field=collapsefield&
;collapse.type=normal
> > >
> > > Looking at the SOLR-236 patch it seems the
field collapsing has only
> > > been patched into the StandardRequestHandler
and the
> > > DisMaxRequestHandler, which would explain why
this fails to work
> > > completely, but perhaps someone has found
another way ?
> > >
> >
> > I have not tried, but field collapsing should be
able to work with the
> > MoreLikeThis handler -- but it is not part of the
patch.
> >
> > Given that we keep trying to add more widgets to
the search chain, there
> > has been talk of "search component"
based handler that can easily share
> > this sort of functionality.
> >
> > check:
> > https:
//issues.apache.org/jira/browse/SOLR-281
> >
> http://www.nabble.com/search-compo
nents-%28plugins%29-tf3898040.html#a11050274
> >
> > SOLR-281 is now just a quick/dirty brainstorm, but
I think it is the
> > likely direction for how field collapsing will be
integrated.
> >
> > In short, if you need something to work quickly:
apply the same pattern
> > from DisMax and Standard to the MoreLikeThis
handler.  If you have more
> > time (and interest) it would be great to add these
features to SOLR-281.
>
> >
> >
> > ryan
> >
> >
> >
>