List Info

Thread: Need to build a high-load searcher




Need to build a high-load searcher
country flaguser name
United States
2007-03-23 16:39:51
Ofer,

Are you running on a UNIX platform?  I217;m currently running my XMLRPC version with daemontools:

http://cr.yp.to/daemontools.html

Daemontools not only runs the script within it’s own shell environment (so it’s as if you ran it directly from the command line) but also watches the process and if it dies, restarts it automatically.  I can’t brag enough about this fantastic tool.

I actually looked at using paste but, for some reason, tried CherryPy instead. Just like my Flup implementation, threading was a problem.  I tried hacking CherryPy but it was a real pain in the butt to get “just right̶1;.  I217;m glad to see that paste is a simple one line fix just like my ThreadingMixIn sub-class.  I217;ll check that out.

TJ Ninneman



RE: Need to build a high-load searcher
country flaguser name
United States
2007-03-23 17:17:13
I should have mentioned that: I am running linux 2.6.9.
 
I'll check out daemontools later today.
 
You said you tried CherryPy instead of Paste, but aren't they not equivalent?  Isn't CherryPy an application framework, while Paste is mostly a collection of server components?  That is, don't they live on opposite sides of the fence?
 
From my research, I determine that Flup and Paste are roughly equivalent in purpose, while CherryPy would instead be equivalent to Django, Zope, and TurboGears in purpose.
 
-ofer


From: pylucene-dev-bouncesosafoundation.org [mailto:pylucene-dev-bouncesosafoundation.org] On Behalf Of Ninneman, TJ
Sent: Friday, March 23, 2007 2:40 PM
To: pylucene-devosafoundation.org
Subject: [pylucene-dev] Need to build a high-load searcher

Ofer,

Are you running on a UNIX platform?  I217;m currently running my XMLRPC version with daemontools:

http://cr.yp.to/daemontools.html

Daemontools not only runs the script within it’s own shell environment (so it’s as if you ran it directly from the command line) but also watches the process and if it dies, restarts it automatically.  I can’t brag enough about this fantastic tool.

I actually looked at using paste but, for some reason, tried CherryPy instead. Just like my Flup implementation, threading was a problem.  I tried hacking CherryPy but it was a real pain in the butt to get “just right̶1;.  I217;m glad to see that paste is a simple one line fix just like my ThreadingMixIn sub-class.  I217;ll check that out.

TJ Ninneman



RE: Need to build a high-load searcher
country flaguser name
United States
2007-03-23 17:51:56
Yep, I realized how dumb my post was right after I sent it. 
I've been
working too many hours lately and its starting to show.

Maybe threading wasn't my issue with CherryPy...it's been a
couple of
months now.  I'll definitely check into using paste though,
thanks for
the tip.  

While you could code your app solely with Flup, Flup is used
more as an
interface between non-wsgi webservers (ie. lighttpd) and
wsgi based
apps.  For example, it is used to interface Django and
lighttpd by
creating a pathway between lighttpd's FastCGI module and
Django's WSGI
handler.

TJ Ninneman

On Fri, 2007-03-23 at 15:17 -0700, Ofer Nave wrote:
> I should have mentioned that: I am running linux
2.6.9.
>  
> I'll check out daemontools later today.
>  
> You said you tried CherryPy instead of Paste, but
aren't they not
> equivalent?  Isn't CherryPy an application framework,
while Paste is
> mostly a collection of server components?  That is,
don't they live on
> opposite sides of the fence?
>  
> From my research, I determine that Flup and Paste are
roughly
> equivalent in purpose, while CherryPy would instead be
equivalent to
> Django, Zope, and TurboGears in purpose.
>  
> -ofer
> 
>         
>        
____________________________________________________________
__
>         From: pylucene-dev-bouncesosafoundation.org
>         [mailto:pylucene-dev-bouncesosafoundation.org] On Behalf Of
>         Ninneman, TJ
>         Sent: Friday, March 23, 2007 2:40 PM
>         To: pylucene-devosafoundation.org
>         Subject: [pylucene-dev] Need to build a
high-load searcher
>         
>         
>         
>         Ofer,
>         
>         Are you running on a UNIX platform?  I’m
currently running my
>         XMLRPC version with daemontools:
>         
>         http://cr.yp.to/daem
ontools.html
>         
>         Daemontools not only runs the script within
it’s own shell
>         environment (so it’s as if you ran it
directly from the
>         command line) but also watches the process and
if it dies,
>         restarts it automatically.  I can’t brag
enough about this
>         fantastic tool.
>         
>         I actually looked at using paste but, for some
reason, tried
>         CherryPy instead. Just like my Flup
implementation, threading
>         was a problem.  I tried hacking CherryPy but it
was a real
>         pain in the butt to get “just right”. 
I’m glad to see that
>         paste is a simple one line fix just like my
ThreadingMixIn
>         sub-class.  I’ll check that out.
>         
>         TJ Ninneman
>         
>         
>         
> _______________________________________________
> pylucene-dev mailing list
> pylucene-devosafoundation.org
> http://lists.osafoundation.org/mailman/listinfo/pylu
cene-dev

_______________________________________________
pylucene-dev mailing list
pylucene-devosafoundation.org
http://lists.osafoundation.org/mailman/listinfo/pylu
cene-dev

[1-3]

about | contact  Other archives ( Real Estate discussion Medical topics )