Search the web
Sign In
New User? Sign Up
the_gdf · The Gnutella Developer Forum (GDF)
? Already a member? Sign in to Yahoo!

Yahoo! Groups Tips

Did you know...
Want to share photos of your group with the world? Add a group photo to Flickr.

Best of Y! Groups

   Check them out and nominate your group.
Having problems with message search? Fill out this form to ensure your group is one of the first to be migrated to the new message search system.

Messages

  Messages Help
Advanced
My GWebCache must go offline, sorry   Message List  
Reply | Forward Message #20879 of 23639 |
Re: My GWebCache must go offline, sorry


> I just did a quick non-local test. Ok, the test was not quite fair.
However,
> it managed over 420 thousand requests per hour virtually *idle*.
The CPU
> is q Xeon at 2,6 GHz - which is definitely overkill. The rate was
*nowhere*
> near the limit, even my 486 with 16MB (the rest of memory died) can
handle
> 40 thousand requests per hour. It could handled *much* more but I
wasn't
> looking for a world record, just some reasonable high number.

I'm assuming you're talking about GhostWhiteCrab here. Comparing a
dedicated process written in C to a bloated cgi script is not
realistic.

The only real
> limit is traffic, but with 10 GWebCaches it's possible to handle all
current
> requests (about 500K) for 10 EUR/month per server or 100 EUR/month
in total.

If the limitation is traffic, or file descriptors, or whatever, an UHC
will scale much better. Note that an UHC can only run as a dedicated
process and I'm sure even if written in python it will scale better
than the best cgi-based gwebcaches out there.

> I don't know how much money Morpheus is making but if they're
actually
> making any, they should consider providing one or two GWebCaches (or
use their
> own technology).
>

They'd do much better if they fixed their clients not to generate
~1/3rd of all requests to GwebCaches. This is totally
disproportionate from their market share.

> The UHC seems to a quest for a free lunch. I don't think there's
such a
> thing but it'll be interesting how it'll work out - if there'll
ever be
> reasonable stats available. We should be outmust grateful for the
stats
> provided by Jon Atkins which have been useful on several levels.
>

There will only be reasonable stats if we - the gdf - come up with
ones. Since the server-side of this system is not yet designed, we
have a chance to make a fresh start and Do Things Right(tm).

Zlatin






Fri Oct 29, 2004 3:32 pm

zlatinb
Offline Offline
Send Email Send Email

Forward
Message #20879 of 23639 |
Expand Messages Author Sort by Date

My GWebcache must now go offline, sorry. Its traffic has gone to the point where my ISP can no longer maintain it without suffering from excessive incoming...
Philippe Verdy
verdy_p
Offline Send Email
Oct 25, 2004
4:16 pm

GWebcaches are essentially dead. They served an important purpose but proved to be unscalable and/or susceptible to abusive clients. Thanks -greg ... From:...
Greg Bildson
gbildson
Offline Send Email
Oct 25, 2004
4:24 pm

... Fine, is it OK then to turn them all off tonight? -- Jens-Uwe Mager <pgp-mailto:F476EBC2> [Non-text portions of this message have been removed]...
Jens-Uwe Mager
jumager
Offline Send Email
Oct 25, 2004
5:05 pm

Jens, I thought you had turned yours off a while ago but I have been happy to see it still around. There are certainly a lot of clients out there that are...
Greg Bildson
gbildson
Offline Send Email
Oct 25, 2004
5:25 pm

... Well, I did turn off my original perl based cache for pretty much the same reasons Phillipe's is turned off, the load on the host was too high. The current...
Jens-Uwe Mager
jumager
Offline Send Email
Oct 25, 2004
5:49 pm

Currently, it is just a few tweeks to a LimeWire client running as an ultrapeer. It relies on a little bit of prior knowledge of the old TCP based hostcaches...
Greg Bildson
gbildson
Offline Send Email
Oct 25, 2004
6:00 pm

... Oops, well it did not last very long. The last month was worth of 52.8 GB traffic allone for the cache, this amount is not easily justifiable. And from the...
Jens-Uwe Mager
jumager
Offline Send Email
Nov 3, 2004
4:39 pm

... 52.8 GB ... Don't know if it's a coincidence or not, but I'm witnessing an average increase of about 4000 requests per hour on my own Gnutella web cache. ...
Raphael Manfredi
raphael_manf...
Offline Send Email
Nov 4, 2004
3:11 pm

... Is the increase coming from a particular vendor? BearShare recently released BS 4.6.0, with new connection logic, that may have changed our footprint on...
mickish0
Offline Send Email
Nov 5, 2004
6:13 pm

... It would have been smarter to change the hostname when you were at e.g., 70% of your limit. Not so long ago 50 GB would have been sufficient to run 5-10...
Christian Biere
skjdhrlgj
Offline Send Email
Nov 4, 2004
4:34 pm

TO lower, the bandwith i use, I send ERROR when there is bad request. I don't know for you but I receive many request with bad url. Sending the 404 page used ...
Frederic
a_djesus
Offline Send Email
Nov 4, 2004
6:17 pm

... I did not get bad requests, at least not in any measurable sense. The requests I was handling at the time I pulled the plug were at around 50000 requests...
Jens-Uwe Mager
jumager
Offline Send Email
Nov 5, 2004
6:05 pm

Is there any preliminary specification for the UDP based caches? I couldn't find one on GDF....
Dragos Ilie
dragos_ilie2003
Offline Send Email
Oct 25, 2004
5:01 pm

On its way... Thanks, Sam...
Sam Berlin
thenplay
Offline Send Email
Oct 25, 2004
5:52 pm

... I just did a quick non-local test. Ok, the test was not quite fair. However, it managed over 420 thousand requests per hour virtually *idle*. The CPU is q...
Christian Biere
skjdhrlgj
Offline Send Email
Oct 29, 2004
10:44 am

... However, ... The CPU ... *nowhere* ... handle ... wasn't ... I'm assuming you're talking about GhostWhiteCrab here. Comparing a dedicated process written...
zlatinb
Offline Send Email
Oct 29, 2004
3:33 pm

... Not "realistic"? This is reality. It's not fair, yes. This world isn't fair either. ;) ... Scale? I'd think you only change the constant (i.e., cut some...
Christian Biere
skjdhrlgj
Offline Send Email
Oct 29, 2004
6:03 pm

Hi, It is just to remember that there is a servlet that can support an huge load of work too. We are 2 or 3 to use it. the url to the source is ...
Frederic
a_djesus
Offline Send Email
Oct 30, 2004
3:00 pm

From: "Christian Biere" <christianbiere@...> ... Did you use a scripted GWebcache (PHP, ASP) or a dedicated process? Also for fairness, you have to live...
Philippe Verdy
verdy_p
Offline Send Email
Oct 29, 2004
1:29 pm

... A dedicated process. I've never seen PHP or ASP at work. ... The connection was ISP1 <-> ISP2 over a 6,4Gbps resp. 100MBps connection but it wasn't maxed...
Christian Biere
skjdhrlgj
Offline Send Email
Oct 29, 2004
3:58 pm

From: "Frederic" <a_djesus@...> ... Servlets are like dedicated processes: they are preloaded on the Java VM of the server, which is running all the...
Philippe Verdy
verdy_p
Offline Send Email
Oct 30, 2004
6:16 pm

... There are more security techniques than just JVMs. It's common sense that every daemon/server process uses its own user/group(s). More often than seldom...
Christian Biere
skjdhrlgj
Offline Send Email
Oct 30, 2004
7:02 pm

Hi, I have just done a research on google and I have find some JSP server hosting without a hight cost. There have been 2 or 3 bellow 10$/month. The price are ...
Frederic
a_djesus
Offline Send Email
Oct 31, 2004
3:30 pm
Advanced

Copyright © 2009 Yahoo! Inc. All rights reserved.
Privacy Policy - Terms of Service - Guidelines - Help