From jcrowell at dcn.davis.ca.us Mon Mar 1 00:48:13 2004 From: jcrowell at dcn.davis.ca.us (John M. Crowell) Date: Mon, 1 Mar 2004 00:48:13 -0800 (PST) Subject: [DCN-TechOps] Monthly LoginID Report Message-ID: DCN LoginID Activity: February 1, 2004 - February 29, 2004 -------------------------------------------------------- This is a summary of LoginID activity on wheel for the month of February, 2004. This represents only the activity affecting the password authentication file, and reflects only LoginID's. There is not a one-to-one correspondence between LoginID and registered subscribers, but the correlation is close. Activity for the month of February: 25 New LoginID's 38 Active LoginID's deleted 1 Suspended LoginID's deleted 3 LoginID's suspended (i.e. LoginID exists, but password invalidated) 1 LoginID's reactivated Current LoginID's as of: 31-Jan 29-Feb Category --------------------------------------------------------------------- 13 13 System ID's used only by the OS and netadmin 8 8 DCN internal and administrative accounts 10 10 Training accounts used for classes and demonstrations 12 13 Suspended/inactive LoginID's 2550 2535 Active LoginID's ---- ---- 2593 2579 Total ---------------------------------------------------------------------- John M. Crowell Learn from the Past Davis Community Network Live for Today DCN Systems Manager Look to Tomorrow netadmin at dcn.davis.ca.us Take a Nap This afternoon Sacramento Master Singers Music Librarian jcrowell at mastersingers.org ______________________________________________________________________ From jcrowell at dcn.davis.ca.us Mon Mar 1 00:49:05 2004 From: jcrowell at dcn.davis.ca.us (John M. Crowell) Date: Mon, 1 Mar 2004 00:49:05 -0800 (PST) Subject: [DCN-TechOps] Monthly Downtime Report Message-ID: Monthly System Availability Report: February 2004 Systems: wheel: 00:00 01-Mar-04 uptime= 33 days 8:43 hours No downtime web: Scheduled interruptions every Saturday midnight for cycling log files. downtime ~20 seconds spoke: 00:00 01-Mar-04 uptime = 163 days 9:59 hours No downtime Modems: No reported outages. Network: No reported outages. ---------------------------------------------------------------------- John M. Crowell Learn from the Past Davis Community Network Live for Today DCN Systems Manager Look to Tomorrow netadmin at dcn.davis.ca.us Take a Nap This afternoon Sacramento Master Singers Music Librarian jcrowell at mastersingers.org ______________________________________________________________________ From msmosaic at dcn.davis.ca.us Sun Mar 7 06:23:00 2004 From: msmosaic at dcn.davis.ca.us (msmosaic at dcn.davis.ca.us) Date: Sun, 7 Mar 2004 06:23 -0800 Subject: [DCN-TechOps] Web Activity Summary Message-ID: <200403071423.i27ENwHA013618@wheel.dcn.davis.ca.us> 1,286,967 requests 10,734,875,437 bytes transferred Subdomains by bytes transferred ------------------------------- 1 peanutscollectorclub.com 1,507,674,109 14.04 2 vme 839,779,923 7.82 3 gvcc 763,716,376 7.11 4 vctinney 739,269,738 6.89 5 warbird.com 591,764,506 5.51 6 redwoodbarn.com 527,956,096 4.92 7 klsabin 473,604,736 4.41 8 DCN 449,030,560 4.18 9 academic-genealogy.com 355,032,711 3.31 10 rentcomputers.com 300,492,984 2.80 11 gracevalley.org 285,058,656 2.66 12 palmsplayhouse.com 212,274,828 1.98 13 abih.org 206,784,234 1.93 14 explorit.org 185,356,444 1.73 15 birchlane 182,919,266 1.70 16 gizmo 165,158,474 1.54 17 members.dcn.org 163,445,172 1.52 18 yannascimbene.com 154,100,327 1.44 19 mos 116,297,756 1.08 20 lamppostpizza.com 111,587,162 1.04 Subdomains by requests ---------------------- 1 abih.org 125,865 9.78% 2 peanutscollectorclub.com 113,847 8.85% 3 DCN 109,410 8.50% 4 vme 100,717 7.83% 5 gvcc 71,961 5.59% 6 redwoodbarn.com 46,972 3.65% 7 klsabin 41,782 3.25% 8 coffer.com 39,643 3.08% 9 palmsplayhouse.com 36,054 2.80% 10 warbird.com 32,685 2.54% 11 gracevalley.org 30,745 2.39% 12 birchlane 30,123 2.34% 13 rentcomputers.com 30,095 2.34% 14 explorit.org 26,819 2.08% 15 vctinney 26,707 2.08% 16 yolorecorder.org 24,598 1.91% 17 members.dcn.org 19,372 1.51% 18 lamppostpizza.com 16,861 1.31% 19 gizmo 15,043 1.17% 20 yannascimbene.com 13,466 1.05% 21 explorit 13,097 1.02% From JLee at ci.davis.ca.us Mon Mar 8 15:18:09 2004 From: JLee at ci.davis.ca.us (Jon Lee) Date: Mon, 08 Mar 2004 15:18:09 -0800 Subject: [DCN-TechOps] Techops committee meeting Message-ID: I would like to schedule a techops meeting on Thursday, March 11 @ 5pm City Computer Training Room 600 A Street There are some issues brewing about purchasing of another email server (election night, triggered service concerns) Are there any other Issues that need to be discussed? Jon. -------------- next part -------------- An HTML attachment was scrubbed... URL: From steve at dcn.org Mon Mar 8 16:18:51 2004 From: steve at dcn.org (Steve McMahon) Date: Mon, 08 Mar 2004 16:18:51 -0800 Subject: [DCN-TechOps] Techops committee meeting In-Reply-To: References: Message-ID: <404D0D6B.6000707@dcn.org> Hi All, That meeting date/time works for me. Notes on the server issue: this has arisen because Velocipede is proving to be a slow platform for hosting Zope and Zope applications like Plone (a Zope-based content-management system). This is a computationally intense application. Election night really showed us the bottleneck; we were seeing 1-2 minute delays serving pages. DCN actually has some budget to deal with this matter, as our MOU with the elections office covers hardware improvements. What we need from the TechOps is a hardware specification and consideration of how a new application server would fit into our administrative and backup plans. Thanks, Steve Jon Lee wrote: > > I would like to schedule a techops meeting on > Thursday, March 11 @ 5pm > City Computer Training Room 600 A Street > > There are some issues brewing about > purchasing of another email server (election night, triggered service > concerns) > > Are there any other Issues that need to be discussed? > > Jon. > > > > ------------------------------------------------------------------------ > > _______________________________________________ > DCN-Technical-Committee mailing list > DCN-Technical-Committee at mailman.dcn.org > http://www2.dcn.org/mailman/listinfo/dcn-technical-committee -- ______________________________________________________ Steve McMahon Reid-McMahon, LLC steve at reidmcmahon.com steve at dcn.org From JLee at ci.davis.ca.us Wed Mar 10 12:53:20 2004 From: JLee at ci.davis.ca.us (Jon Lee) Date: Wed, 10 Mar 2004 12:53:20 -0800 Subject: [DCN-TechOps] Tech Ops Agenda 03-11-04 Message-ID: Tech ops Meeting March 11, 2004 @ 1700 City Computer Training Room 600 A Street Agenda Introductions Status of old issues Tech Ops goalsSystems status PhysicalNetworkWheelSpokeCurrent issues VelocipedeCity requests subnetOther comments and questions Spam Appliance -------------- next part -------------- An HTML attachment was scrubbed... URL: From steve at dcn.org Fri Mar 12 09:18:10 2004 From: steve at dcn.org (Steve McMahon) Date: Fri, 12 Mar 2004 09:18:10 -0800 Subject: [DCN-TechOps] Base Specs for App Server Message-ID: <4051F0D2.7050901@dcn.org> Great meeting last night! Here are my baseline specs for the app server. Goal: platform for cpu/ram intensive apps like Zope. Processor: Performance roughly comparable to (or better than) 2GHz Intel RAM: 1 GB DDR ECC Storage: ~200 GB -- possibly configured as two drives in RAID1; At least 7,200 RPM, (10,000 would be nice, but may be too expensive); Ultra DMA or SCSI Tape Backup: I hope someone who knows these gadgets better can spec this part. In any case, compatible with what's otherwise in use by DCN. -- ______________________________________________________ Steve McMahon steve at dcn.org From bill at math.ucdavis.edu Fri Mar 12 18:34:36 2004 From: bill at math.ucdavis.edu (Bill Broadley) Date: Fri, 12 Mar 2004 18:34:36 -0800 Subject: [DCN-TechOps] Base Specs for App Server] Message-ID: <20040313023436.GA27074@cse.ucdavis.edu> On Fri, Mar 12, 2004 at 09:18:10AM -0800, Steve McMahon wrote: > Great meeting last night! Here are my baseline specs for the app server. ACK, I had the best of intensions for attending this one. I've quite a bit of experience with Zope at Math and CSE. > Goal: platform for cpu/ram intensive apps like Zope. I'd start with making sure that apache or similar is configured to act as a cache for zope, it makes all the difference in the world performance wise, and nicely integrates into Zope (i.e. timeout values under the zope properties panel). I've seen performance improvements over a factor of 10. > Processor: Performance roughly comparable to (or better than) 2GHz Intel > > RAM: 1 GB DDR ECC I'd recommend getting an Opteron from Sun, IBM, HP or one of the smaller vendors. Especially on dynamic content and database related work. HP's dual opteron page has a web benchmark where a single opteron out performs a dual P4. Ars technia, among others have shown the opteron to have significant advantages for this kind of thing. The opteron is rather unique in that often the dual cpu actually manages double the throughput of a single cpu machine. I can dig up URLs if needed. > Storage: ~200 GB -- possibly configured as two drives in RAID1; At least > 7,200 RPM, (10,000 would be nice, but may be too expensive); Ultra DMA > or SCSI In most cases I've seen performance for this kind of thing scales much closer to the number of heads and hardly at all with RPM. I'd recommend 2-4 160 GB drives for $100 each or so. Preferably SATA. Ideally you have enough ram to minimize the disk intensive nature of your workload. > Tape Backup: I hope someone who knows these gadgets better can spec this > part. In any case, compatible with what's otherwise in use by DCN. I can't comment without knowing what is in use by DCN, but am reasonably familiar with the tape technologies available. With more info I could help make a suggestion. The AMD has other benefits, it's more secure with hardware to help avoid buffer overflows, it can directly address > 4GB ram, and is rather inexpensive. Appro sells duals with 4GB ram starting at $2,100, Sun starts at $2,795, and HP starts at $1600. Not sure if this fits the budget or not. -- Bill Broadley Computational Science and Engineering UC Davis From msmosaic at dcn.davis.ca.us Sun Mar 14 06:23:00 2004 From: msmosaic at dcn.davis.ca.us (msmosaic at dcn.davis.ca.us) Date: Sun, 14 Mar 2004 06:23 -0800 Subject: [DCN-TechOps] Web Activity Summary Message-ID: <200403141423.i2EENsHA023088@wheel.dcn.davis.ca.us> 1,234,098 requests 11,031,131,083 bytes transferred Subdomains by bytes transferred ------------------------------- 1 peanutscollectorclub.com 1,367,409,517 12.40 2 gvcc 838,670,087 7.60 3 vme 737,996,489 6.69 4 vctinney 722,577,602 6.55 5 redwoodbarn.com 585,642,333 5.31 6 gracevalley.org 525,859,262 4.77 7 warbird.com 487,109,106 4.42 8 klsabin 458,654,801 4.16 9 DCN 436,703,025 3.96 10 academic-genealogy.com 388,819,206 3.52 11 rentcomputers.com 357,916,121 3.24 12 members.dcn.org 311,290,037 2.82 13 abih.org 229,341,973 2.08 14 explorit.org 215,245,056 1.95 15 palmsplayhouse.com 208,908,268 1.89 16 multiwareinc.com 172,731,088 1.57 17 birchlane 172,698,748 1.57 18 gizmo 154,449,740 1.40 Subdomains by requests ---------------------- 1 abih.org 129,610 10.50% 2 peanutscollectorclub.com 105,108 8.52% 3 DCN 102,474 8.30% 4 vme 95,081 7.70% 5 gvcc 62,221 5.04% 6 redwoodbarn.com 47,167 3.82% 7 coffer.com 40,661 3.29% 8 klsabin 38,887 3.15% 9 explorit.org 35,356 2.86% 10 palmsplayhouse.com 35,031 2.84% 11 rentcomputers.com 31,888 2.58% 12 birchlane 27,604 2.24% 13 gracevalley.org 27,239 2.21% 14 warbird.com 26,408 2.14% 15 vctinney 25,621 2.08% 16 yolorecorder.org 20,607 1.67% 17 members.dcn.org 18,230 1.48% 18 damfast.org 17,853 1.45% 19 explorit 14,298 1.16% 20 lamppostpizza.com 14,066 1.14% 21 gizmo 13,987 1.13% From steve at dcn.org Sun Mar 14 16:06:11 2004 From: steve at dcn.org (Steve McMahon) Date: Sun, 14 Mar 2004 16:06:11 -0800 Subject: [DCN-TechOps] Base Specs for App Server In-Reply-To: <20040313023114.GB26729@cse.ucdavis.edu> References: <4051F0D2.7050901@dcn.org> <20040313023114.GB26729@cse.ucdavis.edu> Message-ID: <4054F373.1090108@dcn.org> Thanks for the suggestions! We're already fronting Zope with Apache, and use it to cache what can be cached. That helps with public pages, but still leaves us hurting on items that can't be cached -- like management interface pages and election result pages. (Also, I'm not seeing as much benefit from caching on this machine as I've seen on others. Something's adding some latency to the apache-cache served files. They're still faster than Zope pages, just not as much as you'd expect.) The machine we're currently using as our main Zope server has four 166mHz processors. I'm pretty sure that Zope/Python's threading isn't making good use of the multiple processors (a known problem with Solaris), so this is acting like a slow, single-processor machine as far as Zope's concerned. One possible improvement might come from using ZEO and binding the Zope client and the ZODB database to different processors. But I think that would just be a holding action. Another consideration is that we'd like to be running some Plone sites. I don't know if you've worked with Plone, but its ZPT pages typically take about ten times as long to serve as DTML pages. (That also means that they benefit even more from caching.) I hadn't thought about Opteron options, so thanks for pointing us in that direction. The memory use benchmarks make it look like it might be a great Zope platform. Steve Bill Broadley wrote: > On Fri, Mar 12, 2004 at 09:18:10AM -0800, Steve McMahon wrote: > >>Great meeting last night! Here are my baseline specs for the app server. > > > ACK, I had the best of intensions for attending this one. I've quite > a bit of experience with Zope at Math and CSE. > > >>Goal: platform for cpu/ram intensive apps like Zope. > > > I'd start with making sure that apache or similar is configured to act as > a cache for zope, it makes all the difference in the world performance > wise, and nicely integrates into Zope (i.e. timeout values under the > zope properties panel). I've seen performance improvements over > a factor of 10. > > >>Processor: Performance roughly comparable to (or better than) 2GHz Intel >> >>RAM: 1 GB DDR ECC > > > I'd strongly recommend getting an Opteron from Sun, IBM, HP or one > of the smaller vendors. Especially on dynamic content and database > related work. > > HP's dual opteron page has a web benchmark where a single opteron out > performs a dual P4. Ars technia, among others have shown the opteron > to have significant advantages for this kind of thing. The opteron is > rather unique in that often the dual cpu actually manages double > the throughput of a single cpu machine. > > I can dig up URLs if needed. > > >>Storage: ~200 GB -- possibly configured as two drives in RAID1; At least >>7,200 RPM, (10,000 would be nice, but may be too expensive); Ultra DMA >>or SCSI > > > In most cases I've seen performance for this kind of thing scales > much closer to the number of heads and hardly at all with RPM. I'd > recommend 2-4 160 GB drives for $100 each or so. Preferably SATA. > > Ideally you have enough ram to minimize the disk intensive nature > of your workload. > > >>Tape Backup: I hope someone who knows these gadgets better can spec this >>part. In any case, compatible with what's otherwise in use by DCN. > > > I can't comment without knowing what is in use by DCN, but am reasonably > familiar with the tape technologies available. With more info I could > help make a suggestion. > > The AMD has other benefits, it's more secure with hardware to help avoid > buffer overflows, it can directly address > 4GB ram, and is rather > inexpensive. Appro sells duals with 4GB ram starting at $2,100, Sun > starts at $2,795, and HP starts at $1600. Not sure if this fits the > budget or not. > -- ______________________________________________________ Steve McMahon steve at dcn.org From bill at math.ucdavis.edu Tue Mar 16 10:00:57 2004 From: bill at math.ucdavis.edu (Bill Broadley) Date: Tue, 16 Mar 2004 10:00:57 -0800 Subject: [DCN-TechOps] Base Specs for App Server In-Reply-To: <4054F373.1090108@dcn.org> References: <4051F0D2.7050901@dcn.org> <20040313023114.GB26729@cse.ucdavis.edu> <4054F373.1090108@dcn.org> Message-ID: <20040316180057.GD10523@cse.ucdavis.edu> On Sun, Mar 14, 2004 at 04:06:11PM -0800, Steve McMahon wrote: > Thanks for the suggestions! > > We're already fronting Zope with Apache, and use it to cache what can be > cached. That helps with public pages, but still leaves us hurting on Using Rewrite rules? ProxyPass? PCGI/FastCGI? CGI? > items that can't be cached -- like management interface pages and But these should be very rare indeed right (when compared to user pages)? > election result pages. (Also, I'm not seeing as much benefit from Why can't these be cached? Even if the cache is set to 60 seconds it could be a signficant performance increase. > The machine we're currently using as our main Zope server has four > 166mHz processors. I'm pretty sure that Zope/Python's threading isn't > making good use of the multiple processors (a known problem with > Solaris), so this is acting like a slow, single-processor machine as far Ah, Solaris. Even if Solaris did do SMP well, having 4 processors share a single 64 bit 66 MHz memory buss is going to lead to major memory contention issues. In comparison for instance the dual opteron should have around 48 times more memory bandwidth. > as Zope's concerned. One possible improvement might come from using ZEO > and binding the Zope client and the ZODB database to different > processors. But I think that would just be a holding action. Yeah, I suspect a $400 dell server with a P4 and a 800 MHz FSB would be substantially faster then a quad p6. > Another consideration is that we'd like to be running some Plone sites. > I don't know if you've worked with Plone, but its ZPT pages typically > take about ten times as long to serve as DTML pages. (That also means > that they benefit even more from caching.) I'm interested in Plone and am considering it for a new computational portal for CSE. > I hadn't thought about Opteron options, so thanks for pointing us in > that direction. The memory use benchmarks make it look like it might be > a great Zope platform. I've seen web serving (both static and dynamic) as well as database benchmarks that show substantial advantages as well. I try to avoid over generalizing microbenchmarks (like all the memory benchmarks), but certainly a killer memory system doesn't hurt. The dual opteron definitely has the best memory system out currently, well except for a quad opteron. I'm not sure where DCN sits as far as the whitebox hardware vs Tier-1 supported hardware. Sun supports linux on the dual opteron today and has announced support for dual opterons (the SunFire v20z) this summer. -- Bill Broadley Computational Science and Engineering UC Davis From msmosaic at dcn.davis.ca.us Sun Mar 21 06:23:00 2004 From: msmosaic at dcn.davis.ca.us (msmosaic at dcn.davis.ca.us) Date: Sun, 21 Mar 2004 06:23 -0800 Subject: [DCN-TechOps] Web Activity Summary Message-ID: <200403211424.i2LENwI7001502@wheel.dcn.davis.ca.us> 1,225,460 requests 10,296,672,943 bytes transferred Subdomains by bytes transferred ------------------------------- 1 peanutscollectorclub.com 1,351,945,628 13.13 2 vctinney 824,449,455 8.01 3 vme 815,951,995 7.92 4 redwoodbarn.com 610,078,972 5.93 5 warbird.com 466,990,988 4.54 6 klsabin 465,066,943 4.52 7 DCN 448,997,580 4.36 8 gvcc 376,320,125 3.65 9 academic-genealogy.com 336,588,142 3.27 10 rentcomputers.com 308,747,407 3.00 11 members.dcn.org 270,656,237 2.63 12 gracevalley.org 268,755,426 2.61 13 palmsplayhouse.com 219,624,408 2.13 14 abih.org 215,620,445 2.09 15 explorit 199,557,124 1.94 16 birchlane 171,615,700 1.67 17 explorit.org 170,583,911 1.66 18 gizmo 162,775,264 1.58 19 mos 127,713,645 1.24 20 yannascimbene.com 120,494,402 1.17 21 multiwareinc.com 109,613,441 1.06 Subdomains by requests ---------------------- 1 abih.org 124,333 10.15% 2 DCN 108,229 8.83% 3 peanutscollectorclub.com 102,625 8.37% 4 vme 99,904 8.15% 5 gvcc 46,181 3.77% 6 redwoodbarn.com 45,887 3.74% 7 explorit 40,091 3.27% 8 klsabin 39,776 3.25% 9 coffer.com 36,863 3.01% 10 palmsplayhouse.com 35,784 2.92% 11 rentcomputers.com 30,368 2.48% 12 birchlane 28,245 2.30% 13 vctinney 27,154 2.22% 14 warbird.com 25,814 2.11% 15 explorit.org 25,314 2.07% 16 gracevalley.org 24,590 2.01% 17 yolorecorder.org 22,566 1.84% 18 members.dcn.org 21,411 1.75% 19 damfast.org 16,166 1.32% 20 lamppostpizza.com 14,520 1.18% 21 davisairporter.com 14,030 1.14% 22 gizmo 13,776 1.12% 23 yannascimbene.com 12,443 1.02% From msmosaic at dcn.davis.ca.us Sun Mar 28 06:23:00 2004 From: msmosaic at dcn.davis.ca.us (msmosaic at dcn.davis.ca.us) Date: Sun, 28 Mar 2004 06:23 -0800 Subject: [DCN-TechOps] Web Activity Summary Message-ID: <200403281423.i2SENjOt001707@wheel.dcn.davis.ca.us> 1,208,088 requests 9,988,668,110 bytes transferred Subdomains by bytes transferred ------------------------------- 1 peanutscollectorclub.com 1,308,912,226 13.10 2 vctinney 773,727,282 7.75 3 redwoodbarn.com 664,487,235 6.65 4 vme 582,247,594 5.83 5 warbird.com 576,715,886 5.77 6 klsabin 507,655,479 5.08 7 DCN 416,447,830 4.17 8 gracevalley.org 336,762,720 3.37 9 rentcomputers.com 282,994,559 2.83 10 abih.org 261,542,351 2.62 11 gvcc 254,443,544 2.55 12 academic-genealogy.com 245,576,683 2.46 13 explorit 242,595,637 2.43 14 palmsplayhouse.com 205,037,643 2.05 15 members.dcn.org 200,820,109 2.01 16 birchlane 192,329,402 1.93 17 explorit.org 173,177,271 1.73 18 gizmo 162,715,654 1.63 19 mos 132,923,500 1.33 20 yannascimbene.com 117,145,647 1.17 21 davisairporter.com 111,665,405 1.12 22 jfhess 103,359,621 1.03 Subdomains by requests ---------------------- 1 abih.org 139,565 11.55% 2 peanutscollectorclub.com 99,807 8.26% 3 DCN 97,427 8.06% 4 vme 82,241 6.81% 5 explorit 52,215 4.32% 6 redwoodbarn.com 50,765 4.20% 7 klsabin 43,311 3.59% 8 gvcc 41,105 3.40% 9 coffer.com 38,947 3.22% 10 palmsplayhouse.com 33,687 2.79% 11 birchlane 33,287 2.76% 12 warbird.com 29,144 2.41% 13 gracevalley.org 27,278 2.26% 14 rentcomputers.com 25,693 2.13% 15 explorit.org 25,656 2.12% 16 vctinney 25,002 2.07% 17 yolorecorder.org 22,061 1.83% 18 davisairporter.com 18,458 1.53% 19 members.dcn.org 17,303 1.43% 20 damfast.org 14,421 1.19% 21 lamppostpizza.com 14,091 1.17%