From:	ADVAX::"mcnc!VM1.NoDak.EDU!gih900%SAO.AARNET.EDU.AU" "Geoff Huston"  2-SEP-1990 10:47:29.87
To:	Multiple recipients of list ANU-NEWS <ANU-NEWS@NDSUVM1>
CC:	
Subj:	Re: VERY LARGE NEWS.ITEMS ...how to reduce it?!

Received: by ADVAX.DECnet (utk-mail11 v1.5) ; Sun, 2 Sep 90 10:49:53 EDT
Received:  from mcnc by ge-dab.GE.COM (5.61/GE-DAB 1.12) with UUCP
	id AA23305 for everhart; Sun, 2 Sep 90 10:04:26 -0400
Received: from VM1.NoDak.EDU by mcnc.mcnc.org (5.59/MCNC/6-11-90)
	id AA14368; Sun, 2 Sep 90 09:26:15 -0400
Message-Id: <9009021326.AA14368@mcnc.mcnc.org>
Received: from NDSUVM1.BITNET by VM1.NoDak.EDU (IBM VM SMTP R1.2.1MX) with BSMTP id 6877; Sun, 02 Sep 90 08:25:09 CDT
Received: from NDSUVM1.BITNET by NDSUVM1.BITNET (Mailer R2.07) with BSMTP id
 6867; Sun, 02 Sep 90 08:25:08 CDT
Date:         Mon, 3 Sep 90 03:10:32 GMT
Reply-To: Geoff Huston <mcnc!VM1.NoDak.EDU!gih900%SAO.AARNET.EDU.AU>
Sender: ANU-NEWS Discussion <ANU-NEWS@VM1.NoDak.EDU>
From: Geoff Huston <mcnc!VM1.NoDak.EDU!gih900%SAO.AARNET.EDU.AU>
Subject:      Re: VERY LARGE NEWS.ITEMS ...how to reduce it?!
To: Multiple recipients of list ANU-NEWS <ANU-NEWS@NDSUVM1>
 
In article <170.26dce0f8@vaxa.strath.ac.uk>, cnbr10@vaxa.strath.ac.uk (David J.Y
oung) writes:
> Someone requested a solution to the "VERY LARGE NEWS.ITEMS FILE" problem
> some weeks ago...but I assume any answers were posted directly to the requeste
r
> because I saw no replies in the newsgroup.
>
> We're in a similar position now..and have a very large news.items file....Can
> it be reduced? If so...HOW!??!
 
In terms of files NEWS.ITEMS is one of the worst - it contains thousands orf
records, has three keys (on quite large) - and has a 100% turnover of records
every few weeks or so. It is open by many users simultaneously and has constant
put, delete and update activity. About the only thing that could be worse is to
use variable length records.
 
To keep this file from using all available diskspace and CPU you have to
compress the file regularly:..
 
$ !             N E W S P A C K . C O M
$ !**********************************************************************
$ !
$ ! Author:
$ !     G Huston
$ !       Computer Services Centre
$ !       Australian National University
$ !
$ ! Version
$ !     V1.0    15-Mar-1988     GIH
$ !
$ !
$ !**********************************************************************
$ !     Start code
$ !
$   on error then goto abort
$   set process/name="NEWS-PACK"
$   oldprv = f$setprv("SYSPRV")
$   if .not. f$privilege("SYSPRV") then exit
$   set def news_root
$   purge news.items
$   backup/ign=interlock news.items news.wrk
$   analyze/rms/fdl/output=newsitems.fdl news.wrk
$   edit/fdl/analyze=news_root:newsitems.fdl/nointer news_root:newsitems.fdl
$   purge newsitems.fdl
$   convert/fdl=newsitems.fdl news.wrk news.wrk
$   purge news.wrk
$   rename news.wrk news.items
$   purge news.items
$   del newsitems.fdl;*
$!
$   purge news.groups
$   backup/ign=interlock news.groups news.wrk
$   analyze/rms/fdl/output=newsgroups.fdl news.wrk
$   edit/fdl/analyze=news_root:newsgroups.fdl/nointer news_root:newsgroups.fdl
$   purge newsgroups.fdl
$   convert/fdl=newsgroups.fdl news.wrk news.wrk
$   purge news.wrk
$   rename news.wrk news.groups
$   purge news.groups
$   del newsgroups.fdl;*
$!
$   purge history.v60
$   backup/ign=interlock history.v60 history.wrk
$   analyze/rms/fdl/output=history.fdl history.wrk
$   edit/fdl/analyze=news_root:history.fdl/nointer news_root:history.fdl
$   purge history.fdl
$   convert/fdl=history.fdl history.wrk history.wrk
$   purge history.wrk
$   rename history.wrk history.v60
$   purge history.v60
$   del history.fdl;*
$ abort:
$    exit
