Loading ...
Sorry, an error occurred while loading the content.

RE: [magicu-l] Speed Issues in Batch Tasks

Expand Messages
  • Brookes, Alan
    Have you got cacheing switched ON for the table? Regards, Alan ... From: sent_ang [mailto:sent_ang@yahoo.com] Sent: Friday, November 01, 2002 6:42 AM To:
    Message 1 of 5 , Oct 31, 2002
    • 0 Attachment
      Have you got cacheing switched ON for the table?

      Regards,

      Alan


      -----Original Message-----
      From: sent_ang [mailto:sent_ang@...]
      Sent: Friday, November 01, 2002 6:42 AM
      To: magicu-l@yahoogroups.com
      Subject: [magicu-l] Speed Issues in Batch Tasks


      Hi Group,


      Whenever i am using the Batch task on a table which is very large
      say about 2 million records.

      The Processing Speed is about 100 Records/Min at the Start as the
      Processing goes on the speed tends to come down at abt 1 rec per min.

      Is there any solution to this problem..


      Thanks

      Senthil




      Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/
    • Jaymer
      you are going to need to tell us: magic version operating system, memory size database and version network involved, etc? thx jaymer... ... min.
      Message 2 of 5 , Nov 1, 2002
      • 0 Attachment
        you are going to need to tell us:

        magic version
        operating system, memory size
        database and version
        network involved, etc?

        thx
        jaymer...

        --- In magicu-l@y..., "sent_ang" <sent_ang@y...> wrote:
        > Hi Group,
        >
        >
        > Whenever i am using the Batch task on a table which is very large
        > say about 2 million records.
        >
        > The Processing Speed is about 100 Records/Min at the Start as the
        > Processing goes on the speed tends to come down at abt 1 rec per
        min.
        >
        > Is there any solution to this problem..
        >
        >
        > Thanks
        >
        > Senthil
      • sent_ang
        Magic version 8.3 Btrieve 7.1 Clients Windows 2000 Client main Memmory 256MB Server Windows 2000 Server Main Memmory 1GB, HArd Disk 20GB with 10GB Free Space.
        Message 3 of 5 , Nov 3, 2002
        • 0 Attachment
          Magic version 8.3
          Btrieve 7.1
          Clients Windows 2000
          Client main Memmory 256MB
          Server Windows 2000
          Server Main Memmory 1GB, HArd Disk 20GB with 10GB Free Space.
          Lan with 100 mbps speed.

          The Example i had mentioned happens in the server itself, and there
          are no other Process running in the system.

          Regards

          Senthil

          --- In magicu-l@y..., "Jaymer" <jaymer_egroups@j...> wrote:
          > you are going to need to tell us:
          >
          > magic version
          > operating system, memory size
          > database and version
          > network involved, etc?
          >
          > thx
          > jaymer...
          >
          > --- In magicu-l@y..., "sent_ang" <sent_ang@y...> wrote:
          > > Hi Group,
          > >
          > >
          > > Whenever i am using the Batch task on a table which is very
          large
          > > say about 2 million records.
          > >
          > > The Processing Speed is about 100 Records/Min at the Start as
          the
          > > Processing goes on the speed tends to come down at abt 1 rec per
          > min.
          > >
          > > Is there any solution to this problem..
          > >
          > >
          > > Thanks
          > >
          > > Senthil
        • Steven G. Blank
          Slow downs are one thing, but 100 records per MINUTE!? That must be one helluva complicated batch task. Either that or something is very, VERY wrong. Two
          Message 4 of 5 , Nov 4, 2002
          • 0 Attachment
            Slow downs are one thing, but 100 records per MINUTE!?

            That must be one helluva complicated batch task. Either that or something
            is very, VERY wrong. Two million records or twenty, given a decent index
            and opening the file once at the beginning, you should be able to update
            records by at least two orders of magnitude faster.

            When it comes to an apparent slowing of processing, a certain amount of
            "stops and starts" or what appears to be pausing is to be expected. When
            an application updates a large number of records, the MKDE will "pause"
            every time it has to flush its cache to disk and, if the cache is large
            and/or the disk is slow, this process can take a number of seconds,
            possibly even minutes. That said, a general slowdown (as opposed to a
            pause followed by resumption of "normal" processing speed) doesn't sound
            "normal" to me either.

            Steve Blank


            At 08:56 PM 11/3/2002, you wrote:
            >Magic version 8.3
            >Btrieve 7.1
            >Clients Windows 2000
            >Client main Memmory 256MB
            >Server Windows 2000
            >Server Main Memmory 1GB, HArd Disk 20GB with 10GB Free Space.
            >Lan with 100 mbps speed.
            >
            > The Example i had mentioned happens in the server itself, and there
            >are no other Process running in the system.
            >
            >Regards
            >
            >Senthil
            >
            >--- In magicu-l@y..., "Jaymer" <jaymer_egroups@j...> wrote:
            > > you are going to need to tell us:
            > >
            > > magic version
            > > operating system, memory size
            > > database and version
            > > network involved, etc?
            > >
            > > thx
            > > jaymer...
            > >
            > > --- In magicu-l@y..., "sent_ang" <sent_ang@y...> wrote:
            > > > Hi Group,
            > > >
            > > >
            > > > Whenever i am using the Batch task on a table which is very
            > > > large say about 2 million records.
            > > >
            > > > The Processing Speed is about 100 Records/Min at the Start as
            > > > the Processing goes on the speed tends to come down at abt 1
            > > > rec per min.
            > > >
            > > > Is there any solution to this problem..
            > > >
            > > >
            > > > Thanks
            > > >
            > > > Senthil

            ----------------------------
            Steven G. Blank
            Salt Lake City, Utah USA
            ----------------------------
          Your message has been successfully submitted and would be delivered to recipients shortly.