Loading ...
Sorry, an error occurred while loading the content.

Re: webalizer help (RAM usage)

Expand Messages
  • enventa2000
    Then webalizer only uses more RAM when you add more entries to the webalizer.conf file? Entries like SearchEngine xxx x, GroupSite/HideSite,
    Message 1 of 5 , Apr 16, 2004
    • 0 Attachment
      Then webalizer only uses more RAM when you add more entries to the
      webalizer.conf file? Entries like SearchEngine xxx x,
      GroupSite/HideSite, GroupAgent/HideAgent, etc?

      How much RAM would every extra entry add on average? 100 bytes? 64
      bytes/each plus overhead for hash tables?


      --- In webalizer@yahoogroups.com, "Bradford L. Barrett" <brad@m...>
      wrote:
      >
      > [...]
      > > solution 2:
      > >
      > > cat all logfiles together in a single file and then
      > > add every night the rotated file to the end. Make
      > > webalizer re-process that file every night. Prepare to
      > > buy more RAM for webalizer so it doesn't resort to
      > > swap.
      >
      > FYI: There is no difference in RAM usage between using one big log
      file
      > or processing lots of smaller files using incremental mode. The
      same
      > memory is consumed regardless of the method used.
      >
      > Also, Option #3: Just rotate your logs once a month. Process the
      log
      > whenever you want to get an updated report, and once at the end of
      the
      > month after rotation to get the final monthly report. This is the
      > preferred and _recommended_ method to use.
      >
      > --
      > Bradford L. Barrett brad@m...
      > A free electron in a sea of neutrons DoD#1750 KD4NAW
      >
      > The only thing Micro$oft has done for society, is make people
      > believe that computers are inherently unreliable.
    • Bradford L. Barrett
      ... The use of entries such as the above have a minimal effect on the amount of RAM used, but a huge impact on processing time since each entry must be
      Message 2 of 5 , Apr 16, 2004
      • 0 Attachment
        > Then webalizer only uses more RAM when you add more entries to the
        > webalizer.conf file? Entries like SearchEngine xxx x,
        > GroupSite/HideSite, GroupAgent/HideAgent, etc?

        The use of entries such as the above have a minimal effect on the amount
        of RAM used, but a huge impact on processing time since each entry must
        be compared against each log record. If you have lots and lots of
        PageType/IndexAlias/Hide/Group/Ignore/Include/SearchEngine entries, they
        will have a large impact on processing time since each one must be
        processed for each log record, and the impact is linear depending on the
        number of such entries.

        > How much RAM would every extra entry add on average? 100 bytes? 64
        > bytes/each plus overhead for hash tables?

        Depends. Some just keep the match string in a linked list, so it only
        takes however many bytes required for the string + linkage. Others
        will also create a hash table entry of whatever size required for the
        object being referenced. The size depends on the object, since each
        object maintains different metrics particular to the object.

        --
        Bradford L. Barrett brad@...
        A free electron in a sea of neutrons DoD#1750 KD4NAW

        The only thing Micro$oft has done for society, is make people
        believe that computers are inherently unreliable.
      Your message has been successfully submitted and would be delivered to recipients shortly.