Loading ...
Sorry, an error occurred while loading the content.

Blank KB In/Out stats

Expand Messages
  • rimmerpaul
    Any ideas why the kB in and out fields would all be blank in my webalizer reports? Strangely enough the Total kB Files field is populated. From my apache
    Message 1 of 8 , Jun 27, 2004
    View Source
    • 0 Attachment
      Any ideas why the kB in and out fields would all be blank in my
      webalizer reports? Strangely enough the "Total kB Files" field is
      populated.

      From my apache commonhttpd.conf:

      <IfModule mod_log_config.c>
      LogFormat "%h %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-Agent}
      i\"" combined
      LogFormat "%h %l %u %t \"%r\" %>s %b" common
      LogFormat "%{Referer}i -> %U" referer
      LogFormat "%{User-agent}i" agent
      LogFormat "%v %h %l %u %t \"%r\" %>s %b %T" script
      LogFormat "%v %h %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-
      Agent}i\" VLOG=%{VLOG}e" vhost

      <IfModule mod_logio.c>

      # You need to enable mod_logio.c to use %I and %O
      #LogFormat "%h %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-
      Agent}i\" %I %O" combinedio

      </IfModule>

      Samples from my access_log:

      199.126.39.33 - - [28/Jun/2004:02:28:05 -0400] "POST /forum-
      posting.html HTTP/1.1" 200 3692 "http://x.com/forums-posting-reply-t-
      4186.html" "Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)"
      199.126.39.33 - - [28/Jun/2004:02:28:07 -0400] "GET /modules.php?
      name=htmlarea&op=editor HTTP/1.1" 200 12005 "http://x.com/forum-
      posting.html" "Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)"

      Sizes appear to be in the puts and gets.

      Running latest webalizer on a Mandrake/Apache box.

      Cheers,

      Paul Rimmer
      Calgary, Alberta, Canada
    • Bradford L. Barrett
      ... KB in and out fields? There are no in or out fields? Where are you looking? ... Those appear fine. -- Bradford L. Barrett
      Message 2 of 8 , Jun 27, 2004
      View Source
      • 0 Attachment
        > Any ideas why the kB in and out fields would all be blank in my
        > webalizer reports? Strangely enough the "Total kB Files" field is
        > populated.

        KB in and out fields? There are no 'in' or 'out' fields? Where are
        you looking?

        > 199.126.39.33 - - [28/Jun/2004:02:28:05 -0400] "POST /forum-
        > posting.html HTTP/1.1" 200 3692 "http://x.com/forums-posting-reply-t-
        > 4186.html" "Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)"
        > 199.126.39.33 - - [28/Jun/2004:02:28:07 -0400] "GET /modules.php?
        > name=htmlarea&op=editor HTTP/1.1" 200 12005 "http://x.com/forum-
        > posting.html" "Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)"

        Those appear fine.

        --
        Bradford L. Barrett brad@...
        A free electron in a sea of neutrons DoD#1750 KD4NAW

        The only thing Micro$oft has done for society, is make people
        believe that computers are inherently unreliable.
      • rimmerpaul
        ... is ... are ... Well there are in my out of the box webalizer reports. Right here: Monthly Statistics for June 2004 Total Hits 5394232 Total Files 3417584
        Message 3 of 8 , Jun 27, 2004
        View Source
        • 0 Attachment
          --- In webalizer@yahoogroups.com, "Bradford L. Barrett" <brad@m...>
          wrote:
          >
          > > Any ideas why the kB in and out fields would all be blank in my
          > > webalizer reports? Strangely enough the "Total kB Files" field
          is
          > > populated.
          >
          > KB in and out fields? There are no 'in' or 'out' fields? Where
          are
          > you looking?

          Well there are in my out of the box webalizer reports. Right here:

          Monthly Statistics for June 2004

          Total Hits 5394232
          Total Files 3417584
          Total Pages 338648
          Total Visits 58831
          Total kB Files 25335414
          Total kB In 0
          Total kB Out 0

          Total Unique Sites 24579
          Total Unique URLs 32665
          Total Unique Referrers 18096
          Total Unique Usernames 4
          Total Unique User Agents 2117

          . Avg Max

          Hits per Hour 8324 24033
          Hits per Day 199786 255075
          Files per Day 126577 167397
          Pages per Day 12542 15637
          Visits per Day 2178 2662
          kB Files per Day 938349 1393901
          kB In per Day 0 0
          kB Out per Day 0 0

          > > 199.126.39.33 - - [28/Jun/2004:02:28:05 -0400] "POST /forum-
          > > posting.html HTTP/1.1" 200 3692 "http://x.com/forums-posting-
          reply-t-
          > > 4186.html" "Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)"
          > > 199.126.39.33 - - [28/Jun/2004:02:28:07 -0400] "GET /modules.php?
          > > name=htmlarea&op=editor HTTP/1.1" 200 12005 "http://x.com/forum-
          > > posting.html" "Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)"
          >
          > Those appear fine.
          >
          > --
          > Bradford L. Barrett brad@m...
          > A free electron in a sea of neutrons DoD#1750 KD4NAW
          >
          > The only thing Micro$oft has done for society, is make people
          > believe that computers are inherently unreliable.
        • Bradford L. Barrett
          You are _not_ using the Webalizer, but apparently using a modified version that is neither official or supported. Where did you get it? --
          Message 4 of 8 , Jun 27, 2004
          View Source
          • 0 Attachment
            You are _not_ using the Webalizer, but apparently using a modified
            version that is neither official or supported. Where did you get it?

            --

            On Mon, 28 Jun 2004, rimmerpaul wrote:

            > --- In webalizer@yahoogroups.com, "Bradford L. Barrett" <brad@m...>
            > wrote:
            > >
            > > > Any ideas why the kB in and out fields would all be blank in my
            > > > webalizer reports? Strangely enough the "Total kB Files" field
            > is
            > > > populated.
            > >
            > > KB in and out fields? There are no 'in' or 'out' fields? Where
            > are
            > > you looking?
            >
            > Well there are in my out of the box webalizer reports. Right here:
            >
            > Monthly Statistics for June 2004
            >
            > Total Hits 5394232
            > Total Files 3417584
            > Total Pages 338648
            > Total Visits 58831
            > Total kB Files 25335414
            > Total kB In 0
            > Total kB Out 0
            >
            > Total Unique Sites 24579
            > Total Unique URLs 32665
            > Total Unique Referrers 18096
            > Total Unique Usernames 4
            > Total Unique User Agents 2117
            >
            > . Avg Max
            >
            > Hits per Hour 8324 24033
            > Hits per Day 199786 255075
            > Files per Day 126577 167397
            > Pages per Day 12542 15637
            > Visits per Day 2178 2662
            > kB Files per Day 938349 1393901
            > kB In per Day 0 0
            > kB Out per Day 0 0
            >
            > > > 199.126.39.33 - - [28/Jun/2004:02:28:05 -0400] "POST /forum-
            > > > posting.html HTTP/1.1" 200 3692 "http://x.com/forums-posting-
            > reply-t-
            > > > 4186.html" "Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)"
            > > > 199.126.39.33 - - [28/Jun/2004:02:28:07 -0400] "GET /modules.php?
            > > > name=htmlarea&op=editor HTTP/1.1" 200 12005 "http://x.com/forum-
            > > > posting.html" "Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)"
            > >
            > > Those appear fine.
            > >
            > > --
            > > Bradford L. Barrett brad@m...
            > > A free electron in a sea of neutrons DoD#1750 KD4NAW
            > >
            > > The only thing Micro$oft has done for society, is make people
            > > believe that computers are inherently unreliable.
            >
            >
            >
            >
            > Webalizer homepage: http://www.webalizer.org
            > Webalizer for NT: http://www.medasys-lille.com/webalizer/
            >
            >
            > ttp://www.webalizer.org
            > Webalizer for NT: http://www.medasys-lille.com/webalizer/
            >
            >
            >
            > Yahoo! Groups Links
            >
            >
            >
            >
            >
          • rimmerpaul
            I got webalizer-2.01.10-11mdk.i586.rpm from here: http://rpmfind.net/linux/rpm2html/search.php?query=webalizer Hang on, are you pulling my leg? :-)
            Message 5 of 8 , Jun 27, 2004
            View Source
            • 0 Attachment
              I got webalizer-2.01.10-11mdk.i586.rpm from here:

              http://rpmfind.net/linux/rpm2html/search.php?query=webalizer

              Hang on, are you pulling my leg? :-)

              http://groups.yahoo.com/group/webalizer/message/2680

              Is that you discussing this very problem? The ansewr you gave that
              fella: "Bogus '%v' in front of each record" doesn't apply to the
              config I mentioned in my first post.

              --- In webalizer@yahoogroups.com, "Bradford L. Barrett" <brad@m...>
              wrote:
              >
              > You are _not_ using the Webalizer, but apparently using a modified
              > version that is neither official or supported. Where did you get
              it?
              >
              > --
              >
              > On Mon, 28 Jun 2004, rimmerpaul wrote:
              >
              > > --- In webalizer@yahoogroups.com, "Bradford L. Barrett"
              <brad@m...>
              > > wrote:
              > > >
              > > > > Any ideas why the kB in and out fields would all be blank in
              my
              > > > > webalizer reports? Strangely enough the "Total kB Files"
              field
              > > is
              > > > > populated.
              > > >
              > > > KB in and out fields? There are no 'in' or 'out' fields?
              Where
              > > are
              > > > you looking?
              > >
              > > Well there are in my out of the box webalizer reports. Right
              here:
              > >
              > > Monthly Statistics for June 2004
              > >
              > > Total Hits 5394232
              > > Total Files 3417584
              > > Total Pages 338648
              > > Total Visits 58831
              > > Total kB Files 25335414
              > > Total kB In 0
              > > Total kB Out 0
              > >
              > > Total Unique Sites 24579
              > > Total Unique URLs 32665
              > > Total Unique Referrers 18096
              > > Total Unique Usernames 4
              > > Total Unique User Agents 2117
              > >
              > > . Avg Max
              > >
              > > Hits per Hour 8324 24033
              > > Hits per Day 199786 255075
              > > Files per Day 126577 167397
              > > Pages per Day 12542 15637
              > > Visits per Day 2178 2662
              > > kB Files per Day 938349 1393901
              > > kB In per Day 0 0
              > > kB Out per Day 0 0
              > >
              > > > > 199.126.39.33 - - [28/Jun/2004:02:28:05 -0400] "POST /forum-
              > > > > posting.html HTTP/1.1" 200 3692 "http://x.com/forums-posting-
              > > reply-t-
              > > > > 4186.html" "Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)"
              > > > > 199.126.39.33 - - [28/Jun/2004:02:28:07 -
              0400] "GET /modules.php?
              > > > > name=htmlarea&op=editor HTTP/1.1" 200
              12005 "http://x.com/forum-
              > > > > posting.html" "Mozilla/4.0 (compatible; MSIE 6.0; Windows
              98)"
              > > >
              > > > Those appear fine.
              > > >
              > > > --
              > > > Bradford L. Barrett brad@m...
              > > > A free electron in a sea of neutrons DoD#1750 KD4NAW
            • Bradford L. Barrett
              ... Don t konw what they did, but it s apparently a basterdized version of the code. Official version can be found at either www.mrunix.net/webalizer/ or
              Message 6 of 8 , Jun 27, 2004
              View Source
              • 0 Attachment
                > I got webalizer-2.01.10-11mdk.i586.rpm from here:
                >
                > http://rpmfind.net/linux/rpm2html/search.php?query=webalizer

                Don't konw what they did, but it's apparently a basterdized
                version of the code. Official version can be found at either
                www.mrunix.net/webalizer/ or webalizer.org

                > Hang on, are you pulling my leg? :-)

                No. See http://www.mrunix.net/webalizer/sample/

                to see what the reports generated look like. You will notice that there
                are no "KB in" or "KB out" metrics reported in any of those reports.

                > http://groups.yahoo.com/group/webalizer/message/2680
                >
                > Is that you discussing this very problem? The ansewr you gave that
                > fella: "Bogus '%v' in front of each record" doesn't apply to the
                > config I mentioned in my first post.

                Yes that's me.. and no, it doesn't apply to you. In the above, NO
                Kb metric was being reported (due to the fields being right shifted
                by one field and throwing off their alignment). In your case, the
                Kb metric is being reported properly, but some bogus "Kb in" and
                "KB out" metrics are not.. which are not part of the webalizer and
                never have been.

                Now.. what I _suspect_ is that you have a bastardized version of
                the webalizer that hacks in support for showing in/out traffic
                using some unusual log format. In your first post, you showed a
                LogFormat snippit from your httpd.conf file that looked like:

                # You need to enable mod_logio.c to use %I and %O
                #LogFormat "%h %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-Agent}i\" %I %O" combinedio

                Chances are, you need to use the above format for your log records
                so the hacked webalizer will pick up the added %I and %O fields
                tacked onto the end of each record. What you probably have in your
                httpd.conf file is a like that looks like:

                CustomLog /path/to/log/access_log combined

                when you should have instead:

                CustomLog /path/to/log/access_log combinedio

                But that is just a guess given the limited info available. At any rate,
                the version of the program is not an official one, as it has been hacked
                to add the above functionality, and therefore is not really supported.
                To get the offical version, visit one of the sites mentioned above.

                --
                Bradford L. Barrett brad@...
                A free electron in a sea of neutrons DoD#1750 KD4NAW

                The only thing Micro$oft has done for society, is make people
                believe that computers are inherently unreliable.
              • rimmerpaul
                ... there ... reports. ... that ... Agent}i %I %O combinedio ... rate, ... hacked ... supported. ... OK, for anyone else running an rpm based version of
                Message 7 of 8 , Jun 28, 2004
                View Source
                • 0 Attachment
                  --- In webalizer@yahoogroups.com, "Bradford L. Barrett" <brad@m...>
                  wrote:
                  >
                  > > I got webalizer-2.01.10-11mdk.i586.rpm from here:
                  > >
                  > > http://rpmfind.net/linux/rpm2html/search.php?query=webalizer
                  >
                  > Don't konw what they did, but it's apparently a basterdized
                  > version of the code. Official version can be found at either
                  > www.mrunix.net/webalizer/ or webalizer.org
                  >
                  > > Hang on, are you pulling my leg? :-)
                  >
                  > No. See http://www.mrunix.net/webalizer/sample/
                  >
                  > to see what the reports generated look like. You will notice that
                  there
                  > are no "KB in" or "KB out" metrics reported in any of those
                  reports.
                  >
                  > > http://groups.yahoo.com/group/webalizer/message/2680
                  > >
                  > > Is that you discussing this very problem? The ansewr you gave
                  that
                  > > fella: "Bogus '%v' in front of each record" doesn't apply to the
                  > > config I mentioned in my first post.
                  >
                  > Yes that's me.. and no, it doesn't apply to you. In the above, NO
                  > Kb metric was being reported (due to the fields being right shifted
                  > by one field and throwing off their alignment). In your case, the
                  > Kb metric is being reported properly, but some bogus "Kb in" and
                  > "KB out" metrics are not.. which are not part of the webalizer and
                  > never have been.
                  >
                  > Now.. what I _suspect_ is that you have a bastardized version of
                  > the webalizer that hacks in support for showing in/out traffic
                  > using some unusual log format. In your first post, you showed a
                  > LogFormat snippit from your httpd.conf file that looked like:
                  >
                  > # You need to enable mod_logio.c to use %I and %O
                  > #LogFormat "%h %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-
                  Agent}i\" %I %O" combinedio
                  >
                  > Chances are, you need to use the above format for your log records
                  > so the hacked webalizer will pick up the added %I and %O fields
                  > tacked onto the end of each record. What you probably have in your
                  > httpd.conf file is a like that looks like:
                  >
                  > CustomLog /path/to/log/access_log combined
                  >
                  > when you should have instead:
                  >
                  > CustomLog /path/to/log/access_log combinedio
                  >
                  > But that is just a guess given the limited info available. At any
                  rate,
                  > the version of the program is not an official one, as it has been
                  hacked
                  > to add the above functionality, and therefore is not really
                  supported.
                  > To get the offical version, visit one of the sites mentioned above.

                  OK, for anyone else running an rpm based version of webalizer
                  (Mandrake and Red Hat linux etc.), edit your conf files to use
                  combinedio rather than combined. You may also need to move
                  mod_logio.so into your modules directory. I did with Mandrake 10.0.
                  The kB In/Out is working perfectly now.

                  I recently received a call from my hosting company that I've gone
                  over my bandwidth allocation. Now I can verify it and hopefully
                  zone in on the culprit.

                  Thanks for the help Brad!

                  Cheers,
                  Paul Rimmer
                  Calgary, Alberta, Canada
                • Bradford L. Barrett
                  ... Do not, and I repeat, DO NOT use webalizer reports to measure bandwidth used. Your ISP is most likely measuring at the interface or at a switch port,
                  Message 8 of 8 , Jun 28, 2004
                  View Source
                  • 0 Attachment
                    > I recently received a call from my hosting company that I've gone
                    > over my bandwidth allocation. Now I can verify it and hopefully
                    > zone in on the culprit.

                    Do not, and I repeat, DO NOT use webalizer reports to measure bandwidth
                    used. Your ISP is most likely measuring at the interface or at a switch
                    port, which is very accurate. HTTP logs are not accurate for a number of
                    reasons.. first off, it does not include protocol or header bandwidth. It
                    also does not take into account other non-HTTP traffic, such as DNS, ftp,
                    SMTP, ICMP, ident, etc.. And lastly, the webalizer only reports on valid
                    requests, so a great number of records are not counted in the totals.

                    --
                    Bradford L. Barrett brad@...
                    A free electron in a sea of neutrons DoD#1750 KD4NAW

                    The only thing Micro$oft has done for society, is make people
                    believe that computers are inherently unreliable.
                  Your message has been successfully submitted and would be delivered to recipients shortly.