Loading ...
Sorry, an error occurred while loading the content.
 

failure to log search strings

Expand Messages
  • David Koski
    Hello, My webalizer search strings list almost never has anything but it did recently find the following: 205.158.231.99 - - [12/Jul/2002:11:20:00 -0700] GET
    Message 1 of 11 , Jul 19, 2002
      Hello,

      My webalizer search strings list almost never has anything but it did recently find the following:

      205.158.231.99 - - [12/Jul/2002:11:20:00 -0700] "GET /island/david/index.html HTTP/1.1" 200 864 "http://groups.google.com/groups?q=Orinoco+Linux+USB&hl=en&lr=&ie=UTF-8&oe=UTF-8&selm=8sk3iuolqp975gaki4195huqa327po1lte%404ax.com&rnum=8" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; Q312461)"

      However, there are many "hits" that never make it to the table and I would like to know how to fix it. Revelant settings are:

      SearchEngine yahoo.com p=
      SearchEngine altavista.com q=
      SearchEngine google. q=
      SearchEngine eureka.com q=
      SearchEngine lycos.com query=
      SearchEngine hotbot.com MT=
      SearchEngine msn.com MT=
      SearchEngine infoseek.com qt=
      SearchEngine webcrawler searchText=
      SearchEngine excite search=
      SearchEngine netscape.com search=
      SearchEngine mamma.com query=
      SearchEngine alltheweb.com query=
      SearchEngine northernlight.com qr=

      AllSites yes
      AllURLs yes
      AllReferrers yes
      AllAgents yes
      AllSearchStr yes
      AllUsers yes

      DumpSearchStr yes

      Some example failures (separated by blank lines for clarity) are:

      129.69.66.147 - - [16/Jul/2002:10:00:48 -0700] "GET /island/david/wireless-rh-install.txt HTTP/1.0" 200 1884 "http://www.google.de/search?hl=en&ie=ISO-8859-1&newwindow=1&q=pci%3Dbiosirq&btnG=Google+Search" "Mozilla/4.78 [en] (X11; U; Linux 2.4.10-4GB i686)"

      62.47.201.60 - - [16/Jul/2002:10:52:56 -0700] "GET /island/david/wireless-rh-install.txt HTTP/1.1" 200 1884 "http://www.google.at/search?q=linux+redhat+orinoco&ie=ISO-8859-1&hl=de&meta=" "Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)"

      131.193.48.116 - - [16/Jul/2002:14:07:51 -0700] "GET /island/david/wireless-rh-install.txt HTTP/1.0" 200 1884 "http://www.google.com/search?hl=en&ie=ISO-8859-1&q=orinoco+wireless+redhat+linux" "Mozilla/4.79 [en] (X11; U; Linux 2.4.18-3 i686)"

      198.129.219.189 - - [17/Jul/2002:00:49:24 -0700] "GET /island/david/wireless-rh-install.txt HTTP/1.1" 200 1884 "http://www.google.com/search?hl=en&lr=&ie=ISO-8859-1&q=pci+biosirq+pcmcia" "Mozilla/5.0 (compatible; Konqueror/2.2; Linux)"

      212.97.184.25 - - [17/Jul/2002:05:22:38 -0700] "GET /island/david/wireless-rh-install.txt HTTP/1.1" 200 1884 "http://www.google.com/search?q=%2Borinoco+%2Bpci+%2Birq&ie=UTF-8&oe=UTF-8&hl=es&lr=" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)"

      193.243.66.2 - - [17/Jul/2002:09:12:47 -0700] "GET /island/david/wireless-rh-install.txt HTTP/1.0" 200 1884 "http://www.google.com/search?q=pci%3Dbiosirq&hl=en&lr=&ie=ISO-8859-1" "Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt)"

      212.234.248.186 - - [17/Jul/2002:09:23:39 -0700] "GET /island/david/lverror.txt HTTP/1.1" 200 3626 "http://www.google.fr/search?q=+Sorry._Although_I%27m_listed_as_a_best-preference_MX_or_A_for_that_host%2C%2Fit_isn%27t_in_my_control%2Flocals_file%2C_so_I_don%27t_treat_it_as_local&ie=ISO-8859-1&hl=fr&btnG=Recherche+Google&meta=" "Mozilla/5.0 (compatible; Konqueror/3.0.0; OpenBSD)"

      129.79.16.185 - - [17/Jul/2002:09:32:35 -0700] "GET /island/david/wireless-rh-install.txt HTTP/1.0" 200 1884 "http://www.google.com/search?hl=en&lr=&ie=ISO-8859-1&q=orinoco+wireless+redhat" "Mozilla/4.77 [en] (Windows NT 5.0; U)"

      216.23.59.184 - - [17/Jul/2002:12:07:09 -0700] "GET /island/david/wireless-rh-install.txt HTTP/1.1" 200 1884 "http://www.google.com/search?hl=en&ie=ISO-8859-1&q=hermes.conf" "Mozilla/5.0 (compatible; Konqueror/2.2.2; Linux)"

      198.129.219.189 - - [17/Jul/2002:15:04:09 -0700] "GET /island/david/wireless-rh-install.txt HTTP/1.1" 304 - "http://www.google.com/search?hl=en&ie=ISO-8859-1&q=pci+biosirq+pcmcia&btnG=Google+Search" "Mozilla/5.0 (compatible; Konqueror/2.2; Linux)"

      66.127.222.170 - - [17/Jul/2002:16:51:35 -0700] "GET /island/david/wireless-rh-install.txt HTTP/1.1" 200 1884 "http://www.google.com/search?sourceid=navclient&q=pci%3Dbiosirq" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 1.0.3705)"

      Stats:

      Mandrake 8.1
      Webalizer 2.01.06-4mdk

      TIA,
      David Koski
      david@...
    • Guy M. Grimes - UCS-COM
      David that s a function of the apache log format Here is my log file definitions in Apache s httpd.conf # LogFormat %h %l %u %t %r % s %b %{Referer}i
      Message 2 of 11 , Jul 19, 2002
        David that's a function of the apache log format Here is my log file
        definitions in Apache's httpd.conf
        # LogFormat "%h %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-Agent}i\""
        combined
        LogFormat "%h %l %u %t\ \"%r\" %>s %b \"%{Referer}i\"\"%{Search}q\"
        \"%{User-agent}i\"" combined
        LogFormat "%h %l %u %t \"%r\" %>s %b" common
        LogFormat "%{Referer}i -> %U" referer
        LogFormat "%{User-agent}i" agent

        Notice the orgional combined is commeted out this is Apache's origional
        below it is the modified format note that the "\"%{Search}q\" was added to
        the log would record search strings along with the q. for each access log
        you would use the combined beyond this point. Example:
        CustomLog /home/access_log.ultra-comm.com combined
        this is done for each virtual host log you create.

        About the SearchEngine varibles you listed below I don't know them to be
        one's that are valid for webalizer but I'm sure you got them from somewhere.
        What you need to know is not every SE passes along the search string info to
        the Apache Server if not it won't get loged. The entries from your access
        log below will show up in your webalzer reports with the default
        webalizer.conf file. This is how your search string report will come out:
        http://www.computer.at/_stats/usage_200207.html#TOPSEARCH
        Not sure why you have added the varibles below but the default will provide
        the reports you see above. It's one of my German hosting clients you can
        use to compare. The access log entries below show that SE info is being
        logged so the next step will be to get your webalizer config file back to
        default I think thats the main problem. Hope this helps.

        Guy M. Grimes ggrimes@... Support:
        support@...

        Ultra Comm Services www.ultra-comm.com 800-477-0969 Fax
        580-477-0499
        "Full Service E-Commerce Solutions, Website Hosting, Design, Management and
        Marketing for the serious on-line Entrepreneur"

        ----- Original Message -----
        From: "David Koski" <david@...>
        To: <webalizer@yahoogroups.com>
        Sent: Friday, July 19, 2002 12:42 PM
        Subject: [webalizer] failure to log search strings


        > Hello,
        >
        > My webalizer search strings list almost never has anything but it did
        recently find the following:
        >
        > 205.158.231.99 - - [12/Jul/2002:11:20:00 -0700] "GET
        /island/david/index.html HTTP/1.1" 200 864
        "http://groups.google.com/groups?q=Orinoco+Linux+USB&hl=en&lr=&ie=UTF-8&oe=U
        TF-8&selm=8sk3iuolqp975gaki4195huqa327po1lte%404ax.com&rnum=8" "Mozilla/4.0
        (compatible; MSIE 6.0; Windows NT 5.0; Q312461)"
        >
        > However, there are many "hits" that never make it to the table and I would
        like to know how to fix it. Revelant settings are:
        >
        > SearchEngine yahoo.com p=
        > SearchEngine altavista.com q=
        > SearchEngine google. q=
        > SearchEngine eureka.com q=
        > SearchEngine lycos.com query=
        > SearchEngine hotbot.com MT=
        > SearchEngine msn.com MT=
        > SearchEngine infoseek.com qt=
        > SearchEngine webcrawler searchText=
        > SearchEngine excite search=
        > SearchEngine netscape.com search=
        > SearchEngine mamma.com query=
        > SearchEngine alltheweb.com query=
        > SearchEngine northernlight.com qr=
        >
        > AllSites yes
        > AllURLs yes
        > AllReferrers yes
        > AllAgents yes
        > AllSearchStr yes
        > AllUsers yes
        >
        > DumpSearchStr yes
        >
        > Some example failures (separated by blank lines for clarity) are:
        >
        > 129.69.66.147 - - [16/Jul/2002:10:00:48 -0700] "GET
        /island/david/wireless-rh-install.txt HTTP/1.0" 200 1884
        "http://www.google.de/search?hl=en&ie=ISO-8859-1&newwindow=1&q=pci%3Dbiosirq
        &btnG=Google+Search" "Mozilla/4.78 [en] (X11; U; Linux 2.4.10-4GB i686)"
        >
        > 62.47.201.60 - - [16/Jul/2002:10:52:56 -0700] "GET
        /island/david/wireless-rh-install.txt HTTP/1.1" 200 1884
        "http://www.google.at/search?q=linux+redhat+orinoco&ie=ISO-8859-1&hl=de&meta
        =" "Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)"
        >
        > 131.193.48.116 - - [16/Jul/2002:14:07:51 -0700] "GET
        /island/david/wireless-rh-install.txt HTTP/1.0" 200 1884
        "http://www.google.com/search?hl=en&ie=ISO-8859-1&q=orinoco+wireless+redhat+
        linux" "Mozilla/4.79 [en] (X11; U; Linux 2.4.18-3 i686)"
        >
        > 198.129.219.189 - - [17/Jul/2002:00:49:24 -0700] "GET
        /island/david/wireless-rh-install.txt HTTP/1.1" 200 1884
        "http://www.google.com/search?hl=en&lr=&ie=ISO-8859-1&q=pci+biosirq+pcmcia"
        "Mozilla/5.0 (compatible; Konqueror/2.2; Linux)"
        >
        > 212.97.184.25 - - [17/Jul/2002:05:22:38 -0700] "GET
        /island/david/wireless-rh-install.txt HTTP/1.1" 200 1884
        "http://www.google.com/search?q=%2Borinoco+%2Bpci+%2Birq&ie=UTF-8&oe=UTF-8&h
        l=es&lr=" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)"
        >
        > 193.243.66.2 - - [17/Jul/2002:09:12:47 -0700] "GET
        /island/david/wireless-rh-install.txt HTTP/1.0" 200 1884
        "http://www.google.com/search?q=pci%3Dbiosirq&hl=en&lr=&ie=ISO-8859-1"
        "Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt)"
        >
        > 212.234.248.186 - - [17/Jul/2002:09:23:39 -0700] "GET
        /island/david/lverror.txt HTTP/1.1" 200 3626
        "http://www.google.fr/search?q=+Sorry._Although_I%27m_listed_as_a_best-prefe
        rence_MX_or_A_for_that_host%2C%2Fit_isn%27t_in_my_control%2Flocals_file%2C_s
        o_I_don%27t_treat_it_as_local&ie=ISO-8859-1&hl=fr&btnG=Recherche+Google&meta
        =" "Mozilla/5.0 (compatible; Konqueror/3.0.0; OpenBSD)"
        >
        > 129.79.16.185 - - [17/Jul/2002:09:32:35 -0700] "GET
        /island/david/wireless-rh-install.txt HTTP/1.0" 200 1884
        "http://www.google.com/search?hl=en&lr=&ie=ISO-8859-1&q=orinoco+wireless+red
        hat" "Mozilla/4.77 [en] (Windows NT 5.0; U)"
        >
        > 216.23.59.184 - - [17/Jul/2002:12:07:09 -0700] "GET
        /island/david/wireless-rh-install.txt HTTP/1.1" 200 1884
        "http://www.google.com/search?hl=en&ie=ISO-8859-1&q=hermes.conf"
        "Mozilla/5.0 (compatible; Konqueror/2.2.2; Linux)"
        >
        > 198.129.219.189 - - [17/Jul/2002:15:04:09 -0700] "GET
        /island/david/wireless-rh-install.txt HTTP/1.1" 304 -
        "http://www.google.com/search?hl=en&ie=ISO-8859-1&q=pci+biosirq+pcmcia&btnG=
        Google+Search" "Mozilla/5.0 (compatible; Konqueror/2.2; Linux)"
        >
        > 66.127.222.170 - - [17/Jul/2002:16:51:35 -0700] "GET
        /island/david/wireless-rh-install.txt HTTP/1.1" 200 1884
        "http://www.google.com/search?sourceid=navclient&q=pci%3Dbiosirq"
        "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 1.0.3705)"
        >
        > Stats:
        >
        > Mandrake 8.1
        > Webalizer 2.01.06-4mdk
        >
        > TIA,
        > David Koski
        > david@...
        >
        >
        >
        >
        > To unsubscribe from this group, send an email to:
        > webalizer-unsubscribe@egroups.com
        > Webalizer homepage: http://www.webalizer.org
        > Webalizer for NT: http://www.medasys-lille.com/webalizer/
        >
        >
        >
        >
        > Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/
        >
      • David Koski
        Hello, Thank you for taking the time to reply! On Fri, 19 Jul 2002 14:53:37 -0500 ... Okay, I changed my combined line from: LogFormat %h %l %u %t %r % s
        Message 3 of 11 , Jul 19, 2002
          Hello,

          Thank you for taking the time to reply!

          On Fri, 19 Jul 2002 14:53:37 -0500
          "Guy M. Grimes - UCS-COM" <ggrimes@...> wrote:

          > David that's a function of the apache log format Here is my log file
          > definitions in Apache's httpd.conf
          > # LogFormat "%h %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-Agent}i\""
          > combined
          > LogFormat "%h %l %u %t\ \"%r\" %>s %b \"%{Referer}i\"\"%{Search}q\"
          > \"%{User-agent}i\"" combined
          > LogFormat "%h %l %u %t \"%r\" %>s %b" common
          > LogFormat "%{Referer}i -> %U" referer
          > LogFormat "%{User-agent}i" agent

          Okay, I changed my combined line from:

          LogFormat "%h %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-Agent}i\"" combined

          To:

          LogFormat "%h %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{Search}q\" \"%{User-Agent}i\"" combined

          ..although I did not find any docs on the %{Search} directive at apache (http://httpd.apache.org/docs-2.0/mod/mod_log_config.html#format). Now the log file shows an empty quoted string for the %{Search}:

          192.168.12.11 - - [19/Jul/2002:13:28:41 -0700] "GET /island/david/wireless-rh-install.txt HTTP/1.1" 200 1884 "http://www.google.com/search?q=redhat%20orinoco%20wireless&hl=en&lr=&ie=UTF-8&sa=N&tab=gw" "" "Mozilla/4.0 (compatible; MSIE 5.0; Linux 2.4.17 i586) Opera 6.02 [en]"

          Is the "" for %{Search}q the desired result?

          I assume webalizer is not able to parse the search string from the %{Referer} field in the default LogFormat but %{Search} does not appear to be working either.

          > Notice the orgional combined is commeted out this is Apache's origional
          > below it is the modified format note that the "\"%{Search}q\" was added to
          > the log would record search strings along with the q. for each access log
          > you would use the combined beyond this point. Example:
          > CustomLog /home/access_log.ultra-comm.com combined
          > this is done for each virtual host log you create.
          >
          > About the SearchEngine varibles you listed below I don't know them to be
          > one's that are valid for webalizer but I'm sure you got them from somewhere.

          They are default; the ones that were there when I installed webalizer.

          > What you need to know is not every SE passes along the search string info to
          > the Apache Server if not it won't get loged. The entries from your access

          But it is clear that there are search strings in the apache access log, as seen below, that are not found by webalizer.

          > log below will show up in your webalzer reports with the default
          > webalizer.conf file.

          But they didn't show up as search strings. That is why I tried changing webalizer.conf, to no avail.

          > This is how your search string report will come out:
          > http://www.computer.at/_stats/usage_200207.html#TOPSEARCH

          There is only one search string in my report and that is the mystery. There are many search strings in the apache log but webalizer does not find most of them. Why would it even find one? (See original post below.)

          > Not sure why you have added the varibles below but the default will provide
          > the reports you see above. It's one of my German hosting clients you can
          > use to compare. The access log entries below show that SE info is being
          > logged so the next step will be to get your webalizer config file back to
          > default I think thats the main problem. Hope this helps.

          I take it you are saying I should try the default webalizer.conf with the apache log modifications and that should work. Should the log entry be blank ("") for the search string as shown above? Is that the desired result?

          > ----- Original Message -----
          >
          > > Hello,
          > >
          > > My webalizer search strings list almost never has anything but it did
          > recently find the following:
          > >
          > > 205.158.231.99 - - [12/Jul/2002:11:20:00 -0700] "GET
          > /island/david/index.html HTTP/1.1" 200 864
          > "http://groups.google.com/groups?q=Orinoco+Linux+USB&hl=en&lr=&ie=UTF-8&oe=U
          > TF-8&selm=8sk3iuolqp975gaki4195huqa327po1lte%404ax.com&rnum=8" "Mozilla/4.0
          > (compatible; MSIE 6.0; Windows NT 5.0; Q312461)"
          > >
          > > However, there are many "hits" that never make it to the table and I would
          > like to know how to fix it. Revelant settings are:
          > >
          > > SearchEngine yahoo.com p=
          > > SearchEngine altavista.com q=
          > > SearchEngine google. q=
          > > SearchEngine eureka.com q=
          > > SearchEngine lycos.com query=
          > > SearchEngine hotbot.com MT=
          > > SearchEngine msn.com MT=
          > > SearchEngine infoseek.com qt=
          > > SearchEngine webcrawler searchText=
          > > SearchEngine excite search=
          > > SearchEngine netscape.com search=
          > > SearchEngine mamma.com query=
          > > SearchEngine alltheweb.com query=
          > > SearchEngine northernlight.com qr=
          > >
          > > AllSites yes
          > > AllURLs yes
          > > AllReferrers yes
          > > AllAgents yes
          > > AllSearchStr yes
          > > AllUsers yes
          > >
          > > DumpSearchStr yes
          > >
          > > Some example failures (separated by blank lines for clarity) are:
          > >
          > > 129.69.66.147 - - [16/Jul/2002:10:00:48 -0700] "GET
          > /island/david/wireless-rh-install.txt HTTP/1.0" 200 1884
          > "http://www.google.de/search?hl=en&ie=ISO-8859-1&newwindow=1&q=pci%3Dbiosirq
          > &btnG=Google+Search" "Mozilla/4.78 [en] (X11; U; Linux 2.4.10-4GB i686)"
          > >
          > > 62.47.201.60 - - [16/Jul/2002:10:52:56 -0700] "GET
          > /island/david/wireless-rh-install.txt HTTP/1.1" 200 1884
          > "http://www.google.at/search?q=linux+redhat+orinoco&ie=ISO-8859-1&hl=de&meta
          > =" "Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)"
          > >
          > > 131.193.48.116 - - [16/Jul/2002:14:07:51 -0700] "GET
          > /island/david/wireless-rh-install.txt HTTP/1.0" 200 1884
          > "http://www.google.com/search?hl=en&ie=ISO-8859-1&q=orinoco+wireless+redhat+
          > linux" "Mozilla/4.79 [en] (X11; U; Linux 2.4.18-3 i686)"
          > >
          > > 198.129.219.189 - - [17/Jul/2002:00:49:24 -0700] "GET
          > /island/david/wireless-rh-install.txt HTTP/1.1" 200 1884
          > "http://www.google.com/search?hl=en&lr=&ie=ISO-8859-1&q=pci+biosirq+pcmcia"
          > "Mozilla/5.0 (compatible; Konqueror/2.2; Linux)"
          > >
          > > 212.97.184.25 - - [17/Jul/2002:05:22:38 -0700] "GET
          > /island/david/wireless-rh-install.txt HTTP/1.1" 200 1884
          > "http://www.google.com/search?q=%2Borinoco+%2Bpci+%2Birq&ie=UTF-8&oe=UTF-8&h
          > l=es&lr=" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)"
          > >
          > > 193.243.66.2 - - [17/Jul/2002:09:12:47 -0700] "GET
          > /island/david/wireless-rh-install.txt HTTP/1.0" 200 1884
          > "http://www.google.com/search?q=pci%3Dbiosirq&hl=en&lr=&ie=ISO-8859-1"
          > "Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt)"
          > >
          > > 212.234.248.186 - - [17/Jul/2002:09:23:39 -0700] "GET
          > /island/david/lverror.txt HTTP/1.1" 200 3626
          > "http://www.google.fr/search?q=+Sorry._Although_I%27m_listed_as_a_best-prefe
          > rence_MX_or_A_for_that_host%2C%2Fit_isn%27t_in_my_control%2Flocals_file%2C_s
          > o_I_don%27t_treat_it_as_local&ie=ISO-8859-1&hl=fr&btnG=Recherche+Google&meta
          > =" "Mozilla/5.0 (compatible; Konqueror/3.0.0; OpenBSD)"
          > >
          > > 129.79.16.185 - - [17/Jul/2002:09:32:35 -0700] "GET
          > /island/david/wireless-rh-install.txt HTTP/1.0" 200 1884
          > "http://www.google.com/search?hl=en&lr=&ie=ISO-8859-1&q=orinoco+wireless+red
          > hat" "Mozilla/4.77 [en] (Windows NT 5.0; U)"
          > >
          > > 216.23.59.184 - - [17/Jul/2002:12:07:09 -0700] "GET
          > /island/david/wireless-rh-install.txt HTTP/1.1" 200 1884
          > "http://www.google.com/search?hl=en&ie=ISO-8859-1&q=hermes.conf"
          > "Mozilla/5.0 (compatible; Konqueror/2.2.2; Linux)"
          > >
          > > 198.129.219.189 - - [17/Jul/2002:15:04:09 -0700] "GET
          > /island/david/wireless-rh-install.txt HTTP/1.1" 304 -
          > "http://www.google.com/search?hl=en&ie=ISO-8859-1&q=pci+biosirq+pcmcia&btnG=
          > Google+Search" "Mozilla/5.0 (compatible; Konqueror/2.2; Linux)"
          > >
          > > 66.127.222.170 - - [17/Jul/2002:16:51:35 -0700] "GET
          > /island/david/wireless-rh-install.txt HTTP/1.1" 200 1884
          > "http://www.google.com/search?sourceid=navclient&q=pci%3Dbiosirq"
          > "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 1.0.3705)"
          > >
          > > Stats:
          > >
          > > Mandrake 8.1
          > > Webalizer 2.01.06-4mdk
          > >
          > > TIA,
          > > David Koski
          > > david@...
          > >
          > >
          > >
          > >
          > > To unsubscribe from this group, send an email to:
          > > webalizer-unsubscribe@egroups.com
          > > Webalizer homepage: http://www.webalizer.org
          > > Webalizer for NT: http://www.medasys-lille.com/webalizer/
        • mikalgis
          David; I am not sure of how much truth is in mys statement but I think you have to define each search engine as a different one; ie: GroupReferrer lycos.com/
          Message 4 of 11 , Jul 19, 2002
            David;

            I am not sure of how much truth is in mys statement but I think you
            have to define each search engine as a different one; ie:

            GroupReferrer lycos.com/ Lycos
            GroupReferrer lycos.de/ Lycos
            GroupReferrer lycos.fr/ Lycos
            GroupReferrer lycos.uk/ Lycos
            GroupReferrer sg.lycosasia.com/ Lycos
            GroupReferrer nbci.com/ NBCI
            GroupReferrer google.com/ Google
            GroupReferrer google.de/ Google
            GroupReferrer google.fr/ Google
            GroupReferrer google.co.uk/ Google
            GroupReferrer google.ca/ Google
            GroupReferrer google.ch/ Google
            GroupReferrer google.be/ Google
            GroupReferrer google.at/ Google
            GroupReferrer google.com./ Google
            GroupReferrer google.cl/ Google
            GroupReferrer google.co.jp/ Google
            GroupReferrer google.com.ar/ Google
            GroupReferrer google.nl/ Google
            GroupReferrer google.co.nz/ Google
            GroupReferrer google.com.br/ Google
            etc.......
            HideReferrer if you like.......
            And then:
            SearchEngine google.it q=
            SearchEngine gogle.com.ar q=
            SearchEngine google.nl q=
            SearchEngine google.com.br q=
            SearchEngine eureka.com q=
            SearchEngine lycos.com query=
            SearchEngine lycos.de query=
            SearchEngine lycos.fr query=
            SearchEngine sg.lycosasia.com query=
            SearchEngine hotbot.com MT=
            SearchEngine msn.com MT=
            Etc........

            Same for the HideReferrer and SearchEngine status. It works for me
            at least :) Over the time; I have cmpile a .long list of SEs and
            have track them in my Apache log file.
            I am now experimenting - thinking (sinking?) about my IIS logs :D

            Hope this will help,


            Algis
          • John Elvin
            You can use generic lines for the search engines e.g. SearchEngine google. q= SearchEngine googel. q= will deal with ALL variants of google. John ... From:
            Message 5 of 11 , Jul 20, 2002
              You can use generic lines for the search engines e.g.

              SearchEngine google. q=
              SearchEngine googel. q=

              will deal with ALL variants of google.

              John

              -----Original Message-----
              From: mikalgis [mailto:mikalgis@...]
              Sent: 20 July 2002 05:59
              To: webalizer@yahoogroups.com
              Subject: [webalizer] Re: failure to log search strings


              David;

              I am not sure of how much truth is in mys statement but I think you
              have to define each search engine as a different one; ie:

              GroupReferrer lycos.com/ Lycos
              GroupReferrer lycos.de/ Lycos
              GroupReferrer lycos.fr/ Lycos
              GroupReferrer lycos.uk/ Lycos
              GroupReferrer sg.lycosasia.com/ Lycos
              GroupReferrer nbci.com/ NBCI
              GroupReferrer google.com/ Google
              GroupReferrer google.de/ Google
              GroupReferrer google.fr/ Google
              GroupReferrer google.co.uk/ Google
              GroupReferrer google.ca/ Google
              GroupReferrer google.ch/ Google
              GroupReferrer google.be/ Google
              GroupReferrer google.at/ Google
              GroupReferrer google.com./ Google
              GroupReferrer google.cl/ Google
              GroupReferrer google.co.jp/ Google
              GroupReferrer google.com.ar/ Google
              GroupReferrer google.nl/ Google
              GroupReferrer google.co.nz/ Google
              GroupReferrer google.com.br/ Google
              etc.......
              HideReferrer if you like.......
              And then:
              SearchEngine google.it q=
              SearchEngine gogle.com.ar q=
              SearchEngine google.nl q=
              SearchEngine google.com.br q=
              SearchEngine eureka.com q=
              SearchEngine lycos.com query=
              SearchEngine lycos.de query=
              SearchEngine lycos.fr query=
              SearchEngine sg.lycosasia.com query=
              SearchEngine hotbot.com MT=
              SearchEngine msn.com MT=
              Etc........

              Same for the HideReferrer and SearchEngine status. It works for me
              at least :) Over the time; I have cmpile a .long list of SEs and
              have track them in my Apache log file.
              I am now experimenting - thinking (sinking?) about my IIS logs :D

              Hope this will help,


              Algis



              To unsubscribe from this group, send an email to:
              webalizer-unsubscribe@egroups.com
              Webalizer homepage: http://www.webalizer.org
              Webalizer for NT: http://www.medasys-lille.com/webalizer/




              Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/
            • Kees de Keizer
              ... You should add SearchEngine yahoo.com p= before the google entries otherwise they will not be parsed. -- Kees de Keizer NT Administrator T:
              Message 6 of 11 , Jul 21, 2002
                On Sat, 20 Jul 2002, John Elvin wrote:

                >You can use generic lines for the search engines e.g.
                >
                >SearchEngine google. q=
                >SearchEngine googel. q=
                >
                >will deal with ALL variants of google.

                You should add "SearchEngine yahoo.com p=" before the google
                entries otherwise they will not be parsed.
                --
                Kees de Keizer NT Administrator T: +31-10-2448344
                Wirehub! Internet PGP: 0x24E3770B F: +31-10-2448356
                http://www.wirehub.net/ mailto:kees.de.keizer@...
              • David Koski
                On Sun, 21 Jul 2002 09:41:31 +0200 (W. Europe Daylight Time) ... How so? david
                Message 7 of 11 , Jul 21, 2002
                  On Sun, 21 Jul 2002 09:41:31 +0200 (W. Europe Daylight Time)
                  Kees de Keizer <kees.de.keizer@...> wrote:

                  > On Sat, 20 Jul 2002, John Elvin wrote:
                  >
                  > >You can use generic lines for the search engines e.g.
                  > >
                  > >SearchEngine google. q=
                  > >SearchEngine googel. q=
                  > >
                  > >will deal with ALL variants of google.
                  >
                  > You should add "SearchEngine yahoo.com p=" before the google
                  > entries otherwise they will not be parsed.

                  How so?

                  david
                • David Koski
                  On Fri, 19 Jul 2002 14:53:37 -0500 ... The webalizer README: Search strings are obtained from the referrer field in the record... ... Okay, I got the
                  Message 8 of 11 , Jul 21, 2002
                    On Fri, 19 Jul 2002 14:53:37 -0500
                    "Guy M. Grimes - UCS-COM" <ggrimes@...> wrote:

                    > David that's a function of the apache log format Here is my log file
                    > definitions in Apache's httpd.conf
                    > # LogFormat "%h %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-Agent}i\""
                    > combined
                    > LogFormat "%h %l %u %t\ \"%r\" %>s %b \"%{Referer}i\"\"%{Search}q\"
                    > \"%{User-agent}i\"" combined
                    > LogFormat "%h %l %u %t \"%r\" %>s %b" common
                    > LogFormat "%{Referer}i -> %U" referer
                    > LogFormat "%{User-agent}i" agent
                    >
                    > Notice the orgional combined is commeted out this is Apache's origional
                    > below it is the modified format note that the "\"%{Search}q\" was added to

                    The webalizer README:

                    "Search strings are obtained from the referrer field in the record..."

                    > the log would record search strings along with the q. for each access log
                    > you would use the combined beyond this point. Example:
                    > CustomLog /home/access_log.ultra-comm.com combined
                    > this is done for each virtual host log you create.
                    >
                    > About the SearchEngine varibles you listed below I don't know them to be
                    > one's that are valid for webalizer but I'm sure you got them from somewhere.
                    > What you need to know is not every SE passes along the search string info to
                    > the Apache Server if not it won't get loged. The entries from your access
                    > log below will show up in your webalzer reports with the default
                    > webalizer.conf file. This is how your search string report will come out:
                    > http://www.computer.at/_stats/usage_200207.html#TOPSEARCH
                    > Not sure why you have added the varibles below but the default will provide
                    > the reports you see above. It's one of my German hosting clients you can
                    > use to compare. The access log entries below show that SE info is being
                    > logged so the next step will be to get your webalizer config file back to
                    > default I think thats the main problem. Hope this helps.

                    Okay, I got the webalizer confib back to default. It still does not work. No search strings (other than the one "fluke" indicated below in my original message.)

                    > Guy M. Grimes ggrimes@... Support:
                    > support@...
                    >
                    > Ultra Comm Services www.ultra-comm.com 800-477-0969 Fax
                    > 580-477-0499
                    > "Full Service E-Commerce Solutions, Website Hosting, Design, Management and
                    > Marketing for the serious on-line Entrepreneur"
                    >
                    > ----- Original Message -----
                    > From: "David Koski" <david@...>
                    > To: <webalizer@yahoogroups.com>
                    > Sent: Friday, July 19, 2002 12:42 PM
                    > Subject: [webalizer] failure to log search strings
                    >
                    >
                    > > Hello,
                    > >
                    > > My webalizer search strings list almost never has anything but it did
                    > recently find the following:
                    > >
                    > > 205.158.231.99 - - [12/Jul/2002:11:20:00 -0700] "GET
                    > /island/david/index.html HTTP/1.1" 200 864
                    > "http://groups.google.com/groups?q=Orinoco+Linux+USB&hl=en&lr=&ie=UTF-8&oe=U
                    > TF-8&selm=8sk3iuolqp975gaki4195huqa327po1lte%404ax.com&rnum=8" "Mozilla/4.0
                    > (compatible; MSIE 6.0; Windows NT 5.0; Q312461)"
                    > >
                    > > However, there are many "hits" that never make it to the table and I would
                    > like to know how to fix it. Revelant settings are:
                    > >
                    > > SearchEngine yahoo.com p=
                    > > SearchEngine altavista.com q=
                    > > SearchEngine google. q=
                    > > SearchEngine eureka.com q=
                    > > SearchEngine lycos.com query=
                    > > SearchEngine hotbot.com MT=
                    > > SearchEngine msn.com MT=
                    > > SearchEngine infoseek.com qt=
                    > > SearchEngine webcrawler searchText=
                    > > SearchEngine excite search=
                    > > SearchEngine netscape.com search=
                    > > SearchEngine mamma.com query=
                    > > SearchEngine alltheweb.com query=
                    > > SearchEngine northernlight.com qr=
                    > >
                    > > AllSites yes
                    > > AllURLs yes
                    > > AllReferrers yes
                    > > AllAgents yes
                    > > AllSearchStr yes
                    > > AllUsers yes
                    > >
                    > > DumpSearchStr yes
                    > >
                    > > Some example failures (separated by blank lines for clarity) are:
                    > >
                    > > 129.69.66.147 - - [16/Jul/2002:10:00:48 -0700] "GET
                    > /island/david/wireless-rh-install.txt HTTP/1.0" 200 1884
                    > "http://www.google.de/search?hl=en&ie=ISO-8859-1&newwindow=1&q=pci%3Dbiosirq
                    > &btnG=Google+Search" "Mozilla/4.78 [en] (X11; U; Linux 2.4.10-4GB i686)"
                    > >
                    > > 62.47.201.60 - - [16/Jul/2002:10:52:56 -0700] "GET
                    > /island/david/wireless-rh-install.txt HTTP/1.1" 200 1884
                    > "http://www.google.at/search?q=linux+redhat+orinoco&ie=ISO-8859-1&hl=de&meta
                    > =" "Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)"
                    > >
                    > > 131.193.48.116 - - [16/Jul/2002:14:07:51 -0700] "GET
                    > /island/david/wireless-rh-install.txt HTTP/1.0" 200 1884
                    > "http://www.google.com/search?hl=en&ie=ISO-8859-1&q=orinoco+wireless+redhat+
                    > linux" "Mozilla/4.79 [en] (X11; U; Linux 2.4.18-3 i686)"
                    > >
                    > > 198.129.219.189 - - [17/Jul/2002:00:49:24 -0700] "GET
                    > /island/david/wireless-rh-install.txt HTTP/1.1" 200 1884
                    > "http://www.google.com/search?hl=en&lr=&ie=ISO-8859-1&q=pci+biosirq+pcmcia"
                    > "Mozilla/5.0 (compatible; Konqueror/2.2; Linux)"
                    > >
                    > > 212.97.184.25 - - [17/Jul/2002:05:22:38 -0700] "GET
                    > /island/david/wireless-rh-install.txt HTTP/1.1" 200 1884
                    > "http://www.google.com/search?q=%2Borinoco+%2Bpci+%2Birq&ie=UTF-8&oe=UTF-8&h
                    > l=es&lr=" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)"
                    > >
                    > > 193.243.66.2 - - [17/Jul/2002:09:12:47 -0700] "GET
                    > /island/david/wireless-rh-install.txt HTTP/1.0" 200 1884
                    > "http://www.google.com/search?q=pci%3Dbiosirq&hl=en&lr=&ie=ISO-8859-1"
                    > "Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt)"
                    > >
                    > > 212.234.248.186 - - [17/Jul/2002:09:23:39 -0700] "GET
                    > /island/david/lverror.txt HTTP/1.1" 200 3626
                    > "http://www.google.fr/search?q=+Sorry._Although_I%27m_listed_as_a_best-prefe
                    > rence_MX_or_A_for_that_host%2C%2Fit_isn%27t_in_my_control%2Flocals_file%2C_s
                    > o_I_don%27t_treat_it_as_local&ie=ISO-8859-1&hl=fr&btnG=Recherche+Google&meta
                    > =" "Mozilla/5.0 (compatible; Konqueror/3.0.0; OpenBSD)"
                    > >
                    > > 129.79.16.185 - - [17/Jul/2002:09:32:35 -0700] "GET
                    > /island/david/wireless-rh-install.txt HTTP/1.0" 200 1884
                    > "http://www.google.com/search?hl=en&lr=&ie=ISO-8859-1&q=orinoco+wireless+red
                    > hat" "Mozilla/4.77 [en] (Windows NT 5.0; U)"
                    > >
                    > > 216.23.59.184 - - [17/Jul/2002:12:07:09 -0700] "GET
                    > /island/david/wireless-rh-install.txt HTTP/1.1" 200 1884
                    > "http://www.google.com/search?hl=en&ie=ISO-8859-1&q=hermes.conf"
                    > "Mozilla/5.0 (compatible; Konqueror/2.2.2; Linux)"
                    > >
                    > > 198.129.219.189 - - [17/Jul/2002:15:04:09 -0700] "GET
                    > /island/david/wireless-rh-install.txt HTTP/1.1" 304 -
                    > "http://www.google.com/search?hl=en&ie=ISO-8859-1&q=pci+biosirq+pcmcia&btnG=
                    > Google+Search" "Mozilla/5.0 (compatible; Konqueror/2.2; Linux)"
                    > >
                    > > 66.127.222.170 - - [17/Jul/2002:16:51:35 -0700] "GET
                    > /island/david/wireless-rh-install.txt HTTP/1.1" 200 1884
                    > "http://www.google.com/search?sourceid=navclient&q=pci%3Dbiosirq"
                    > "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 1.0.3705)"
                    > >
                    > > Stats:
                    > >
                    > > Mandrake 8.1
                    > > Webalizer 2.01.06-4mdk
                    > >
                    > > TIA,
                    > > David Koski
                    > > david@...
                    > >
                    > >
                    > >
                    > >
                    > > To unsubscribe from this group, send an email to:
                    > > webalizer-unsubscribe@egroups.com
                    > > Webalizer homepage: http://www.webalizer.org
                    > > Webalizer for NT: http://www.medasys-lille.com/webalizer/
                    > >
                    > >
                    > >
                    > >
                    > > Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/
                    > >
                    >
                    >
                    >
                    >
                    > To unsubscribe from this group, send an email to:
                    > webalizer-unsubscribe@egroups.com
                    > Webalizer homepage: http://www.webalizer.org
                    > Webalizer for NT: http://www.medasys-lille.com/webalizer/
                    >
                    >
                    >
                    >
                    > Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/
                    >
                    >
                    >
                  • Guy M. Grimes - UCS-COM
                    Try moving this month report files out of the _stats directory and re-run and rebuild this month reports. That would be all *200207* html and png files. This
                    Message 9 of 11 , Jul 21, 2002
                      Try moving this month report files out of the _stats directory and re-run
                      and rebuild this month reports. That would be all *200207* html and png
                      files. This should rebuild the months report format.

                      ----- Original Message -----
                      From: "David Koski" <david@...>
                      To: <webalizer@yahoogroups.com>
                      Sent: Sunday, July 21, 2002 2:08 PM
                      Subject: Re: [webalizer] failure to log search strings


                      > On Fri, 19 Jul 2002 14:53:37 -0500
                      > "Guy M. Grimes - UCS-COM" <ggrimes@...> wrote:
                      >
                      > > David that's a function of the apache log format Here is my log file
                      > > definitions in Apache's httpd.conf
                      > > # LogFormat "%h %l %u %t \"%r\" %>s %b \"%{Referer}i\"
                      \"%{User-Agent}i\""
                      > > combined
                      > > LogFormat "%h %l %u %t\ \"%r\" %>s %b \"%{Referer}i\"\"%{Search}q\"
                      > > \"%{User-agent}i\"" combined
                      > > LogFormat "%h %l %u %t \"%r\" %>s %b" common
                      > > LogFormat "%{Referer}i -> %U" referer
                      > > LogFormat "%{User-agent}i" agent
                      > >
                      > > Notice the orgional combined is commeted out this is Apache's origional
                      > > below it is the modified format note that the "\"%{Search}q\" was added
                      to
                      >
                      > The webalizer README:
                      >
                      > "Search strings are obtained from the referrer field in the record..."
                      >
                      > > the log would record search strings along with the q. for each access
                      log
                      > > you would use the combined beyond this point. Example:
                      > > CustomLog /home/access_log.ultra-comm.com combined
                      > > this is done for each virtual host log you create.
                      > >
                      > > About the SearchEngine varibles you listed below I don't know them to be
                      > > one's that are valid for webalizer but I'm sure you got them from
                      somewhere.
                      > > What you need to know is not every SE passes along the search string
                      info to
                      > > the Apache Server if not it won't get loged. The entries from your
                      access
                      > > log below will show up in your webalzer reports with the default
                      > > webalizer.conf file. This is how your search string report will come
                      out:
                      > > http://www.computer.at/_stats/usage_200207.html#TOPSEARCH
                      > > Not sure why you have added the varibles below but the default will
                      provide
                      > > the reports you see above. It's one of my German hosting clients you
                      can
                      > > use to compare. The access log entries below show that SE info is being
                      > > logged so the next step will be to get your webalizer config file back
                      to
                      > > default I think thats the main problem. Hope this helps.
                      >
                      > Okay, I got the webalizer confib back to default. It still does not work.
                      No search strings (other than the one "fluke" indicated below in my original
                      message.)
                      >
                      > > Guy M. Grimes ggrimes@... Support:
                      > > support@...
                      > >
                      > > Ultra Comm Services www.ultra-comm.com 800-477-0969 Fax
                      > > 580-477-0499
                      > > "Full Service E-Commerce Solutions, Website Hosting, Design, Management
                      and
                      > > Marketing for the serious on-line Entrepreneur"
                      > >
                      > > ----- Original Message -----
                      > > From: "David Koski" <david@...>
                      > > To: <webalizer@yahoogroups.com>
                      > > Sent: Friday, July 19, 2002 12:42 PM
                      > > Subject: [webalizer] failure to log search strings
                      > >
                      > >
                      > > > Hello,
                      > > >
                      > > > My webalizer search strings list almost never has anything but it did
                      > > recently find the following:
                      > > >
                      > > > 205.158.231.99 - - [12/Jul/2002:11:20:00 -0700] "GET
                      > > /island/david/index.html HTTP/1.1" 200 864
                      > >
                      "http://groups.google.com/groups?q=Orinoco+Linux+USB&hl=en&lr=&ie=UTF-8&oe=U
                      > > TF-8&selm=8sk3iuolqp975gaki4195huqa327po1lte%404ax.com&rnum=8"
                      "Mozilla/4.0
                      > > (compatible; MSIE 6.0; Windows NT 5.0; Q312461)"
                      > > >
                      > > > However, there are many "hits" that never make it to the table and I
                      would
                      > > like to know how to fix it. Revelant settings are:
                      > > >
                      > > > SearchEngine yahoo.com p=
                      > > > SearchEngine altavista.com q=
                      > > > SearchEngine google. q=
                      > > > SearchEngine eureka.com q=
                      > > > SearchEngine lycos.com query=
                      > > > SearchEngine hotbot.com MT=
                      > > > SearchEngine msn.com MT=
                      > > > SearchEngine infoseek.com qt=
                      > > > SearchEngine webcrawler searchText=
                      > > > SearchEngine excite search=
                      > > > SearchEngine netscape.com search=
                      > > > SearchEngine mamma.com query=
                      > > > SearchEngine alltheweb.com query=
                      > > > SearchEngine northernlight.com qr=
                      > > >
                      > > > AllSites yes
                      > > > AllURLs yes
                      > > > AllReferrers yes
                      > > > AllAgents yes
                      > > > AllSearchStr yes
                      > > > AllUsers yes
                      > > >
                      > > > DumpSearchStr yes
                      > > >
                      > > > Some example failures (separated by blank lines for clarity) are:
                      > > >
                      > > > 129.69.66.147 - - [16/Jul/2002:10:00:48 -0700] "GET
                      > > /island/david/wireless-rh-install.txt HTTP/1.0" 200 1884
                      > >
                      "http://www.google.de/search?hl=en&ie=ISO-8859-1&newwindow=1&q=pci%3Dbiosirq
                      > > &btnG=Google+Search" "Mozilla/4.78 [en] (X11; U; Linux 2.4.10-4GB i686)"
                      > > >
                      > > > 62.47.201.60 - - [16/Jul/2002:10:52:56 -0700] "GET
                      > > /island/david/wireless-rh-install.txt HTTP/1.1" 200 1884
                      > >
                      "http://www.google.at/search?q=linux+redhat+orinoco&ie=ISO-8859-1&hl=de&meta
                      > > =" "Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)"
                      > > >
                      > > > 131.193.48.116 - - [16/Jul/2002:14:07:51 -0700] "GET
                      > > /island/david/wireless-rh-install.txt HTTP/1.0" 200 1884
                      > >
                      "http://www.google.com/search?hl=en&ie=ISO-8859-1&q=orinoco+wireless+redhat+
                      > > linux" "Mozilla/4.79 [en] (X11; U; Linux 2.4.18-3 i686)"
                      > > >
                      > > > 198.129.219.189 - - [17/Jul/2002:00:49:24 -0700] "GET
                      > > /island/david/wireless-rh-install.txt HTTP/1.1" 200 1884
                      > >
                      "http://www.google.com/search?hl=en&lr=&ie=ISO-8859-1&q=pci+biosirq+pcmcia"
                      > > "Mozilla/5.0 (compatible; Konqueror/2.2; Linux)"
                      > > >
                      > > > 212.97.184.25 - - [17/Jul/2002:05:22:38 -0700] "GET
                      > > /island/david/wireless-rh-install.txt HTTP/1.1" 200 1884
                      > >
                      "http://www.google.com/search?q=%2Borinoco+%2Bpci+%2Birq&ie=UTF-8&oe=UTF-8&h
                      > > l=es&lr=" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)"
                      > > >
                      > > > 193.243.66.2 - - [17/Jul/2002:09:12:47 -0700] "GET
                      > > /island/david/wireless-rh-install.txt HTTP/1.0" 200 1884
                      > > "http://www.google.com/search?q=pci%3Dbiosirq&hl=en&lr=&ie=ISO-8859-1"
                      > > "Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt)"
                      > > >
                      > > > 212.234.248.186 - - [17/Jul/2002:09:23:39 -0700] "GET
                      > > /island/david/lverror.txt HTTP/1.1" 200 3626
                      > >
                      "http://www.google.fr/search?q=+Sorry._Although_I%27m_listed_as_a_best-prefe
                      > >
                      rence_MX_or_A_for_that_host%2C%2Fit_isn%27t_in_my_control%2Flocals_file%2C_s
                      > >
                      o_I_don%27t_treat_it_as_local&ie=ISO-8859-1&hl=fr&btnG=Recherche+Google&meta
                      > > =" "Mozilla/5.0 (compatible; Konqueror/3.0.0; OpenBSD)"
                      > > >
                      > > > 129.79.16.185 - - [17/Jul/2002:09:32:35 -0700] "GET
                      > > /island/david/wireless-rh-install.txt HTTP/1.0" 200 1884
                      > >
                      "http://www.google.com/search?hl=en&lr=&ie=ISO-8859-1&q=orinoco+wireless+red
                      > > hat" "Mozilla/4.77 [en] (Windows NT 5.0; U)"
                      > > >
                      > > > 216.23.59.184 - - [17/Jul/2002:12:07:09 -0700] "GET
                      > > /island/david/wireless-rh-install.txt HTTP/1.1" 200 1884
                      > > "http://www.google.com/search?hl=en&ie=ISO-8859-1&q=hermes.conf"
                      > > "Mozilla/5.0 (compatible; Konqueror/2.2.2; Linux)"
                      > > >
                      > > > 198.129.219.189 - - [17/Jul/2002:15:04:09 -0700] "GET
                      > > /island/david/wireless-rh-install.txt HTTP/1.1" 304 -
                      > >
                      "http://www.google.com/search?hl=en&ie=ISO-8859-1&q=pci+biosirq+pcmcia&btnG=
                      > > Google+Search" "Mozilla/5.0 (compatible; Konqueror/2.2; Linux)"
                      > > >
                      > > > 66.127.222.170 - - [17/Jul/2002:16:51:35 -0700] "GET
                      > > /island/david/wireless-rh-install.txt HTTP/1.1" 200 1884
                      > > "http://www.google.com/search?sourceid=navclient&q=pci%3Dbiosirq"
                      > > "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 1.0.3705)"
                      > > >
                      > > > Stats:
                      > > >
                      > > > Mandrake 8.1
                      > > > Webalizer 2.01.06-4mdk
                      > > >
                      > > > TIA,
                      > > > David Koski
                      > > > david@...
                      > > >
                      > > >
                      > > >
                      > > >
                      > > > To unsubscribe from this group, send an email to:
                      > > > webalizer-unsubscribe@egroups.com
                      > > > Webalizer homepage: http://www.webalizer.org
                      > > > Webalizer for NT: http://www.medasys-lille.com/webalizer/
                      > > >
                      > > >
                      > > >
                      > > >
                      > > > Your use of Yahoo! Groups is subject to
                      http://docs.yahoo.com/info/terms/
                      > > >
                      > >
                      > >
                      > >
                      > >
                      > > To unsubscribe from this group, send an email to:
                      > > webalizer-unsubscribe@egroups.com
                      > > Webalizer homepage: http://www.webalizer.org
                      > > Webalizer for NT: http://www.medasys-lille.com/webalizer/
                      > >
                      > >
                      > >
                      > >
                      > > Your use of Yahoo! Groups is subject to
                      http://docs.yahoo.com/info/terms/
                      > >
                      > >
                      > >
                      >
                      >
                      > To unsubscribe from this group, send an email to:
                      > webalizer-unsubscribe@egroups.com
                      > Webalizer homepage: http://www.webalizer.org
                      > Webalizer for NT: http://www.medasys-lille.com/webalizer/
                      >
                      >
                      >
                      >
                      > Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/
                      >
                    • Kees de Keizer
                      ... An example of a yahoo search: http://google.yahoo.com/bin/query?p=bamva&hc=0&hs=2 The URL contains google. but keywords are behind the p= and not the
                      Message 10 of 11 , Jul 22, 2002
                        David Koski wrote on 21-07-2002:

                        > > >You can use generic lines for the search engines e.g.
                        > > >
                        > > >SearchEngine google. q=
                        > > >SearchEngine googel. q=
                        > > >
                        > > >will deal with ALL variants of google.
                        > >
                        > > You should add "SearchEngine yahoo.com p=" before the google
                        > > entries otherwise they will not be parsed.
                        > How so?

                        An example of a yahoo search:
                        http://google.yahoo.com/bin/query?p=bamva&hc=0&hs=2

                        The URL contains 'google.' but keywords are behind the 'p=' and
                        not the the 'q=' like with the google search engines.
                        --
                        Kees de Keizer NT Administrator T: +31-10-2448344
                        Wirehub! Internet PGP: 0x24E3770B F: +31-10-2448356
                        http://www.wirehub.net/ mailto:kees.de.keizer@...
                        You put in for mam, she'll put our for you [Chicago]
                      • Deathlok_the_Demolisher
                        Hello everyone. I joined the webalizer group because I was having this exact same problem. 20% of the searches going into my site weren t showing up. After
                        Message 11 of 11 , Sep 5, 2002
                          Hello everyone. I joined the webalizer group because I was having
                          this exact same problem. 20% of the searches going into my site
                          weren't showing up. After upgrading from 2.01-06 to 2.01-10, spending
                          hours trying to get jpeglib and gdlib to compile, and finally
                          hammering on webalizer until it almost fell apart I finally found out
                          what was causing this behaviour. (well, okay, it wasn't all that
                          difficult, but it was frustrating because I, like most people who had
                          this problem, spend hours and hours messing with the .conf file and
                          referral section of my combined log when that ISN'T the problem).

                          So, what did I find?

                          webalizer only logs searches that hit 'pages'. Pages being defined as
                          htm* and .cgi by default. Now, you can go in and define all your file
                          types as 'pages' but then that makes your 'pages' count a bit less
                          accurate. I decided to just remove that requirement.

                          in webalizer.c, around line 1163
                          change:
                          /* Pages (pageview) calculation */
                          if (ispage(log_rec.url))
                          {
                          t_page++;
                          tm_page[rec_day-1]++;
                          th_page[rec_hour]++;

                          /* do search string stuff if needed */
                          if (ntop_search) srch_string(log_rec.srchstr);
                          }
                          to
                          /* Pages (pageview) calculation */
                          if (ispage(log_rec.url))
                          {
                          t_page++;
                          tm_page[rec_day-1]++;
                          th_page[rec_hour]++;
                          }
                          /* do search string stuff if needed */
                          if (ntop_search) srch_string(log_rec.srchstr);

                          And that takes care of the whole problem. ^_^


                          --- In webalizer@y..., David Koski <david@K...> wrote:
                          > Hello,
                          >
                          > My webalizer search strings list almost never has anything but it
                          did recently find the following:
                          >
                          > 205.158.231.99 - - [12/Jul/2002:11:20:00 -
                          0700] "GET /island/david/index.html HTTP/1.1" 200
                          864 "http://groups.google.com/groups?
                          q=Orinoco+Linux+USB&hl=en&lr=&ie=UTF-8&oe=UTF-
                          8&selm=8sk3iuolqp975gaki4195huqa327po1lte%
                          404ax.com&rnum=8" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0;
                          Q312461)"
                          >
                          > However, there are many "hits" that never make it to the table and
                          I would like to know how to fix it. Revelant settings are:
                          >
                          > SearchEngine yahoo.com p=
                          > SearchEngine altavista.com q=
                          > SearchEngine google. q=
                          > SearchEngine eureka.com q=
                          > SearchEngine lycos.com query=
                          > SearchEngine hotbot.com MT=
                          > SearchEngine msn.com MT=
                          > SearchEngine infoseek.com qt=
                          > SearchEngine webcrawler searchText=
                          > SearchEngine excite search=
                          > SearchEngine netscape.com search=
                          > SearchEngine mamma.com query=
                          > SearchEngine alltheweb.com query=
                          > SearchEngine northernlight.com qr=
                          >
                          > AllSites yes
                          > AllURLs yes
                          > AllReferrers yes
                          > AllAgents yes
                          > AllSearchStr yes
                          > AllUsers yes
                          >
                          > DumpSearchStr
                          yes

                          >
                          > Some example failures (separated by blank lines for clarity) are:
                          >
                          > 129.69.66.147 - - [16/Jul/2002:10:00:48 -
                          0700] "GET /island/david/wireless-rh-install.txt HTTP/1.0" 200
                          1884 "http://www.google.de/search?hl=en&ie=ISO-8859-
                          1&newwindow=1&q=pci%3Dbiosirq&btnG=Google+Search" "Mozilla/4.78 [en]
                          (X11; U; Linux 2.4.10-4GB i686)"
                          >
                          > 62.47.201.60 - - [16/Jul/2002:10:52:56 -
                          0700] "GET /island/david/wireless-rh-install.txt HTTP/1.1" 200
                          1884 "http://www.google.at/search?q=linux+redhat+orinoco&ie=ISO-8859-
                          1&hl=de&meta=" "Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)"
                          >
                          > 131.193.48.116 - - [16/Jul/2002:14:07:51 -
                          0700] "GET /island/david/wireless-rh-install.txt HTTP/1.0" 200
                          1884 "http://www.google.com/search?hl=en&ie=ISO-8859-
                          1&q=orinoco+wireless+redhat+linux" "Mozilla/4.79 [en] (X11; U; Linux
                          2.4.18-3 i686)"
                          >
                          > 198.129.219.189 - - [17/Jul/2002:00:49:24 -
                          0700] "GET /island/david/wireless-rh-install.txt HTTP/1.1" 200
                          1884 "http://www.google.com/search?hl=en&lr=&ie=ISO-8859-
                          1&q=pci+biosirq+pcmcia" "Mozilla/5.0 (compatible; Konqueror/2.2;
                          Linux)"
                          >
                          > 212.97.184.25 - - [17/Jul/2002:05:22:38 -
                          0700] "GET /island/david/wireless-rh-install.txt HTTP/1.1" 200
                          1884 "http://www.google.com/search?q=%2Borinoco+%2Bpci+%2Birq&ie=UTF-
                          8&oe=UTF-8&hl=es&lr=" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT
                          5.1)"
                          >
                          > 193.243.66.2 - - [17/Jul/2002:09:12:47 -
                          0700] "GET /island/david/wireless-rh-install.txt HTTP/1.0" 200
                          1884 "http://www.google.com/search?q=pci%3Dbiosirq&hl=en&lr=&ie=ISO-
                          8859-1" "Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt)"
                          >
                          > 212.234.248.186 - - [17/Jul/2002:09:23:39 -
                          0700] "GET /island/david/lverror.txt HTTP/1.1" 200
                          3626 "http://www.google.fr/search?q=+Sorry._Although_I%
                          27m_listed_as_a_best-preference_MX_or_A_for_that_host%2C%2Fit_isn%
                          27t_in_my_control%2Flocals_file%2C_so_I_don%
                          27t_treat_it_as_local&ie=ISO-8859-
                          1&hl=fr&btnG=Recherche+Google&meta=" "Mozilla/5.0 (compatible;
                          Konqueror/3.0.0; OpenBSD)"
                          >
                          > 129.79.16.185 - - [17/Jul/2002:09:32:35 -
                          0700] "GET /island/david/wireless-rh-install.txt HTTP/1.0" 200
                          1884 "http://www.google.com/search?hl=en&lr=&ie=ISO-8859-
                          1&q=orinoco+wireless+redhat" "Mozilla/4.77 [en] (Windows NT 5.0; U)"
                          >
                          > 216.23.59.184 - - [17/Jul/2002:12:07:09 -
                          0700] "GET /island/david/wireless-rh-install.txt HTTP/1.1" 200
                          1884 "http://www.google.com/search?hl=en&ie=ISO-8859-
                          1&q=hermes.conf" "Mozilla/5.0 (compatible; Konqueror/2.2.2; Linux)"
                          >
                          > 198.129.219.189 - - [17/Jul/2002:15:04:09 -
                          0700] "GET /island/david/wireless-rh-install.txt HTTP/1.1" 304 -
                          "http://www.google.com/search?hl=en&ie=ISO-8859-
                          1&q=pci+biosirq+pcmcia&btnG=Google+Search" "Mozilla/5.0 (compatible;
                          Konqueror/2.2; Linux)"
                          >
                          > 66.127.222.170 - - [17/Jul/2002:16:51:35 -
                          0700] "GET /island/david/wireless-rh-install.txt HTTP/1.1" 200
                          1884 "http://www.google.com/search?sourceid=navclient&q=pci%
                          3Dbiosirq" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET
                          CLR 1.0.3705)"
                          >
                          > Stats:
                          >
                          > Mandrake 8.1
                          > Webalizer 2.01.06-4mdk
                          >
                          > TIA,
                          > David Koski
                          > david@K...
                        Your message has been successfully submitted and would be delivered to recipients shortly.