Loading ...
Sorry, an error occurred while loading the content.

need help with exotic javascript links and xenu not seeing plain links on a page

Expand Messages
  • shayneweyker
    Hi, I emailed a while back about getting authentication to work and it does seem to work if I login with IE and then run Xenu. That seems to work as Xenu now
    Message 1 of 1 , Aug 14, 2006
    • 0 Attachment
      Hi,

      I emailed a while back about getting authentication to work and it
      does seem to work if I login with IE and then run Xenu. That seems
      to work as Xenu now spiders down to pages it could never see if not
      authenticated. Thanks for that advice.

      Now I'm trying to use Xenu 1.2h on a fairly large nonprofit site and
      I have the problem that Xenu isn't seeing all the links on some
      pages.

      One kind of link it misses is javascript links generated by our
      CommonSpot CMS:

      ---EXAMPLE JS LINK-----------

      <a onmouseover=" return
      self.status='http://museable.home.comcast.net/BAD-NEWWIN.cfm'; "
      onmouseout=" return self.status=''; " href="javascript:HandleLink
      ('cpe_10562_0','CPNEWWIN:NewWindow^top=10,left=10,width=500,height=40
      0,toolbar=1,location=1,directories=0,status=1,menubar=1,scrollbars=1,
      resizable=1@http://museable.home.comcast.net/BAD-
      NEWWIN.cfm');">NEWWINDOW BAD LINK</a>

      -----------------------------

      I went and added the following line to the xenu.ini file under
      options to try and help Xenu see/parse that link but I see no
      difference in the results. Note that I replaced ['"] with @

      --------EXAMPLE REGEXP--------------

      Javascript=javascript: *[_a-zA-Z0-9]+ *\( *@((/|ftp://|http://)[^'"]
      +)['"]

      ---------------------------------

      There may be other reasons this isn't having any effect besides
      problems with the regexp (see below) but if the one above is wrong
      then please let me know.

      The other problem is that Xenu ignores even ordinary links sometimes
      like with some that occur in this main content block of at least two
      of our pages.

      For example I think Xenu is ignoring all of the links out from one
      page page that includes the HTML below. I know its missing the
      simple link to <a
      href="http://museable.home.comcast.net/BAD.cfm">BAD
      LINK</a>

      What is odd is that Xenu reporting successfully opening the page
      that contains the HTML below and that page was only a few levels
      down from the start of the crawl. And Xenu's level limit was set at
      999.

      Thanks for any help anyone can provide.

      --Shayne Weyker

      ----LONG sample main contents block follows---------
      ----sample bad links at end-------------------------

      <div class="CS_Element_Layout"> </div><div
      class="CS_Element_Layout"><table id="idLayout2" cellpadding="5"
      cellspacing="0" class="CS_Layout_Table" width="100%" summary=""><tr
      class="CS_Layout_TR"><td id="idCell2x1x1" class="CS_Layout_TD"><div
      class="MainBody"><div class="SubTitle">Membership</div><div
      class="MainBody"><p><a id="top" name="top"></a></p><p>The AAM
      Information Center shares a Fact Sheet with <a
      class="CP___PAGEID_19257" href="/museumresources/ic/fs/ei/loader.cfm?
      url=/commonspot/security/getfile.cfm&PageID=19257">data about
      individual/family and corporate memberships</a> extracted from
      <em>2006 Museum Financial Information</em> (PDF). A second Fact
      Sheet describes a <a class="CP___PAGEID_7931"
      href="/museumresources/ic/fs/ei/loader.cfm?
      url=/commonspot/security/getfile.cfm&PageID=7931">membership program
      evaluation tool</a> (PDF). The tool evaluates activity in 10 areas
      and can be used to target areas needing improvement. A third Fact
      Sheet outlines characteristics of <a class="CP___PAGEID_8052"
      href="/museumresources/ic/fs/ei/loader.cfm?
      url=/commonspot/security/getfile.cfm&PageID=8052">reciprocal
      membership programs</a>, suggests issues to consider before
      beginning or joining a program, and lists several existing museum
      and association programs.</p><p>The Alliance of Nonprofit Mailers
      has information about <a onmouseover=" return
      self.status='http://www.nonprofitmailers.org/'; " onmouseout="
      return self.status=''; " href="javascript:HandleLink
      ('cpe_10562_0','CPNEWWIN:NewWindow^top=10,left=10,width=500,height=40
      0,toolbar=1,location=1,directories=0,status=1,menubar=1,scrollbars=1,
      resizable=1@http://www.nonprofitmailers.org/');">nonprofit mail
      permits, rules & regulations, and nonprofit postal rates</a>. The
      Commonly Asked Questions & Answers address the substantial
      relatedness test and back-end premiums. The site also has a glossary
      of postal terms and a list of preferred commercial
      vendors.</p><p>The Association of Direct Response Fundraising
      Counsel provides an overview article about <a onmouseover=" return
      self.status='http://www.carlbloom.com/marketing/dmfund.html'; "
      onmouseout=" return self.status=''; " href="javascript:HandleLink
      ('cpe_10562_0','CPNEWWIN:NewWindow^top=10,left=10,width=500,height=40
      0,toolbar=1,location=1,directories=0,status=1,menubar=1,scrollbars=1,
      resizable=1@http://www.carlbloom.com/marketing/dmfund.html');">direct
      mail fundraising</a>. It notes that donors acquired through direct
      mail can become the foundation of an overall fundraising program. It
      suggests ways to cultivate donors through renewals, special appeals,
      and pledge or sustainer programs. It also discusses protecting
      donor's privacy and renting the organization's donor list.</p><p>The
      Australia Council for the Arts sponsors SAUCE, an online marketing
      resource. It has a how-to <a onmouseover=" return
      self.status='http://www.fuel4arts.com/sauce/09_direct_marketing/direc
      t_marketing.htm'; " onmouseout=" return self.status=''; "
      href="javascript:HandleLink
      ('cpe_10562_0','CPNEWWIN:NewWindow^top=10,left=10,width=500,height=40
      0,toolbar=1,location=1,directories=0,status=1,menubar=1,scrollbars=1,
      resizable=1@http://www.fuel4arts.com/sauce/09_direct_marketing/direct
      _marketing.htm');">guide on direct marketing</a> designed to
      generate a specific response, be it a membership, a donation, or a
      ticket purchase. It discusses acquiring customers, organizing a
      database, designing a direct mail campaign, fulfilling orders, and
      evaluating results. It includes tips, examples, and
      links.</p><p>Charity Village discusses the benefits and pitfalls of
      <a onmouseover=" return
      self.status='http://www.charityvillage.com/cv/archive/acov/acov03/aco
      v0340.html'; " onmouseout=" return self.status=''; "
      href="javascript:HandleLink
      ('cpe_10562_0','CPNEWWIN:NewWindow^top=10,left=10,width=500,height=40
      0,toolbar=1,location=1,directories=0,status=1,menubar=1,scrollbars=1,
      resizable=1@http://www.charityvillage.com/cv/archive/acov/acov03/acov
      0340.html');">using premiums as incentives for
      giving</a>.</p><p>Chewning Direct Marketing offers advice on <a
      onmouseover=" return
      self.status='http://www.cdmdirect.com/dmpremiums.htm'; "
      onmouseout=" return self.status=''; " href="javascript:HandleLink
      ('cpe_10562_0','CPNEWWIN:NewWindow^top=10,left=10,width=500,height=40
      0,toolbar=1,location=1,directories=0,status=1,menubar=1,scrollbars=1,
      resizable=1@http://www.cdmdirect.com/dmpremiums.htm');">selecting
      premiums and measuring their success</a> in increasing revenue from
      a direct mail campaign. A second article lists <a onmouseover="
      return self.status='http://www.cdmdirect.com/23ideas.htm'; "
      onmouseout=" return self.status=''; " href="javascript:HandleLink
      ('cpe_10562_0','CPNEWWIN:NewWindow^top=10,left=10,width=500,height=40
      0,toolbar=1,location=1,directories=0,status=1,menubar=1,scrollbars=1,
      resizable=1@http://www.cdmdirect.com/23ideas.htm');">23 ways to test
      premiums</a>.</p><p>DEI provides <a onmouseover=" return
      self.status='http://www.deiworksite.org/index.asp?Type=B_LIST&SEC=
      {9FBF2D71-3C36-4B65-BEFE-1D41EFB37D1A}'; " onmouseout=" return
      self.status=''; " href="javascript:HandleLink
      ('cpe_10562_0','CPNEWWIN:NewWindow^top=10,left=10,width=500,height=40
      0,toolbar=1,location=1,directories=0,status=1,menubar=1,scrollbars=1,
      resizable=1@http://www.deiworksite.org/index.asp?Type=B_LIST&SEC=
      {9FBF2D71-3C36-4B65-BEFE-1D41EFB37D1A}');">mailing list
      guidelines</a>, including recommendations for developing a mailing
      list policy, trading mailing lists, and working with a list broker.
      It also provides samples of a mailing list policy, a list exchange
      agreement, and a mailing list trade request form.</p><p>Direct
      Marketing Solutions has a <a onmouseover=" return
      self.status='http://www.duncandirect.com/articles/artclhowto.html'; "
      onmouseout=" return self.status=''; " href="javascript:HandleLink
      ('cpe_10562_0','CPNEWWIN:NewWindow^top=10,left=10,width=500,height=40
      0,toolbar=1,location=1,directories=0,status=1,menubar=1,scrollbars=1,
      resizable=1@http://www.duncandirect.com/articles/artclhowto.html');">
      series of how-to articles</a> on topics such as the cost of doing a
      mailing, what results can be expected, selecting mailing lists and
      brokers, determining the package format, and describing benefits
      from the consumer's point of view.</p><p>DSD, Inc. offers an article
      titled <a onmouseover=" return
      self.status='http://www.dsdnet.com/articles.html'; " onmouseout="
      return self.status=''; " href="javascript:HandleLink
      ('cpe_10562_0','CPNEWWIN:NewWindow^top=10,left=10,width=500,height=40
      0,toolbar=1,location=1,directories=0,status=1,menubar=1,scrollbars=1,
      resizable=1@http://www.dsdnet.com/articles.html');">Testing for
      Success</a>. Direct mail is often used to acquire new members. The
      article offers guidelines for testing components in a direct mail
      campaign to gauge which are most effective at the lowest
      cost.</p><p>The Fund-Raising Forum Library has 2 articles. One
      presents an approach for a grassroots campaign to solicit <a
      onmouseover=" return self.status='http://www.raise-
      funds.com/0301forum.html'; " onmouseout=" return self.status=''; "
      href="javascript:HandleLink
      ('cpe_10562_0','CPNEWWIN:NewWindow^top=10,left=10,width=500,height=40
      0,toolbar=1,location=1,directories=0,status=1,menubar=1,scrollbars=1,
      resizable=1@http://www.raise-funds.com/0301forum.html');">small
      gifts from a large number of donors</a> or “Friends.”
      The second discusses memberships, naming opportunities, and
      sponsorships as points on the <a onmouseover=" return
      self.status='http://www.raise-funds.com/b98forum.html'; "
      onmouseout=" return self.status=''; " href="javascript:HandleLink
      ('cpe_10562_0','CPNEWWIN:NewWindow^top=10,left=10,width=500,height=40
      0,toolbar=1,location=1,directories=0,status=1,menubar=1,scrollbars=1,
      resizable=1@http://www.raise-funds.com/b98forum.html');">continuum
      of recognition and appreciation</a>.</p><p>GinCommGroup offers a <a
      onmouseover=" return
      self.status='http://www.gincomm.com/html/membership_plan.html'; "
      onmouseout=" return self.status=''; " href="javascript:HandleLink
      ('cpe_10562_0','CPNEWWIN:NewWindow^top=10,left=10,width=500,height=40
      0,toolbar=1,location=1,directories=0,status=1,menubar=1,scrollbars=1,
      resizable=1@http://www.gincomm.com/html/membership_plan.html');">samp
      le membership plan outline</a>. It can help museums set objectives
      for retention and recruitment, think through the strategies to be
      used, and develop a time line and budget for
      implementation.</p><p>The Grantsmanship Center presents 2 articles.
      <a onmouseover=" return
      self.status='http://www.tgci.com/magazine/00summer/memberships1.asp';
      " onmouseout=" return self.status=''; " href="javascript:HandleLink
      ('cpe_10562_0','CPNEWWIN:NewWindow^top=10,left=10,width=500,height=40
      0,toolbar=1,location=1,directories=0,status=1,menubar=1,scrollbars=1,
      resizable=1@http://www.tgci.com/magazine/00summer/memberships1.asp');
      ">Memberships: How to Build Your Organization's Donor Base and
      Political Clout at the Same Time</a> discusses the benefits of
      having a broad base of supporters and offers tips for annual
      membership drives. <a onmouseover=" return
      self.status='http://www.tgci.com/magazine/01spring/direct1.asp'; "
      onmouseout=" return self.status=''; " href="javascript:HandleLink
      ('cpe_10562_0','CPNEWWIN:NewWindow^top=10,left=10,width=500,height=40
      0,toolbar=1,location=1,directories=0,status=1,menubar=1,scrollbars=1,
      resizable=1@http://www.tgci.com/magazine/01spring/direct1.asp');">Dir
      ect-Mail Fundraising: Testing the Trends</a> has suggestions for
      testing the components of a direct mail piece; of particular
      interest are the observations about increasing membership
      dues.</p><p>The Internet Nonprofit Center provides an overview of <a
      onmouseover=" return
      self.status='http://www.nonprofits.org/npofaq/08/07.html'; "
      onmouseout=" return self.status=''; " href="javascript:HandleLink
      ('cpe_10562_0','CPNEWWIN:NewWindow^top=10,left=10,width=500,height=40
      0,toolbar=1,location=1,directories=0,status=1,menubar=1,scrollbars=1,
      resizable=1@http://www.nonprofits.org/npofaq/08/07.html');">direct
      mail as a tool for identifying new donors</a>. It discusses mailing
      lists, response rates, and writing the appeal letter. A second
      article has ideas for ways to <a onmouseover=" return
      self.status='http://www.nonprofits.org/npofaq/05/15.html'; "
      onmouseout=" return self.status=''; " href="javascript:HandleLink
      ('cpe_10562_0','CPNEWWIN:NewWindow^top=10,left=10,width=500,height=40
      0,toolbar=1,location=1,directories=0,status=1,menubar=1,scrollbars=1,
      resizable=1@http://www.nonprofits.org/npofaq/05/15.html');">purge an
      in-house mailing list</a>.</p><p>Mal Warwick & Associates offers a
      series of short articles on <a onmouseover=" return
      self.status='http://www.malwarwick.com/direct7.html'; " onmouseout="
      return self.status=''; " href="javascript:HandleLink
      ('cpe_10562_0','CPNEWWIN:NewWindow^top=10,left=10,width=500,height=40
      0,toolbar=1,location=1,directories=0,status=1,menubar=1,scrollbars=1,
      resizable=1@http://www.malwarwick.com/direct7.html');">direct mail
      fundraising for nonprofits</a>. The articles have tips on getting
      started for small organizations, choosing the best postage for
      nonprofit mail, and handling complaints about duplicate
      mailings.</p><p>Museum Marketing Tips has 2 articles. One offers <a
      onmouseover=" return
      self.status='http://www.museummarketingtips.com/articles/nuggets.html
      '; " onmouseout=" return self.status=''; "
      href="javascript:HandleLink
      ('cpe_10562_0','CPNEWWIN:NewWindow^top=10,left=10,width=500,height=40
      0,toolbar=1,location=1,directories=0,status=1,menubar=1,scrollbars=1,
      resizable=1@http://www.museummarketingtips.com/articles/nuggets.html'
      );">29 ways for getting and keeping members</a>. A second notes that
      <a onmouseover=" return
      self.status='http://www.museummarketingtips.com/articles/appeal.html'
      ; " onmouseout=" return self.status=''; " href="javascript:HandleLink
      ('cpe_10562_0','CPNEWWIN:NewWindow^top=10,left=10,width=500,height=40
      0,toolbar=1,location=1,directories=0,status=1,menubar=1,scrollbars=1,
      resizable=1@http://www.museummarketingtips.com/articles/appeal.html')
      ;">writing a compelling appeal letter</a> is an art; it gives tips
      for composing a successful one.</p><p><strong>See
      Also:</strong><br /><a href="http://www.aam-
      us.org/museumresources/ic/fs/dev/program.cfm">Development Program
      Management</a> for information about donor management
      software<br /><a class="CP___PAGEID_11263"
      href="/museumresources/ic/fs/dev/dr/index.cfm">Donor Relations</a>
      for information about donor privacy policies, prospect research,
      cultivation, and recognition<br /><a class="CP___PAGEID_10537"
      href="/museumresources/ic/fs/ei/tax.cfm">Tax Issues</a> for
      information about deductibility</p><p><a
      href="http://museable.home.comcast.net/BAD.cfm">BAD
      LINK</a></p><p><a onmouseover=" return
      self.status='http://museable.home.comcast.net/BAD-NEWWIN.cfm'; "
      onmouseout=" return self.status=''; " href="javascript:HandleLink
      ('cpe_10562_0','CPNEWWIN:NewWindow^top=10,left=10,width=500,height=40
      0,toolbar=1,location=1,directories=0,status=1,menubar=1,scrollbars=1,
      resizable=1@http://museable.home.comcast.net/BAD-
      NEWWIN.cfm');">NEWWINDOW BAD LINK</a></p><p>| <a href="#top">top</a>
      |</p></div></div></td></tr>
      </table> </div>
    Your message has been successfully submitted and would be delivered to recipients shortly.