FW: [OT] Web ASP or javascript code help needed

[Robert Chasmer <robert.chasmer@xxxxxxx>]

Opps sent to soon...

steve.cooper@xxxxxxx [mailto:steve.cooper@xxxxxxx] wrote:
> The site has no frames but instead uses some asp code to combine
> various files together (e.g. header, side menu etc)...
> This causes a problem when you do a search as the site search
> engine picks up the individual files.

The problem is that your search engine is indexing your ASP source code,
rather than the HTML code that is normally sent to a users web-browser. 
You
get this for example when you configure Microsofts Content Index Service to
monitor a whole web.

The bad thing about this is that it will index things that are in your
source code.  Variables, database tables, field names etc, which is not a
good thing.  You need either some sort of search tool that acts more like a
web crawler, in that it browses your site like a real user and follows
links.  On a site I built I configure it to only index certain file types
like .html, .pdf etc, and kept it well away from my sourcecode.  I modified
the search pages that use the indexed pages, so that they wouldn't suggest
certain webpages, I also integrated this to search certain tables in my SQL
Server database.

Hope this helps.  If anyone can suggest a good webcrawler tool for building
up indexes of websites for use with IIS and ASP let me know.


Rob

--
______   __   _   ______   ______
/ ___   / /  /  / __    / _____ HOME: rob@xxxxxxx
/ /  /_/ / /__/ / / /__/ / / /__    http://www.kaosuk.co.uk/
/ /  __  / ___  / / ___  /  \__  \            ----
/ /__/ / / /  / / / /  / / _____/ / Rob Chasmer, MMT Computing
______/ _/  /_/ _/  /_/ ______/ robert.chasmer@xxxxxxx

This email and any files transmitted with it are confidential and intended
solely for the use of the individual or entity to whom they are addressed.
If you have received this email in error please let us know by e-mail reply
and delete it from your system; you may not copy this message or disclose
its contents to anyone.  Please note that any views or opinions presented
in
this email are solely those of the author and do not necessarily represent
those of MMT Computing plc.  Finally, the recipient should check this email
and any attachments for the presence of viruses.  MMT Computing plc accepts
no liability for any damage caused by any virus transmitted by this email.