|
|
|
 |
|
|
td valign=top align=center>
|
| Web Components |
|
User Manual
|
|
|
Web Builder 2.0
|
|
How to...
Build a Web site with Comdev Web Builder 2.0
|
|
|
e-Business
|
|
Web site development, increase sales, globalization, customer service
|
|
|
Email
|
|
Outlook Express, create new address, administration, virus, attachment
|
|
|
Graphics
|
|
Image touch up, editing, scanning, digital camera, photography
|
|
|
Internet Marketing
|
|
Online marketing, search engine, ezine, banner ads, spam mail
|
|
|
 |
How Does Search Engine Crawl Your Site
by Jovi Yu |
As the Internet has become more popular, websites have turned to new technologies like dynamic HTML and Flash or well designed graphics to improve the user experience. Good navigation through your website isn't just important to your users. Search engines use the links within your website to crawl and index the pages those links point to.
Search Engine Spiders
In simple terms a spider (also known as a robot, crawler or intelligent agent) is a computer program that crawls the World-Wide Web and collects information in the process. Ideally, a search engine spider should start at your home page (index page) and then follows hypertext links deeper into interior pages or to other web pages. Spiders can crawl several types of links - standard text links, graphics with links and image maps contained within graphics.
These links give clear directions for the search engines to follow. They act as a roadmap of your website for search engine spiders. Site Map pages are also valuable resources for search engines because in one central area the spider can see links to everything. The more of your website the spider sees, the more times you will appear in a search result for a certain topic.
It's very important that you have text links on your website that contain keywords that you are hoping to compete for. Spiders not only follow links, they also analyze the text within them to help determine a site's relevancy. Graphic links often don't have any text associated with them, so the spiders don't treat them the same as text links made up of good keywords.
Spider Tags
Another solution is to include specific meta tags on each and every Web page that gives instructions to the spiders as to whether they should follow or index your pages. This can be effective when a page is on a server and in development, but you'll find it's much easier to control these little critters from one file. If you're used to using CSS at all, the concept is not dissimilar. Manage one file or manage many pages.
Search engine spiders cannot crawl Flash based web sites, images (although they can crawl the alt tag), Javascript, or URLs that are dynamic (written to include queries). These technologies use languages and commands that a spider can't easily travel through. When a spider sees one of these dynamic elements, it will usually stop crawling any deeper into your website.
If the search engine doesn't index your entire website, much of the valuable content contained deep within will never appear in a search result. That's why good text linking is so important. The more direction you give the search engines, the easier and more convenient it for them to get in and scan your website, that way, the more traffic they are going to deliver to your website. The more copy and content the search engines can easily find, the more likely you are to reach your audience online. |
|
|
|
