Archive of UserLand's first discussion group, started October 5, 1998.
Re: Deep Linking
Author: Eric Soroos Posted: 8/9/1999; 4:48:32 PM Topic: Deep Linking Msg #: 9280 (In response to 9278) Prev/Next: 9279 / 9281
So....The effect of a robots.txt file is to preclude the use of deep links.
So go by the search engine criteria. If a search engine would blunder into your content while following the rules, it is deep linkable. If you keep the search engines out, obviously you don't want deep linking (since that's what the search engines do). (Has anyone checked to see if Universal's content is indexed in the major engines?)
Now if it's smart to reject traffic coming into your site; well, that's another question. I have my opinions, and they just happen to side with "Links are good". This is probably some manifestation of Metcalfe's law.
No website is an island.
eric
This page was archived on 6/13/2001; 4:51:47 PM.
© Copyright 1998-2001 UserLand Software, Inc.