I am documenting the user interface for metadata editing and
a few questions came along about the section _Controlling
external indexing_
At the moment the options are
1. Not specified, use 'robots.txt'
2. Disallow indexing
3. Allow indexing
4. Allow indexing, indexer may follow links
5. Allow indexing, indexer must not follow links
What is the difference with 3 and 4? I think number 4 should
be 'Disallow indexing, indexer may follow links'...
Where is the `robots.txt`? I couldn't find it by writing
the URL e.g. from the root topic. Shouldn't we provide at
least some kind of file for the robots?
I also couldn't find any difference that setting the
indexer options would have affected anything. No difference
in META-tags. Is this feature available at the moment?
--
Arttu Manninen aka Adrenalin
-----------
This message has been sent to the Midgard Forums on http://www
.midgard-project.org/discussion/
DO NOT reply to this message by email. If you want to reply
to it, go to https://ww
w.midgard-project.org/discussion/developer-forum/reply/d6455
03b642dfd64cf29ebb2ce3c142c.html
Go to h
ttps://www.midgard-project.org/discussion/account/ to
update your contact details or click https://www.midgard-project.org/discussion/subscriptions/
campaign/unsubscribe/25eded291764e251a0b57d1cb42d6c4d.html to unsubscribe.
|