Conditional indexing or following

[tahagh]

Sometimes user wants to index a document when some value is present or absent in the page. The typical example is robots meta tag. The same is also hold for following the outlinks. This plugin can support this feature by having two predefined fields index and follow and based on their values it decides to index or follow the document or not. Something like this might be do the job:

<document>
  <extract-to field="robots">
    <normalize normalizer="lower">
        <first skipEmptyItems="true">
          <attribute name="content">
            <expr value="meta[name=robots]" />
          </attribute>
        </first>
    </normalize>
  </extract-to>
  <extract-to field="index">
    <not>
        <matches pattern="noindex">
            <field-value field="robots" />
        </matches>
    </not>
  </extract-to>
  <extract-to field="follow">
    <not>
        <matches pattern="nofollow">
            <field-value field="robots" />
        </matches>
    </not>
  </extract-to>
</document>

[raisindetre]

Fantastic plug-in - thanks! This conditional indexing functionality is what I'm after but am not clear whether it is currently implemented or dev notes for future development? Some of the tags used in the example are invalid against the current schema for my source - "not", "normalize" etc. I can't see any recent commits since I downloaded which alter the schema also.

[tahagh]

unfortunately it's not implemented yet, just an idea for the future.
On Jan 21, 2015 12:37 AM, "raisindetre" [email protected] wrote:

Fantastic plug-in - thanks! This conditional indexing functionality is
what I'm after but am not clear whether it is currently implemented or dev
notes for future development? Some of the tags used in the example are
invalid against the current schema for my source - "not", "normalize" etc.
I can't see any recent commits since I downloaded which alter the schema
also.

Reply to this email directly or view it on GitHub
#12 (comment)
.

[AndraDenis]

Did you manage to implement the conditional indexing?

[tahagh]

No