Regex patterns

A condition that keeps a page by matching its URL against regular expressions.

A condition decides whether a fetched page is processed and its result kept. Conditions are configured inside a condition step under a pipeline's steps; a single condition step holds a list of conditions. This page documents the regex_patterns condition.

The regex_patterns condition matches the full URL against regular expressions. A page is kept when its URL matches an allow pattern and no deny pattern; default_allow decides the outcome for a URL that matches neither list.

Field	Type	Required	Default	Description
`allow`	list of regex strings	no	empty	Patterns a URL may match to keep the page.
`deny`	list of regex strings	no	empty	Patterns that exclude the page.
`default_allow`	boolean	no	`false`	Whether a URL matching neither list is kept.

steps:
  - kind: condition
    params:
      - kind: regex_patterns
        params:
          allow:
            - https://example\.com/products/.+

Regex patterns

Search docs