What the New Pages Agent does
The New Pages Agent takes a product feed, one or more sitemaps, and connections to Google Search Console (GSC) and Google Analytics (GA). It generates labels from your products, combines those labels into topics, then checks whether each topic is worth creating a page for.
After filtering out the duds, the remaining topics sit waiting for your approval. Once approved, they can be published straight to the site via the integration, complete with h1, category blurb, meta-title and meta-description, plus the relevant products.
The pages have internal links generated automatically, and products and links stay up to date without manual intervention. For more detail on the publishing workflow, see the page creation platform page.
Key concepts
These terms appear throughout the New Pages Agent interface and documentation. Understanding them will make the rest of this guide straightforward.
Label
A meaningful part of a phrase. It can be one or more words. Examples: red, emerald green, audi, dresses.
Label group
What kind of thing a label is. For instance, red is a color, as is emerald green. audi is a brand. dresses is a category.
Topic
A set of labels. For instance, red Audi or emerald green dresses are both topics, each composed of two labels.
Grammar
A set of label groups. For instance, color + brand and color + category are both grammars. Grammars define which combinations of label groups the agent uses to build topics.
Positive label groups
The label groups required for any generated topics. At least one label from any of these groups is required for a topic to be created.
Ngrams
Bigram (2-gram) or trigram (3-gram) means topics with two or three labels, respectively. A bigram topic like red dresses combines two labels; a trigram like red cotton dresses combines three.
Product count
How many relevant products or listings match a topic. The agent uses this to decide whether there is enough inventory to justify a dedicated category page.
Maximum Best Position
The highest Google rank threshold for an existing page. If a page on your site already ranks better than this position for a keyword similar to the topic, the new topic is rejected to avoid duplication.
Minimum number of products
The required count of relevant products a topic must match for the agent to consider creating a new category page.
Minimum demand
The required monthly search volume a topic must have in the local market. Topics below this threshold are rejected as low demand.
Reject sieve
The automated set of checks that filters topics into rejection reasons. Topics can be rejected as duplicated, already ranking, insufficient products, irrelevant products, or low demand.
How it works
The New Pages Agent follows a pipeline from raw product data to published pages. Here is each step in order.
Product feed ingestion
The agent reads your product feed and extracts structured data - titles, descriptions, categories, attributes, and prices. It also reads your sitemaps and connects to GSC and GA to understand your current organic performance.
Label generation
From the product data, the agent generates labels and organizes them into label groups. For example, it might identify color labels (red, blue, emerald green), brand labels (Nike, Adidas), and category labels (trainers, jackets).
Topic creation
The agent combines labels into topics using the configured grammars and positive label groups. A grammar like color + category produces bigram topics such as red trainers or blue jackets. Trigram grammars like color + brand + category produce topics such as red Nike trainers.
Reject sieve filtering
Every topic passes through the reject sieve, a series of automated checks. A topic is rejected if it:
- xMatches an existing page on the site (duplicated)
- xMatches keywords the site already ranks for, or similar ones (already ranks)
- xHas too few matching products (insufficient products)
- xHas matching products that are not relevant to the topic (irrelevant products)
- xHas too little monthly search volume in the local market (low demand)
Approval and publishing
Topics that survive the reject sieve are presented for approval. Once you approve a topic, the agent publishes a full category page via the integration. Each page includes an h1, category blurb, meta-title, meta-description, and the relevant products. Internal links are generated automatically, and both products and links stay up to date without manual work.
Pipeline summary
Product feed
-> Label generation
-> Topic creation (grammars + positive label groups)
-> Reject sieve (duplicate / already ranks / insufficient / irrelevant / low demand)
-> Approval queue
-> Published pages (h1, blurb, meta, products, internal links)Related guides
Ready to create new pages?
See how the New Pages Agent can identify untapped category opportunities from your product feed and publish pages that drive organic traffic.