For agents and site owners

MyPortaBot

MyPortaBot is MyPorta's crawler. It reads the public property pages on estate and letting agents' own websites, so the homes you're marketing can be found on MyPorta, credited to you, with a link back to your listing.

What MyPortaBot is

Every request it makes identifies itself with this user agent:

MyPortaBot/1.0 (+https://www.myporta.ai/bot)

Before September 2026 our crawler used several working names, including ModelProp-RawFetcher, ModelProp-Discovery and MyPortaResearchBot. Rules in your robots.txt written for any of those names, or for "ModelProp" or "MyPorta", still apply to MyPortaBot.

MyPorta is run by AI Property Intelligence Ltd, trading as MyPorta, registered in England & Wales, company no. 16474737.

How it behaves

  • It reads your robots.txt before it crawls and obeys it, including Crawl-delay.
  • It makes one request at a time to your site, no more than two a second, and slower if your Crawl-delay asks.
  • It only reads public pages. It never logs in, fills in forms or sends enquiries, and never tries to get past a login, paywall or bot protection. If it's challenged, it stops.
  • It runs on cloud servers, so its IP addresses change. The user agent is the way to recognise it.

What it reads

From each listing page it takes the facts: the address, price, bedrooms, property type, whether it's for sale or to let and its current status, and which agent is marketing it. It keeps a dated copy of the page it read, as a record of what was published.

Listings found this way appear on MyPorta with your agency's name and a link to your page, and are marked so search engines don't index them as MyPorta's own pages.

Block or limit it

To keep MyPortaBot off your whole site, add this to the robots.txt file at the root of your website:

User-agent: MyPortaBot
Disallow: /

Or keep it out of one part of your site and slow it down:

User-agent: MyPortaBot
Disallow: /lettings/
Crawl-delay: 5

MyPortaBot picks up changes within 24 hours. Blocking MyPortaBot doesn't affect Google or any other crawler.

Remove your listings

Blocking stops new crawling. To take down listings MyPorta already shows from your website, email hi@myporta.ai with your website address and we'll remove them.

Send us a feed instead

If you'd rather control exactly what MyPorta shows, send us your listings directly. We take the same BLM feed you send the portals, or connect through your CRM, and feed listings carry your full descriptions and photos. Email hi@myporta.ai or visit the agent console.