Crawler - Does it have a consistent name?

Content
1

Hi! What is the name that a client would see for the Site Crawler? Does it change based on what we name the crawler or is there a general “yext” name? Need to ensure that it is white-listed by their security team.

2

Hi Jordan,

A crawler is uniquely named when it is initially created on this screen:

image
image3336×1588 314 KB

Clients can also edit the name of the crawler after it is created, but its ID, which is based on its original name, will remain locked.

Let us know if you have any other questions!

Thanks,
Jamie

3

Hi @Jamie_Kim,

Ah okay! Can you confirm the ID this is the User Agent they would see?

Best,
Jordan

4

Hey Jordan,

Here is the user agent you can expect to see for the crawler:

Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) HeadlessChrome/87.0.4280.88 YextBot/Java Safari/537.36

Thanks,
Calvin

5

Hi Calvin, just revisiting this thread - is the User Agent above still the same or would clients identify our crawler via any other identifier since you posted your response in April 2021? Essentially looking to do the same as the original post; how would organisations identify the Yext crawler?

Many thanks, Sam

6

Hi Sam,

We haven’t changed the name, so the user agent is the same as what is listed above.

Also sharing that these details can also be found in this Create a Crawler help article - both the user agent and IPs addresses if that’s helpful as well.

1 Like
7

Perfect! Thanks so much for the quick replay