Hi Team,
On the individual Crawler page, you have 2 counters for:
a) Pages Crawled
b) Pages Failed
and a “Status” field
The pain point is these 2 counters and Status field do not auto-refresh as the crawler progresses through the given URLs. I will recommend having this capability on the page as the only other option is to manually refresh the crawler page to see what is the current crawl status.