Hey!
For the scrape and crawl (which I think runs scrape under it), we are looking to get analytics such as page load time to understand the health of a website. i.e. a 200 status code only shows part of the picture. I figure you store this, but was wondering if it could be exposed in the API?
Thanks
One other ask, can we see redirect paths for the page load for SEO purposes?
Thanks for the suggestion. However, page load time also depends on the website’s DOM rendering. Do you think it makes sense to expose those load times in the API? Nonetheless, I appreciate your input.
Hey! Yeah I think so. We care about how long a page takes until it is ready for a user so until the DOM is rendered makes sense. i.e. how long the HTML takes to go over the network may be interesting from a technical perspective, but until it is rendered/usable/scrapable (i.e. a JS site loads in there content etc.) is what we care about. I suppose you could use lightspeed style timings or DataForSEO has some nice timing features:
Other things like word count of the main content, dom size and such as well would be helpful SEO data points.