Is there a way to scrape an URL for just the HTTP-response-body, i.e. no JS execution?
My task is to “mimic” a requests.get() method.
Thanks
Is there a way to scrape an URL for just the HTTP-response-body, i.e. no JS execution?
My task is to “mimic” a requests.get() method.
Thanks
Hi there, you can use fastMode in scrape for this:
{
"url": "https://example.com",
"fastMode": true,
"formats": ["rawHtml"]
}
That´s the one, thank you.
Why is this not in the official documentation? Can you guarantee that this function will be retained in the future?
Great the worked for you, regarding docs and this function, unfortunately there’s no guarantee, high chances we’ll rename it at some point, but no immediate plans to change or remove it.