[Solved] How to handle secure cookies with web crawler [closed]


The cookies in your sample are Google’s web analytics cookies, and they’re set via Javascript. Unless the crawler you’re writing can execute Javascript, those cookies will simply NEVER get set in the crawler.

What you see in your browser is utterly irrelevant for fixing this – it’s what the crawler sees, gets, and can do that counts.

1

solved How to handle secure cookies with web crawler [closed]