[Solved] .aspx site Web scraping using python [closed]

by


Inside your for loop you’re creating a new Session object – you should only have one (you have one at the start of your code)

You’re also using a .get() request when it should be a .post()

replace:

# Getting data from each page
s = requests.Session()
headers = {'User-Agent': 'Mozilla/5.0'} #My user agent here
response = s.get(url, verify=False, headers=headers, data=data)

with:

response = s.post(url, verify=False, headers=headers, data=data)

solved .aspx site Web scraping using python [closed]