[Solved] Scrapy crawler function not executing


Found the issue, the problem was that because i was using extract() its output is a list, so i had a list within a list ( with only one element ) and the request wasn’t calling the url, changed it to a extract_first() and now it works.

HierarchyItem["hierarchy_url"] = lvl3.css("a::attr(href)").extract_first()

solved Scrapy crawler function not executing