[Solved] How to get a link with web scraping

by


In the future, provide some code to show what you have attempted.

I have expanded on Fabix answer. The following code gets the Youtube link, song name, and artist for all 20 pages on the source website.

from bs4 import BeautifulSoup
import requests

master_url="https://www.last.fm/tag/rock/tracks?page={}"

headers = {
"User-Agent": "Mozilla/5.0 (iPhone; CPU iPhone OS 5_1 like Mac OS X) AppleWebKit/534.46 (KHTML, like Gecko) Version/5.1 Mobile/9B179 Safari/7534.48.3"
}

for i in range(1,20):
    response = requests.get(master_url.format(i), headers=headers)
    soup = BeautifulSoup(response.content, 'html.parser')

    chart_items = soup.find_all(class_='chartlist-row')

    for chart_item in chart_items:
        youtube_link = chart_item.find('a')['href']
        artist = chart_item.find('td', {'class':'chartlist-artist'}).find('a').text
        song_name = chart_item.find('td', {'class': 'chartlist-name'}).find('a').text
        print('{}, {}, {}'.format(song_name, artist, youtube_link))

solved How to get a link with web scraping