I'm working on a hobby project where I want to collect the YouTube channels for a specific genre (a game in this example). I do this based on a search term. For example "Witcher 3, Witcher 3 Wild Hunt" etc. However, I'm torn about what data collection method I should use. I want to collect the following:
- Channel Name
- Avatar image (link to image)
- Subscribers
- Number ofvideos
- Channel Description
- Other information (whatever is available)
I currently got a small project, with the points mentioned above, running in Selenium but it might be less scalable. And also, it might not be the right way to do it since I have to strip characters, convert strings to integers etc.
I want to work with the YouTube API and I am familiar with Google Cloud. But the code to get a list of channels seems complicated. I'm not that experienced with Python yet. When I used other API's that offer to 'scrape' the YouTube Search Results, it's only limited to 20 results and not sorted by subscribers. This means that I would leave a lot of channels out.
Do you guys have any suggestions on how I should approach this issue?
