A level NEA Computer Science Web Scraping
Hi, I am trying to web scrape through different websites, does anyone have any idea how to automate it so that the program will be able to know what to search for in the html code. I am trying to create a web scraping project to search for jobs, and I would like to be able to scrape through many different sites.
Thanks,
Sam
Thanks,
Sam
Reply 1
18
Original post
by sam10381Hi, I am trying to web scrape through different websites, does anyone have any idea how to automate it so that the program will be able to know what to search for in the html code. I am trying to create a web scraping project to search for jobs, and I would like to be able to scrape through many different sites.
Thanks,
Sam
Thanks,
Sam
So why don't you replicate the Google Search engine? Pick a starter web page and then whenever you get an href, log it and at some point in the future, scrap that web page. Eventually you will have a massive list of every web page in the internet and be ready to start competing with Google itself! Google also ranks sites based on how many links there are to that page. Its a start and by the time you have perfected it, you will have worked out how to work out the title of each (clue - <title>)
Quick Reply
Related discussions
- NEA help please
- Should I Switch from CAIE to OCR A-Level Computer Science?
- WJEC A-level Computer Science Unit 4 - 18th June 2025 [Exam Chat]
- ALEVEL OCR A Computer Science NEA
- Nea ocr computer science help please!!!
- Computer Science A-level, is it really worth it or will it be a pain in the backside?
- NEA as a private candidate?
- A-Level options
- AQA A level Computer science
- AQA Computer Science NEA
- A Level Computer Science - python help needed!
- AQA A-Level Computer Science NEA grade boundaries
- Resitting OCR A-level computer science
- A-Level Computer Science Study Group 2025-26
- I feel like I dont have much to say for my last section in my personal statement.
- Got DDD in My A-Level Mocks - Need Serious Help with Revision
- When should I worry about my Computer Science NEA?
- Computer Science NEA Survey
- Should I drop A level CompSci in Year 13
- HELP!!!!!
Latest
Trending
Last reply 1 month ago
OCR A-level Computer Science Paper 1 - 11th June 2025 [Exam Chat]Last reply 4 months ago
Microsoft Certification Discussion: Microsoft AZ-140 & AZ-400 Exam DifficultiesLast reply 5 months ago
How to Export Contacts from Lotus Notes to Outlook?Last reply 7 months ago
Survey Exchange for A level computer science NEALast reply 8 months ago
Prepared for OCR GCSE Computer Science Paper 2 2025Last reply 8 months ago
OCR A-level Computer Science Paper 2 - 18th June 2025 [Exam Chat]Last reply 8 months ago
AQA A-level Computer Science Paper 2 - 18th June 2025 [Exam Chat]Last reply 8 months ago
AQA A-level Computer Science Paper 1 - 11th June 2025 [Exam Chat]
How The Student Room is moderated
To keep The Student Room safe for everyone, we moderate posts that are added to the site.
