Skip to content

john-tipper/rover-scraper

Repository files navigation

Minimal demo of scraping data from DVLA vehicle database website

This project uses PhantomJS to download data from the DVLA website and render from Javascript into HTML. It then uses JSoup to parse that HTML into a DOM that can be processed.

Code

All functionality is contained within the Crawler class - there are no tests and the registration being sought is hardcoded.

Running

./gradlew run  

Warning

NOTE: The website seems to occasionally return no results, even when the vehicle exists in the database. I don't know whether this is due to some form of rate-limiting at the server end, or whether there's some funny interaction between PhantomJS and the Java process that is calling it.

About

Minimum demo of scraping DVLA vehicle database

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages