The company uses search engine technology and obtains data for its searches from many web scrapers and other external data sources. You would be working as part of an energetic and intelligent team of developers to develop web scrapers and data sources and ensure they are reliably providing accurate data. You would also be responsible for developing and maintaining deep links to other web sites.
Responsibilities
* Working in primarily in python using powerful scraping and deeplinking libraries
* Ensuring that information on the website is accurate and complete
* Creating seamless redirects to partners’ sites
* Migrating to a new python-based data collection solution
* Assisting with the maintenance of existing scrapers and data sources
* Understanding and configuring our system in keeping with fast-changing operational requirements
Technical Requirements
Experience with:
* Python
* SQL
* XML
* XSLT
* XPath
* Will consider candidates with object oriented development skills (Java, PHP, ,net)
Ideally an understanding of how websites work from the perspective of scraping them, including:
* Common HTTP methods e.g. GET, POST
* Cookies
* AJAX (and mimicking client-side behaviour)
* JSON (and parsing it)
* Bot detection (and avoiding it)
This position may suit a recent graduate and offers the right candidate the opportunity to develop their skills across a range of systems in an integral role within the organisation.
If you are looking for a challenging but rewarding position with excellent benefits and career development opportunities please call me on 0141 410 1018.
Job Reference: 14927
Closing Date: 09-May-2011