Zyte logo

Fully remote

Team Lead Web Scraping/Python

About Us

At Zyte, we eat data for breakfast and you can eat your breakfast anywhere and work for Zyte. Founded in 2010, we are a globally distributed team of over 250 Zytans working from over 28 countries who are on a mission to enable our customers to extract the data they need to continue to innovate and grow their businesses. We believe that all businesses deserve a smooth pathway to data

For more than a decade, Zyte has led the way in building powerful, easy-to-use tools to collect, format, and deliver web data, quickly, dependably, and at scale. And today, the data we extract helps thousands of organisations make smarter business decisions, secure competitive advantage, and drive sustainable growth. Today, over 3,000 companies and 1 million developers rely on our tools and services to get the data they need from the web.

About the Job:

Zyte is looking for software engineers to join our Delivery team as Team Leads to work on web crawler development with Scrapy, our flagship open-source project.

Are you interested in managing teams and people and building web crawlers harnessing the Zyte platform, which powers crawls of over 3 billion pages a month?

Do you like working in a company with a strong open-source foundation?

Zyte helps companies, ranging from Fortune 500 enterprises to up and coming early stage startups, turn web content into useful data with a cloud-based web crawling platform, off-the-shelf datasets, and turn-key web scraping services.

Job Responsibilities:

  • Technical leadership of a development team, being responsible for scopes of work execution and delivery to our data services customers

  • Drive, support, mentor, train, inspire and motivate your team of software engineers

  • ´╗┐´╗┐Oversee all technical aspects, being the first point of contact for any challenges that arise offering advice and coaching

  • ´╗┐´╗┐Work closely with Project Managers and escalate information and issues if necessary

  • ´╗┐´╗┐Communicate effectively with projects stakeholders

  • ´╗┐´╗┐Adept at understanding customer needs and focused to deliver the best solution that addresses customer's business goals

  • ´╗┐´╗┐Implement best practices and standards and promote continuous improvement and technical excellence

  • ´╗┐´╗┐Collaborate with Sales, Product, QA and Development to provide the best solutions to customers

  • ´╗┐´╗┐Design, develop and maintain web crawlers and scrapers and other data pipeline downstream solutions

  • ´╗┐´╗┐Identify and resolve performance and scalability issues with distributed crawling at scale

  • ´╗┐´╗┐Leverage the Zyte platform, products and our open source projects to deliver our data services solutions

  • ´╗┐´╗┐Participate with a leading role in our development chapters, the place where continuous improvement is hosted within our development organization

  • ´╗┐´╗┐Career planning and development and performance reviews for team members

  • ´╗┐´╗┐People issue management

  • ´╗┐´╗┐Active participation in software engineers recruitment process

ZyteÔÇÖs platform and Delivery offerings have been growing tremendously over the past couple of years but there are a lot of big projects waiting in the pipeline, and in this role you would be a key part of that process. HereÔÇÖs what weÔÇÖre looking for:

  • 6+ years of software development experience.

  • ´╗┐´╗┐Solid Python knowledge.

  • ´╗┐´╗┐Solid Linux/UNIX, HTTP, HTML, Javascript and Networking knowledge.

  • ´╗┐´╗┐Strong experience with web data crawling and scraping with Scrapy.

  • ´╗┐´╗┐Good knowledge of Zyte's platform products.

  • ´╗┐´╗┐Strong communication skills at both business and technical levels.

  • ´╗┐´╗┐Proactivity and autonomy to deliver scopes of work with minimal supervision.

  • ´╗┐´╗┐Strong prioritization and delegation skills.

  • ´╗┐´╗┐Continuous improvement mindset.

  • ´╗┐´╗┐Adept at promoting learning and development in the team through positive feedback.

  • ´╗┐´╗┐Team and people management capabilities.

  • ´╗┐´╗┐Resilience to handle customer escalations and interactions.

Bonus points for:
  • Scrapy experience is a big plus.

  • Familiarity with techniques and tools for crawling, extracting and processing data (e.g. Scrapy, NLTK, pandas, scikit-learn, mapreduce, nosql, etc).

  • Proficient English

As a new Zytan, you will:

Become part of a self-motivated, progressive, multi-cultural team.

Have the freedom and flexibility to work from where you do your best work.

Attend conferences and meet with team members from across the globe.

Work with cutting-edge open source technologies and tools.

35 days paid holidays