Company
Novata logo

Novata

www.novata.com
Location

Hybrid work from London:

  • 🇬🇧 United Kingdom
Apply

Senior Data Engineer (Python, Airbyte)

Novata is a public benefit corporation created and funded by a unique consortium of foundations and private sector companies including the Ford Foundation, the Omidyar Network, S&P Global, and Hamilton Lane. We are a for-profit, mission-driven company with the goal of empowering the private markets to build a more inclusive and sustainable form of capitalism. By bringing together the brightest minds in financial data, private equity, social justice and inclusive capitalism, we aim to build the best technology and tools for the private markets to better collect, analyze, benchmark and report ESG (Environmental, Social, Governance) data. We have an experienced and diverse team who are as ambitious about growing a successful company as we are about making an impact.


About the Team

We’re a team of around 45 engineers and digital specialists of mixed disciplines and experience distributed across the UK and US. Our highest priority is to satisfy the customer through continuous delivery of the product so we focus on making small, incremental improvements in order to deliver high quality software, frequently. We’re strong believers in the principles of agile, so we work in small cycles and regularly reflect on our processes making changes where necessary to improve outcomes and effectiveness.

This role sits inside our Product and Engineering team, where you’ll be embedded into our new data team, and contribute to the development of our new data analytics and benchmarking platform. You’ll have a chance to get involved in the platform's development from the outset, taking an active role in defining and standing up a new data platform.

You will:

  • Design and build DAG-based data pipelines that can handle complex data efficiently.

  • Manage the data infrastructure, including databases and a data warehouse, ensuring that the infrastructure is scalable and reliable.

  • Collaborate with data scientists and analysts to understand their data requirements and develop solutions to meet their needs.

  • Maintain CDC ETL processes that move data from various sources into the data warehouse.

  • Ensure data quality and integrity by implementing quality control procedures and performing data validation and verification.

  • Stay up-to-date with the latest industry trends and best practices in data engineering.

  • Coach and mentor junior team members, ensuring that they are following best practices and helping them to develop and improve their skills and abilities.

  • Fulfill additional duties as requested.

You have:

  • Excellent communication skills, and are able to work collaboratively and respectfully with other members of the team.

  • A start-up mentality, are responsible, energetic, ambitious, adaptable and willing to jump in wherever you might be needed.

  • Good judgment, and aren’t afraid to make decisions and act with purpose and intention to progress our mission.

  • A pragmatic approach to problem solving, and appreciate the importance of building the right thing vs building the thing right.

  • Great attention to detail, a no-compromise approach to quality and are committed to delivering the best experience possible to our users.

  • Extensive and demonstrable experience developing reliable, efficient data pipelines that can consume and transform large amounts of data suitable for enterprise level customers.

  • Ability to “get hands dirty” with data wrangling - slicing and dicing datasets for ad-hoc analytics.

  • Production experience with SQL data modeling, ideally in a Data Lake / Warehouse context.

We Use and Teach:

  • Python, Airbyte, Dagster and dbt for our data pipelines.

  • Snowflake for our Data Warehouse.

  • AWS for infrastructure, specifically EKS, RDS and S3.

  • Git for managing change.

  • Docker to package our services into containers.

  • Terraform to define our orchestrate our infrastructure.

Restrictions

  • Applicants must be located in and eligible to work in the UK. We can’t currently support or sponsor visa applications

  • Work at a scaleup where you can make an impact, and see the results of what you do.

  • A competitive salary up to ÂŁ90k per annum, depending on experience.

  • Hybrid approach to working, with regular coworking days in our London office.

  • 30 days holiday per year, plus bank holidays.

  • Pension scheme with a 5% contribution from you, and 9% from us.

  • Private medical insurance via Vitality.