Senior Software Engineer

Syndigo’s engineering team is looking for a passionate Data Engineer / Scraping Extraordinaire to help develop web data mining robots and power our software. This is a team role to fulfill the Syndigo’s growing crawling needs. The role will require knowledge of writing sophisticated crawlers and scraping large volumes of unstructured data from public databases, websites, and social platforms using Python. The role will help ensure the accessibility, aesthetics, performance, and security of the application, and will work with other members of the software engineering team to perform integration activities.

Essential Duties and Responsibilities:

• • The ideal candidate should have in-depth experience in Python, Django, MVC Pattern, Linux, and Cloud technologies, and comfortable working in an agile, test-driven environment and is experienced in continuous-delivery processes.
    Applicants must also be excellent problem solvers.
    Create new data ingestion and processing tooling to eliminate manual processes, inefficient or repetitive work, and address quality issues.
    Advanced knowledge of Django ecosystem and best practices.
    Work with the team to scale and embed techniques and help with data ingestion projects.
    Extract data from a variety of relational databases, manipulate, explore data using quantitative, statistical and visualization tools
    Develop and implement standards for clean code that maintain modularity, clarity, and portability.
    Timely escalation with Product and Engineering leaders in grooming of backlog items
    Demonstrate passion for continued learning by staying abreast of new technology and trends.
    Adhere to SDLC and ensure that it is being followed consistently by entire team

     

    
    WE SHOULD TALK IF THIS SOUNDS LIKE YOU

     

    7+ years of professional web/software development experience.
    5-7 years’ experience in Python.
    3+ years of Django experience.
    Experience with at least two RDBMS, necessary PostgreSQL or MySQL
    Experience with at least two queue managers or message brokers.
    Unix: command line, IPC, shell scripting
    Microservices: scaling, monitoring, and support experience
    Advanced in Docker and docker-compose
    Experience with at least one container orchestrator
    Command of software engineering principles, frameworks, best practices and technologies.

     

    Plus:
    Dev Ops experience in AWS/Azure
    Knowledge of e-commerce platforms.
    Experience with Elasticsearch.

 #LI-REMOTE