Senior Python Software Engineer, Data Lake
Markit
Poland, Gdansk- ul. Marynarki Polskiej 163
3 d. temu

Senior Python Software Engineer, Data Lake

Gdansk - ul. Marynarki Polskiej 163

Project

The aim of the project is to create a Data Lake - an environment which contains all the data that the company acquires, allows data scientists and analysts easily access various data sets and finally do complex data analysis.

We are searching for a person who will help us deliver the Data Lake Catalogue a web application which is used to catalogue all the datasets at IHS Markit.

It consists of a REST API written in Flask and frontend in ReactJS. Everything delivered with extensive use of Docker and hosted on AWS.

Responsibilities :

  • Develop a key component in a system for managing big data (5+ Petabytes) in the company, mostly in backend but potentially also in front-end
  • Package your application in Docker containers and deploy it to the cloud (AWS)
  • Use AWS services (IAM, S3, Lambdas, SQS, SNS)
  • Use and modify various Dev-Ops tools to automate repetitive tasks
  • Work in a team environment using Agile (Scrum) practices and methods
  • Work with internal and external customers to understand requirements better and adjust the design accordingly
  • Requirements :

  • Full project life-cycle experience of a web app
  • Rich experience in Python (the team uses Flask, Marshmallow, SQL Alchemy)
  • Knowledge of Docker
  • Good knowledge about common design patterns and architecture patterns
  • High analytical and problem-solving skills
  • Eagerness to learn new things and passion for software development
  • Strong unit testing and troubleshooting skills
  • Curiosity why something is working even though it should not
  • Additionally, as a Senior team member you are expected to :

  • Be a mentor to other team members
  • Drive architecture design in cooperation with other team members
  • Perform investigation and design tasks independently
  • Nice to have :

  • Other modern programming languages, like Java, Kotlin, Scala, C#
  • Elasticsearch
  • AWS services - S3, EC2, IAM, SQS, SNS, Lambda
  • React, Angular or other front-end frameworks
  • We offer :

  • Access to the most interesting information technologies
  • Ability to implement your own ideas and solutions
  • Competitive salary
  • Participation in conferences and training
  • Three days for charity / volunteering

  • Chillout & fun room (table tennis, table football, Xbox, billiards)
  • Attractive benefits package (private health care, life insurance, MultiSport card)
  • English classes
  • Fruit days, coffee, tea, chocolate
  • IHS Markit is committed to Equal Employment Opportunity and providing reasonable accommodations to applicants with disabilities.

    If you are interested in applying for employment with IHS Markit and need special assistance or accommodation to use our website to apply to a position, please contact accessibility ihsmarkit.

    com or call +1 212 849 0399. Determination on requests for reasonable accommodation will be considered on a case-by-case basis.

    This contact information (email and phone) is intended for application assistance and accommodation requests only.

    We are unable to accept resumes or provide information about application status through the phone number or email address above.

    Resumes are only accepted through the online application process and only qualified candidates will receive consideration and follow-up.

    IHS Markit is proud to provide equal employment opportunity (

    Aplikuj
    Dodaj do ulubionych
    Usuń z ulubionych
    Aplikuj
    Mój adres email
    Klikając przycisk "Kontynuuj", wyrażam zgodę neuvoo na przetwarzanie moich danych i wysyłanie powiadomień e-mailem, zgodnie z zasadami przedstawionymi przez neuvoo. W każdej chwili mogę wycofać moją zgodę lub zrezygnować z subskrypcji.
    Kontynuuj
    Formularz wniosku