We are looking for Big Data Engineer with Scala to join our team. We process over a billion records at a time, our engineers are responsible for the data analysis and construction as well as for the optimization of data flow processes.
You will build multi-country pipelines using ETL solutions for acquiring, processing, and loading medical data into the database using Hadoop and cloud technologies.
Your role
Building pipelines for processing big amounts of medical data
Participating in analysis, system design, development, deployment, and maintenance
Configuration and prototyping of new systems
Conducting peer code reviews
Creating comprehensive automated unit and integration tests
Your skills
At least 3 years of hands-on experience as a Data Engineer or similar position
Knowledge of Scala
Solid experience with data analysis, data profiling, data integration, data quality, data warehousing, data reporting
Experience with Microservices Architecture and / or Big Data Stream / Batch processing
Knowledge of one or more : Apache Kafka, Apache Spark, Apache Flink, HDFS
Intermediate SQL knowledge
Experience with complex ETL design and implementation
Good understanding of TDD, CI, CD Jenkins
Knowledge of build automation tools such as Maven, Gradle, SBT
Job no. 220622-FQTU4
