Data Engineer with Python

SII Group

Gdansk, poland

‎13 godz. temu

We are looking for a Data Engineer with Python knowledge, who will be responsible for developing data pipelines for analysis of Configuration Management (CM), Performance Management (PM), and Drive Test (DT) data in CDIT+D clusters in a telco-related project.

Your role

Perform Data Engineering tasks required to analyze data from CDIT+D clusters

Setting up data pipelines

Storing data on client’s premises and transforming collected data into data structures optimized for efficient browsing

Execute testing, perform troubleshooting of delivered data pipelines

Your skills

Very good Python knowledge (as a plus combined with libraries like pandas, NumPy)

Familiarity with Apache Spark

Familiarity with partitioning, indexing, and retention strategies

Good knowledge of SQL

Ability to work with hdfs and s3 storage

Experience in Kubernetes for containerization

Experience in orchestrating data pipelines with Airflow

Job no. 220622-465FA

Zgłoś tę pracę

Thank you for reporting this job!

Your feedback will help us improve the quality of our services.