Data Engineer with Python
SII Group
Warsaw, poland
‎14 godz. temu

We are looking for a Data Engineer with Python knowledge, who will be responsible for developing data pipelines for analysis of Configuration Management (CM), Performance Management (PM), and Drive Test (DT) data in CDIT+D clusters in a telco-related project.

Your role

  • Perform Data Engineering tasks required to analyze data from CDIT+D clusters
  • Setting up data pipelines
  • Storing data on client’s premises and transforming collected data into data structures optimized for efficient browsing
  • Execute testing, perform troubleshooting of delivered data pipelines
  • Your skills

  • Very good Python knowledge (as a plus combined with libraries like pandas, NumPy)
  • Familiarity with Apache Spark
  • Familiarity with partitioning, indexing, and retention strategies
  • Good knowledge of SQL
  • Ability to work with hdfs and s3 storage
  • Experience in Kubernetes for containerization
  • Experience in orchestrating data pipelines with Airflow
  • Job no. 220622-465FA

    Zgłoś tę pracę
    checkmark

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    Aplikuj
    Mój adres email
    Klikając przycisk "Kontynuuj", wyrażam zgodę neuvoo na przetwarzanie moich danych i wysyłanie powiadomień e-mailem, zgodnie z zasadami przedstawionymi przez neuvoo. W każdej chwili mogę wycofać moją zgodę lub zrezygnować z subskrypcji.
    Kontynuuj
    Formularz wniosku