Senior Data Engineer - Hadoop/HDFS/Kafka/Spark/Hive
‎23 godz. temu
source :

Job title Senior Data Engineer(SDE)(Hadoop, HDFS, Kafka, Spark, Hive)Overall Experience 8 to12 yearsJob location Chennai BangaloreNotice Period Immediate joiner 15 to 20 day MaxSr Data EngineerTheDataTeam is looking for a Senior Data Engineer to join fulltime and contribute to the engineering consulting services of the company.

The Senior Data Engineer role is primarily responsible for building out entire engineering artifacts (code and documentation) for clients delivered on top of the Hadoop ecosystem (and friends like Spark and Kafka).

The Responsibilities Of The Senior Data Engineer Are Requirements gathering and assessment Breakdown complexity and translate requirements to specification artifacts and story boards to build towards, using a testdriven approach Engineer scalable data pipelines using big data technologies including but not limited to Hadoop, HDFS, Kafka, HBase, Elastic Implement the pipelines using execution frameworks including but not limited to MapReduce, Spark, Hive, using JavaScalaPython for application design.

Mentoring juniors in a dynamic team setting Manage stakeholders with proactive communication upholding TheDataTeam's brand and valuesA Candidate Must Have The Following Skills Strong problem solving ability Excellent software design and implementation ability Exposure and commitment to agile methodologies Detail oriented with willingness to proactively own software tasks as well as management tasks, and see them to completion with minimal guidance Minimum 8 years of experience Should have experience in full lifecycle of one big data application Strong understanding of various storage formats(ORCParquetAvro) Should have hands on experience in one of the Hadoop Experience in at least one cloud environment (GCPAWSAzure) Should be well versed with at least one database (MySQLOracleMongoDBPostgres) Bachelor's in Computer Science, and preferably, a Masters as well Should have good code review and debugging skillsAdditional skills(Good to have) Experience in Containerization (dockerHeroku) Exposure to microservices Exposure to DevOps practices Experience in Performance tuning of big data applications

Zgłoś tę pracę

Thank you for reporting this job!

Your feedback will help us improve the quality of our services.

Mój adres email
Klikając przycisk "Kontynuuj", wyrażam zgodę neuvoo na przetwarzanie moich danych i wysyłanie powiadomień e-mailem, zgodnie z zasadami przedstawionymi przez neuvoo. W każdej chwili mogę wycofać moją zgodę lub zrezygnować z subskrypcji.
Formularz wniosku