Big Data Engineer
Brown Brothers Harriman
8 d. temu

Brown Brothers Harriman is seeking a full-time Big Data Engineer to help with the configuration, architecture design and development of a brand-

new Big Data platform. BBH’s Big Data platform serves as the foundation for a key set of offerings running Cloudera's distribution.

It is an opportunity for the candidate to gain both knowledge and experience with the most advanced data technology in a highly-secured environment.

Key responsibilities include :

  • Facilitate the establishment of a secure data lake on BBH’s Big Data infrastructure
  • Provide technical leadership on best practices for chosen architecture and technology (Cloudera)
  • Deliver solutions that fulfill business needs and align with the information vision and strategy of enterprise data lake
  • Design, document and develop ETL logic and data flows to facilitate the easy usage of data assets, both batch and real-time streaming
  • Help establish and maintain Data Governance processes and mechanisms for enterprise data lake
  • Leverage the following (but not limited to) components of Cloudera distribution to achieve project objectives : HDFS, Hadoop, MapReduce, Sqoop, Hive, Impala, Solr, Oozie and Spark
  • Consistent practice in coding and unit testing
  • Work with distributed teams and act as a subject matter expert
  • Qualifications :

  • Bachelor's degree in Computer Science or related technical field, or equivalent experience
  • 8+ years of experience in an IT developer role
  • 4+ years’ real project experience as a data wrangler / engineer across design, development, testing, and production implementation for Big Data projects, processing large volumes of structured / unstructured data
  • Strong hands-on experience with Spark and Hadoop / MapReduce
  • Strong experience with programming languages Java, Scala and / or Python
  • Strong experience in designing efficient and robust ETL / ELT workflows and schedulers
  • Experience with Apache Pig scripting and Apache HiveQL
  • Experience with NoSQL databases (HBase / MongoDB)
  • Experience in Agile development environment
  • End-to-end development life-cycle support and SDLC processes
  • Ability to understand and adapt to changing business priorities and technology advancements
  • Communication skills both written and verbal
  • Strong analytical and problem-solving skills
  • Self-driven, ability to work independently and as part of a team
  • Nice to have :

  • Knowledge of Machine Learning libraries and exposure to Data Mining
  • Cloudera Certified Professional (CCP) or Cloudera Certified Administrator (CCA)
  • What We Offer :

  • A collaborative environment that enables you to step outside your role to add value wherever you can
  • Direct access to clients, information and experts across all business areas around the world
  • Opportunities to grow your expertise, take on new challenges, and reinvent yourself without leaving the firm
  • A culture of inclusion that values each employee’s unique perspective
  • High-quality benefits program emphasizing good health, financial security, and peace of mind
  • Rewarding work with the flexibility to enjoy personal and family experiences at every career stage
  • Volunteer opportunities to give back to your community and help transform the lives of others
  • Full timeKrakow

    Dodaj do ulubionych
    Usuń z ulubionych
    Mój adres email
    Klikając przycisk "Kontynuuj", wyrażam zgodę neuvoo na przetwarzanie moich danych i wysyłanie powiadomień e-mailem, zgodnie z zasadami przedstawionymi przez neuvoo. W każdej chwili mogę wycofać moją zgodę lub zrezygnować z subskrypcji.
    Formularz wniosku