At we pride ourselves on data-driven decision-making, and the data team is at the heart of this initiative. We are looking for a highly motivated Sr.
Software engineer with extensive data engineering experience to help build out the massive-volume data platform supporting NVIDIA's cloud platform services.
Our data platform serves as the basis for advanced real time data analytics and monitoring for NVIDIA's cloud services.
We are looking for an excellent Big Data Engineer that will work on collecting, storing, processing, and analyzing huge sets of data.
The primary focus will be on choosing efficient solutions to use for these purposes, then maintaining, implementing, and supervising them.
This is an opportunity to handle billions of events per day, multi TBs per day, build systems at scale, demonstrate and contribute to open source technologies.
What you’ll be doing :
Design, Build & Maintain critical high performance, large scale services and libraries
Building data pipelines for collecting & processing data from multiple data sources : from the point of ingestion to measurable insight
Monitoring performance and advising any necessary infrastructure changes
Build automation and integration tools for the data platform
Automate everything for measuring, testing, updating, monitoring and alerting.
Drive data quality for a global cloud service that generates several billions of data points per day, producing 100s of metrics
We use AWS extensively, so experience with deploying to AWS, EMR and other web services will help you hit the ground running
What we need to see :
Bachelors or Master’s degree in Computer Science or a related technical field.
2+ years’ software engineering experience
Proficient understanding of distributed computing principles
Excellent SW development skills in one or more : Java / Scala / Python / C
Experience with building real time streaming applications using Kafka
Experience in a highly-available big data ecosystem (Hadoop, Spark, Kafka) at non-trivial scale
Ways to stand out from the crowd :
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.