Manager, Data Engineering
You yearn to be part of cutting edge, high profile projects and are motivated by delivering world-class solutions on an aggressive schedule
Someone who is not intimidated by challenges, even thriving under pressure, is passionate about their craft, and hyper focused on delivering exceptional results
Ability to work in a geographically decentralized organization
You love learning new technologies and mentoring junior engineers
It would be awesome if you have a robust portfolio on Github and / or open source contributions you are proud to share
On a quest to transform the Data and analytic landscape, we are seeking bright, driven and talented individuals to lead the engineering of our Big Data powered platforms based on open source technologies, introduce new capabilities to a large population of data scientists, create and contribute cutting edge solutions to the Open source community. If you enjoy being part of an organization founded on the principals of Information based strategy (IBS), where Data and analytics is core part of how we do business, keep reading.
Developing cutting edge analytic / Big Data technology takes the culmination and collaboration of bright, talented people and forward thinking leadership. We nurture a work environment where people with a variety of thoughts, ideas and backgrounds guided by our shared values come together to make us one of the '100 Best companies to work for"
Geek, Nerd, Tech-junkie. They're all pet names to us. If you share a passion for all things technology and are up for the challenge, come dare to innovate, disrupt and deliver.
The Job:
Alongside some of the saves techies in the industry, you will be responsible for leading a team of engineers to build a platform to deliver Big Data / Fast data powered analytics for Technology operations.
Responsibilities and expectations:
- Develop an engineering practice within the Big Data engineering team to support open-source data products and establish Capital One's brand within the open-source data-analytics community.
- Engineer a platform to be able to ingest machine data real-time, customizable real-time dashboards and predictive analytics capability to proactively detect / avert failures, present a unified view of the IT ecosystem.
- Partner with peers within Technology operations to incorporate their use cases, develop prototypes and scale them to production use cases.
- Serious bonus points awarded for integrating on-site solutions to cloud based offerings such as Amazon's AWS.
- Develop scripts and glue code to integrate multiple software components
- Lead the engineering function to design and deliver a IT analytics capability based on machine log data
- Reliance on open source / emerging data technologies with an approach to building solutions in-house
Qualifications
Basic Qualifications:
Bachelor's Degree in Computer Science or Mathematics or Statistics or Data Analysis
At least 3 years of Java programming experience or at least 3 years of Javascript programming experience,
At least 1 year of Shell programming experience,
At least 1 year of python programming experience,
At least 1 year of experience with data streaming framework kafka or at least 1 year of experience with spring
At least 1 year of experience with Spark or at least 1 year of experience with Storm
Preferred Qualifications:
1 year experience in working with patterns in machine log
1 year of experience working with application logs
1 year of experience in building what-if analysis models
1 year of experience with Root cause analysis based on correlation of events along a timeline
1 year experience with one of the Machine learning languages R+ strongO or Spark ML or scikit
1 year experience with Agile development Methodology
Primary Location United States-Illinois-Champaign-U of I Research Park (35009)
Schedule Full-time
Travel Yes, 10 % of the Time
Apply for this position at the following link:
https://capitalone.taleo.net/careersection/usx/jobdetail.ftl?job=794613