About
Turn delivers real-time insights that transform the way leading advertising agencies and enterprises make decisions. Our digital advertising hub enables audience planning, media execution, and real-time analytics from a single login, and provides point-and-click access to more than 150 integrated marketing technology partners. Turn is headquartered in Silicon Valley and provides its products and services worldwide. For more information, visitturn.com or follow@turnplatform.
The Data Infrastructure Team at Turn is responsible for running very large Hadoop clusters, extremely fast changing RDBMS environments and different types of storage environments. This is an agile environment that provides opportunities to solve complex and scaling challenges.
Overview
As part of the Data Infrastructure Team, you will be an integral part of managing 24X7 Hadoop infrastructure. Currently this environment is at tens of petabytes in size. You will be contributing to improvements in architecture, performance, and optimization of Turn’s Hadoop ecosystem components. You’ll get the chance to take on complex and interesting problems as part of a fast-paced, highly-collaborative team. We've built a complex analytics system around Hadoop for scalability and high availability. It's imperative that you approach administration with an emphasis on repeatability, testability, and consistency. The demands on our systems are increasing rapidly as we grow the userbase, as data ingestion grows, and as we add more functionality and products.
The successful candidate will be self-motivated with an attitude of getting things done, be able to see the big picture, and be able to deep-dive into details to solve complex problems.
Responsibilities
Contribute actively to improve Turn’s Hadoop ecosystem architecture.
Apply in-depth analysis of Hadoop performance, design solutions for issues, and evaluate each solution’s effectiveness.
Understand, develop, implement, and maintain operational best practices for smooth operation of large Hadoop clusters.
Design, develop and manage diagnostic & instrumentation tools for troubleshooting & in-depth analysis.
Optimize and tune the Hadoop environment to meet performance requirements.
Partner with Hadoop developers in establishing best practices for Warehouse and Analytics environments.
Investigate emerging technologies in Hadoop ecosystem that relate to our needs, and implement those technologies.
Required Skills
3-5+ years plus of hands-on experience in deploying and administering Hadoop environments. Experience with multi-petabyte-scale Hadoop clusters is preferable.
Strong problem solving and troubleshooting skills.
Deep understanding of Hadoop design principals and the factors that affect distributed system performance.
Well versed in installing, administering, and managing Hadoop clusters running Cloudera, YARN, Spark, or similar technologies.
Sound understanding of products in the Hadoop ecosystem, such as HDFS, map-reduce, Spark, Storm, Pig, Oozie, Zookeeper, Cloudera manager, etc.
Good experience with scripting languages, such as Unix shell scripting languages, Python, Ruby, etc.
Good knowledge in implementing metrics collection for monitoring and alerting.
Hands on experience with automation tools like Puppet.
Good knowledge of Hadoop cluster connectivity and security.
BS/MS degree in computer science or related field.
Pluses
Linux administration and troubleshooting skills.
Good knowledge of common ETL packages/libraries and data ingestion.
Experience with RDBMS and NOSQL databases.
Experience with Java programming.
Knowledge of open source projects like Git, Nagios, TSDB, Docker and OpenStack.
Experience with Hadoop in cloud.
Location: Champaign, Illinois; On the University of Illinois campus in the Research Park
In addition to our great environment, we offer a competitive base salary, bonus program, stock options, employee development programs and other comprehensive benefits. Please send a cover letter along with your resume when applying to the position of interest located at Turn.com. We are an Equal Opportunity Employer. No phone calls and no recruiting agencies, please.
The Turn Innovation Center, located in the University of Illinois Research Park, is Turn’s first engineering office and innovation center outside of the corporate headquarters. The Turn Innovation Center offers the same excitement and challenges working in the fast-paced online advertising industry as Turn’s headquarters, plus many various opportunities to engage with the University and students. The Research Park, consistently ranked as one of the top research parks and tech incubators in the country, offers a variety of social and training events throughout the year. All employees at companies within the Research Park are affiliate members of the University, and receive benefits accordingly (http://researchpark.illinois.edu/at-illinois/affiliation-benefits).