Senior Hadoop Administrator / Data Engineer
|Job Title:||Senior Hadoop Administrator / Data Engineer|
|Location:||Amsterdam, North Holland|
|Contact Name:||Mark Crorkin|
|Job Published:||June 22, 2018 10:00|
Becoming data driven is a key pillar of the company strategy.
The company wants to run its Big Data environment via DevOps. For this they are looking for a specialist who is senior in Hadoop administration and data engineering. We need someone to prepare the team for DevOps administration responsibilities towards the launch of the new big data platform.
Your work involves designing, capacity arrangement, cluster set up, performance fine-tuning, monitoring, structure planning, scaling and administration. You will work closely with the BI architecture team, infrastructure, network, database, business intelligence and application teams to ensure business applications are highly available and performing within agreed on service levels. Accountable for storage, performance tuning and volume management of Hadoop clusters and MapReduce routines.
-Minimum of 4 year of Hadoop stack admin experience, set-up/tear-down, configuration management and debugging of problems
-Knowledge of monitoring and debugging apps in the Hortonworks environment.
-Understanding of how Hadoop works, tracking errors and solving performance issues.
-Experience in data engineering
-Self-driven on projects with provided requirements
-Hands-on pragmatic attitude
-Backend Data Work Experience.
-Data warehouse AND / OR Hadoop Hive Experience. Mainly on HIVE and Data Storage such as ORC, AVRO
-ETL and SQL Experience
-Experience in programming data handling tools (e.g. streamsets)
-Experienced working with Scrum methodology + agile mindset
-Experience in data modeling