Senior Big Data Developer

About the employer:

My client is a financial services firm that creates solutions for the financial sector. Their tradition dates back to 1818 and their reach is worldwide - they have offices all over the world from Chicago to Hong Kong.

Responsibilities:

• facilitate the establishment of a secure data platform on OnPrem Cloudera infrastructure,
• document and develop ETL logic and data flows to facilitate the easy usage of data assets, both batch and real-time streaming,
• leverage the following (but not limited to) components of Cloudera distribution to achieve project objectives: Sqoop, Hive, Impala, Spark,
• consistent practice in coding and unit testing,
• work with distributed teams.

Requirements:

• 6+ years of experience in an IT, preliminary on hands on development,
• strong knowledge of architectural principles, frameworks, design patterns and industry best practices for design and development,
• strong hands on experience with programming languages - Java, Scala or Python,
• 4+ years’ real project experience as a data wrangler/engineer across design, development, testing, and production implementation for Big Data projects, processing large volumes of structured/unstructured data,
• strong hands-on experience with Snowflake, Spark and Kafka,
• experience with Oracle database engine with PL/SQL and performance tuning of SQL Queries,
• experience in designing efficient and robust ETL/ELT workflows and schedulers,
• communication skills - both written and verbal, strong analytical and problem-solving skills,
• experience working with Git, Jira, and Agile methodologies,
• very good English.

Our client offers:

• private medical care for you and your family,
• life Insurance,
• hybrid Working Opportunities,
• 2 additional days added to your holiday calendar for Culture Celebration and Community Service,
• various additional benefits including professional training and qualification support,
• subsidised cafeteria,
• contracts for an indefinite period of time with no probation period.