Snowflake/Databricks Engineer
Numer referencyjny: SDE/GB- lokalizacja
- mazowieckie / Warszawa
- kategoria
- Administrator
About the employer:
Our Client ranks at the top of the leading companies providing services at the highest level, allowing us to build modern and efficient businesses. The client's objective is to change business operational and technological models and adapt them to a rapidly changing world.
Responsibilities:
- design and build efficient, scalable data pipelines and ELT workflows using Snowflake
- oversee and maintain cloud environments to ensure high availability and top performance,
- utilize Snowflake capabilities like Snowpipe, Streams, Tasks, and Time Travel to support data operations,
- create and maintain database structures, data models, and stored procedures using Snowflake SQL,
- optimize performance in Snowflake, including query tuning and adjusting virtual warehouse configurations,
- administer security and access management through roles and permissions within the Snowflake platform,
- automate data loading from multiple sources using Snowflake integrations and external staging areas,
- partner with data architects and analysts to ensure high-quality, reliable, and consistent datasets,
- apply data governance and compliance standards to maintain control and transparency in the Snowflake environment,
- use Databricks notebooks to support data engineering activities with PySpark and SQL,
- enable advanced analytics and machine learning by integrating Databricks with Snowflake,
- help design and maintain Delta Lake data structures and related processing pipelines,
- improve processing efficiency through job tuning and orchestration in Databricks.
Requirements:
- advanced proficiency in Snowflake SQL for data modeling, transformation, and optimization,
- experience with Snowpipe, Streams, Tasks, and Time Travelfeatures,
- strong understanding of data warehousing conceptsand ELT architecture,
- expertise in performance tuning (query optimization, warehouse sizing, clustering),
- knowledge of role-based access control (RBAC) and data security in Snowflake,
- familiarity with external stages, file formats, and data ingestionfrom cloud storage,
- experience with Snowflake connectors (Python, Spark, Kafka, etc.),
- proficiency in automation and orchestration using tools like Informatica,
- working knowledge of PySpark and Databricks SQL for data engineering tasks,
- experience with Delta Lake and data lake house architecture,
- familiarity with Databricks notebooks, job scheduling, and cluster management,
- integration of Databricks with Snowflake for advanced analytics and ML workflows,
- basic understanding of MLflow, feature engineering, and data science collaboration,
- very good knowledge of English.
Our client offers:
- contract of Employment or a B2B contract,
- for the contract of employment: extensive benefits package - Multisport Card, Lux Med medical healthcare including dental care, life insurance, cafeteria benefits,
- hybrid work model,
- training and continuous learning and certification opportunities.
wszystkie oferty 977