Your expertise

Experience in building Data Processing pipeline using various ETL/ELT design patterns and methodologies to Azure data solution, building solutions using ADLSv2, Azure Data factory, Databricks, Python and PySpark.

Experience with at least one of the following technologies: Scala/Java or Python

Deep understanding of the software development craft, with focus on cloud based (Azure), event driven solutions and architectures, with key focus on Apache Spark batch and streaming, Datalakehouses using medallion architecture. Knowledge of DataMesh principles is added plus.

Ability to debug using tools Ganglia UI, expertise in Optimizing Spark Jobs

Experience in traditional data warehousing concepts (Kimball Methodology, Star Schema, SCD)/ETL tools (Azure Data factory, Informatica)

Experience in Datamodelling atleast one database technology such as: - Traditional RDBMS (MS SQL Server, Oracle, PostgreSQL) - NoSQL (MongoDB, Cassandra, Neo4J, CosmosDB, Gremlin)

Understanding of Information Security principles to ensure compliant handling and management of data

Ability to clearly communicate complex solutions.

Strong problem solving and analytical skills.

Working experience in Agile methodologies (SCRUM, Kanban)