EXPERT DATABRICKS

Description de la mission

EXPERT DATABRICKS

Contexte de la mission :

Le client recherche 1 profil ayant une forte expertise et un savoir-faire dans l’utilisation de Databricks pour la manipulation et l’organisation de grands ensembles de données.

COMPETENCES RECHERCHEES

Skill’s group

Skill’s description

Databricks & Python

Mastery of python / pyspark / spark programming for data science in databricks

Experience databricks premium environment (unity catalog, delta live tables, workflows)

Experience sql programming (in databricks premium environment)

Ability to analyze data descriptively and identify corrections to be made (missing values, outliers)

Microsoft AZURE Services

Mastery of Azure Data Factory data orchestration.

Experience with of DATA / AI Microsoft issues around onthers solutions : SQL Server, Azure For Data, Big Data, SQL Datawarehouse, Data Lake, HD Insight, Databrick, IA / ML.

Knowledge in ETL (datalake, deltalake, lakehouse),

Know how to use APIs (cognitive services or custom serverless development with Azure Function or Azure Web App) and API management

Experience in exploiting data in various format such as SQL, noSQL, parquet files, csv, external API…

Continuous Integration & Devops

Deployment & Automation – Terraform, Azure DevOps, ARM templates, Azure Pipelines, PowerShell etc.

Fluent with git / github

Additional Skills

Ability to work remotely using Agile methodologies (SCRUM)

Language skills

A good technical English is mandatory (all functional and technical specifications are in English)

Fluent French

VCS

Use of Git / Gitflow as a Versioning control system / Development workflow

Soft Skills

Autonomy and adaptability
Problem solving and critical thinking
High attention to detail
Top-notch communication skills
Continuous technology watch to stay on top of industry trends
Knowledge in the media / audiovisual field is a plus.