Job

Technical Lead - Data Platform Services– Databricks

Experience:10+
Location:Remote
Type:full-time

Job Description

Responsibilities

• Providing technical guidance to team

• Team management / shift management / Skill management

• Daily Governance to ensure smooth operation

• Identify areas where technical solutions will improve business experience

• Identify Automation opportunities for smother operation

• Validation of new Releases / Change Requests and suggest improvement / Controls for smooth deployment

• Understanding new requirements / Use case from operation point of view

• Lead troubleshooting call / solution discussion calls with other stakeholders

• Lead handover / B2O discussion and put operational control

• Identify failure scenario and alert configuration

• Improve operational processes using ITIL frameworks (incident, problem, change mgmt).

• Create Dashboards and Charts as per operational requirements.

• Ensure Security and compliance related tasks

• Training new resources on technologies / process in use

Skills -

• 12–15 years of experience in Big Data / Cloud Data Platform Support.

• SME of Databricks platform (clusters, jobs, repos, MLflow, warehouse)

• Deep expertise in Databricks architecture and Azure Cloud Platform

• Expertise in UNIX, SQL, Shell Scripting.

• Expertise in Spark UI & job debugging

• Strong skill in CI/CD pipelines (Azure DevOps)

• Strong skill of Apache Spark

Want to stay in our pipeline?

Pre-register to join the waitlist so we can notify you as soon as aligned roles and assessments go live.