Platform Architect : Databricks Job at PEOPLE FORCE CONSULTING INC, Remote

dFRnYkFKNW1FYXBUeWVaYTA2d29yS1UveWc9PQ==
  • PEOPLE FORCE CONSULTING INC
  • Remote

Job Description

Role - Platform Architect : Databricks

Location - KY / Remote Option possible

Tentative Duration - 6 months

Rate - All-invlusive


Deep understanding of Databricks architecture, including clusters, notebooks, jobs, and the underlying compute and storage layers
Experience building Databricks as a global platform across multiple regions
Proficiency in Apache Spark, including its core components (Spark SQL, Spark Streaming, and MLlib)
Knowledge of Delta Lake and its features (ACID transactions, time travel, etc.)
Experience in using Databricks SQL for data querying, analysis, and visualization
Ability to create and manage complex data pipelines and workflows using Databricks Jobs
Understanding of cluster configurations, autoscaling, and performance optimization
Unity Catalog experience
Deep understanding of AWS or Azure cloud essentials, including Storage, Networking, Identity and Access Management, and Data Security
Understanding of network configurations, VPCs, and security groups for Databricks deployments
Ability to analyze and optimize Databricks costs

Nice-to-haves
Certifications for any of the cloud services like Azure, AWS, or GCP
Experience working with code repositories and continuous integration pipelines using AWS code build/code pipelines or similar tools/technologies
Experience in data governance and lineage implementation
Multi-geo and distributed delivery experience in large programs.

Job Tags

Remote work,

Similar Jobs

Shannon Health

Registered Nurse/Licensed Vocational Nurse Job at Shannon Health

 ...patients served in the clinical areas noted below. Education Education Type Program of Study Required/Preferred High School Diploma or G.E.D. High School Required Accredited Program Registered Nurse (RN) Required Associates degree... 

UNITE HERE Local 75

Hospitality Union Organizing Internship Job at UNITE HERE Local 75

 ...UNITE HERE Local 75 Hospitality Union Organizing Internship Based in Toronto, Ontario, Canada UNITE HERE Local 75 is seeking Organizing Apprentices in the Greater Toronto Area to organize in the hospitality industry. We take on multi-national corporations... 

SummitStone Health Partners

Behavioral Health Technician - PRN Job at SummitStone Health Partners

 ...Behavioral Health Technician atGarcia House Salary Range: $24.04 - $28.85/hour, based on relevant years of experience Location: Fort Collins, Colorado at the Garcia House Status: PRN, On call as needed Employees working at locations operating 24/7 earn a... 

Rutherford County Government

Medicolegal Death Investigator (MDI) Job at Rutherford County Government

 ...seeking a highly motivated and detail-oriented Medicolegal Death Investigator to assist with the investigation of deaths reportable to the...  ...~ Voluntary insurance options (Short-Term Disability, Accident, Critical Illness, etc.)~ MDLive Telehealth access ~ Employee... 

Atlas Search

Investment Banking Associate Job at Atlas Search

 ...analyst resources Establish and maintain the respect and trust of clients Qualifications: Bachelors degree with 3+ years investment banking experience Understanding and knowledge of Consumer industry participants, performance drivers, trends and challenges...