Databricks Platform Architect Job at ClifyX, INC, New York, NY

  • ClifyX, INC
  • New York, NY

Job Description

Job Description

Job Description

Key Responsibilities
Platform Engineering & Architecture
" Design, implement, and maintain Databricks platform architecture to support enterprise-scale data workloads
" Establish best practices for workspace setup, cluster management, and job orchestration
" Optimize platform performance, scalability, and cost efficiency
" Define and enforce standards for data engineering and analytics workloads within Databricks
Developer Enablement
" Support development teams by providing guidance, documentation, and reusable frameworks
" Enable developers with CI/CD pipelines, automation, and deployment standards
" Troubleshoot and resolve platform-related issues impacting development teams
" Provide technical mentorship and onboarding support to engineers using Databricks
Governance, Security & Compliance
" Implement and manage data governance, access controls, and security models (Unity Catalog, RBAC, etc.)
" Ensure compliance with enterprise data policies and regulatory requirements
" Monitor and audit platform usage, access patterns, and data lineage
Integration & Ecosystem Management
" Integrate Databricks with cloud platforms (AWS/Azure/GCP), data lakes, and enterprise systems
" Manage connectivity with tools such as Power BI, APIs, data ingestion frameworks, and orchestration tools
" Support ingestion and processing frameworks (e.g., batch, streaming, Delta Lake)
Operational Excellence
" Monitor platform health, performance, and usage metrics
" Implement automation for provisioning, monitoring, and scaling
" Drive continuous improvements in platform reliability and developer experience

Required Qualifications

  • Bachelor's degree in Computer Science, Engineering, or related field (or equivalent experience)
  • 5 years of experience in data engineering or platform engineering roles
  • 3 years of hands-on experience with Databricks (architecture, administration, or platform engineering)
  • Strong understanding of distributed data processing (Spark)
  • Experience with cloud platforms (Azure preferred, or AWS/GCP)
  • Knowledge of data lake architecture, Delta Lake, and modern data platforms
  • Experience implementing security, governance, and access control frameworks
  • Familiarity with CI/CD pipelines, DevOps practices, and infrastructure as code (Terraform, etc.)

Job Tags

Similar Jobs

Sky Transportation

Now Hiring: Solo & Team OTR CDL-A Drivers | Sky Transportation Job at Sky Transportation

 ...referred Home Time: 6-7 days out / 34-48 hours home Equipment: 2022-and-newer trucks, 68 MPH governed, assigned to you Requirements: ~ Class A CDL ~1+ year verifiable OTR experience within the last 10 years Apply now Sky Transportation is hiring.... 

Soliant

Travel Federal Outpatient Clinical Pharmacist - Cameron, AZ Job at Soliant

 ...Job Description Job Description Doctor of Pharmacy (PharmD) degree, active Pharmacist license, and minimum 1+ years Pharmacist experience required. Applicants who do not meet these qualifications will not be considered. This travel opportunity is ideal for experienced... 

Phyton Talent Advisors

Human Resources Assistant Job at Phyton Talent Advisors

 ...Our client a well known Investment Bank is seeking a Human Resources Assistant in their New York, New York Location! Event Management: Create and maintain calendar invitations and update and track global participation for ~100 annual events & initiatives. Support event... 

LA County Department of Medical Examiner

FORENSIC TECHNICIAN I Job at LA County Department of Medical Examiner

 ...experience handling, transporting, and preparing deceased persons for post-mortem examinations and subsequent release at the level of Forensic Attendant**.Option IiAn Associate of Science (A.S.) Degree***, or higher, in Mortuary Science.LicenseA valid California Class... 

We Are Legal Revolution

Attorney - Commercial Litigation - Manhattan, NY - $250k Job at We Are Legal Revolution

 ...Job Description Commercial Litigation Attorney | Manhattan, NY (Hybrid) $250K \n \n Location/Schedule: Manhattan, NY (Hybrid)...  ...Base Salary: $250K \n Practice : Commercial litigation. Contract disputes, business torts, and related civil matters in New York...