Databricks Architect Job at Expert In Recruitment Solutions, New York, NY

  • Expert In Recruitment Solutions
  • New York, NY

Job Description

Job Description

Job Description

Our client is seeking an experienced Databricks Platform Architect to design, deploy, configure, and secure enterprise Databricks environments on AWS. This role is primarily focused on Databricks platform architecture, Infrastructure-as-Code (Terraform), and enterprise platform engineering. Strong AWS networking expertise is beneficial but is not the primary focus of the role.

Responsibilities & Qualifications
  • Design, configure, deploy, and secure Databricks platforms on AWS , including both Classic and Serverless Workspaces
  • Architect enterprise Databricks environments, including workspace configuration, identity integration, cluster policies, secret management, and platform governance
  • Author and maintain Terraform modules to provision and manage Databricks and AWS infrastructure using Infrastructure-as-Code (IaC)
  • Implement secure platform architecture, including workspace isolation, IAM/SSO integration, cluster access controls, secret scopes, and secure connectivity patterns
  • Partner with cloud, security, and platform engineering teams to design, validate, and deploy scalable Databricks solutions
  • Produce architecture documentation, diagrams, standards, and operational runbooks
  • Provide technical leadership, architecture guidance, and best practices for enterprise Databricks platform deployments
Required Skills
  • 10 years of experience in Cloud Platform Engineering, Data Platform Architecture, Infrastructure Engineering, or similar roles
  • Deep hands-on experience with Databricks Platform Architecture , including deployment, configuration, security, and administration
  • Experience designing and supporting both Classic and Serverless Databricks Workspaces
  • Strong experience with Terraform and Infrastructure-as-Code (IaC)
  • Experience with Databricks platform security, including:
    • Workspace architecture
    • Identity & SSO integration
    • IAM integration
    • Cluster policies
    • Secret management / Secret Scopes
    • Workspace isolation and governance
  • Working knowledge of AWS infrastructure, including IAM, VPC, S3, PrivateLink, networking, routing, and identity integration required to deploy and support Databricks environments
  • Strong troubleshooting, architecture, and technical documentation skills
  • Excellent communication skills with the ability to work directly with customers, architects, and cross-functional engineering teams
Nice to Have
  • Advanced AWS networking experience (VPC design, PrivateLink, Security Groups, NACLs, routing, etc.)
  • Experience with Databricks security accreditation, governance, and compliance initiatives
  • Experience building reusable Terraform modules and enterprise platform automation
  • Experience leading architecture workshops and customer enablement sessions

Job Tags

Similar Jobs

DF Young

Ocean Freight Coordinator Job at DF Young

 ...achieved and maintained in accordance with client requirements and company objectives. Essential Duties and Responsibilities Arranges transport of cargo with required carriers, vendors, trucking companies, warehouses, packing facilities, or other applicable parties... 

The Cheesecake Factory Incorporated

Oven Operator Job at The Cheesecake Factory Incorporated

 ...since 2014! What you may not know is at The Cheesecake Factory Bakery, our staff members are our highest quality ingredient.As an Oven Operator at The Cheesecake Factory Bakery, you will play a crucial role in the production of our delicious cheesecakes and other baked... 

Merx Global, Inc

Truck Dispatcher Job at Merx Global, Inc

 ...no fire drills, just clean execution on a team that doesn't tolerate dead weight. About Merx Global We're a 22-year-old trucking company built on high safety standards and legal, disciplined operations. We run a modern process with modern systems, no duct-tape workflows... 

National Grid USA

Mechanic B Job at National Grid USA

 ...round basis, after an injury and for reasonable cause. Valid Drivers License required with a safe driving history that meets National Grids Safe Driver policy Pass Field Assessment Test More Information Pay rate: $36.50 an hour Location:... 

URBN

Nuuly Graphic Design Intern Job at URBN

Nuuly is looking for a Graphic Design Intern to join us for the summer. This intern will embed with our creative team, supporting design...  ...modern rental brand builds and sustains its visual identity. About the Summer Internship Program: Each summer, URBN Inc. welcomes...