Databricks Platform Engineer(Remote)(12+ Years)


Position:Databricks Platform Engineer
Location:Bloomington,IL ( 90% offsite, 10% onsite)
Duration:Long term

Job Description:

** Do not submit profiles limited to traditional ETL tools, basic SQL development, or AWS Glue without meaningful hands-on Databricks and Spark experience.

Databricks Platform Engineer: Must-Have Skills
6+ years of cloud platform or data infrastructure engineering experience, including 2+ years of production Databricks experience.
Strong hands-on experience designing and administering Databricks workspaces on AWS.
Deep AWS infrastructure experience with VPC, IAM roles and policies, cross-account access, SCPs, S3, KMS, Secrets Manager, and CloudTrail.
Strong Terraform experience, specifically with the Databricks Terraform provider.
Hands-on expertise with Unity Catalog administration, including metastore configuration, catalog and schema ownership, storage credentials, external locations, privilege management, and RBAC.
Experience implementing column-level masking, row-level security, dynamic views, lineage, and audit logging.
Strong knowledge of private networking, including AWS PrivateLink, VPC peering, transit gateways, security groups, NACLs, and no-public-IP configurations.
Hands-on experience defining Databricks cluster policies, instance pools, job clusters, autoscaling, Photon, runtime standards, and cost controls.
Experience with Databricks Workflows, system tables, CLI, SDK, Repos, and Git integration.
Strong CI/CD experience using GitHub Actions, Azure DevOps, or equivalent for Databricks deployments.
Experience implementing platform monitoring, cost attribution, and observability using Databricks system tables, Datadog, Grafana, or equivalent tools.
Ability to create platform architecture documentation, operational runbooks, onboarding standards, and production support procedures.
Profiles should demonstrate all the following:

Production Databricks platform administration on AWS
Unity Catalog implementation and administration
Terraform-based Databricks provisioning
AWS networking and cross-account IAM experience
Databricks security, governance, cluster policies, and cost controls
CI/CD automation for Databricks platform resources
Thanks,
Ganesh R
Jupiter Consulting Services
MWBE Certified Company
16024 Manchester Road, Suite 262, St. Louis, MO 63011.
Email
Jupiter Consulting Services, LLC is an Equal Opportunity Employer (EOE).
Back to blog

Other Jobs To Apply

Remote Video Editor: Social-first Storytelling Pro

Media Operations Specialist, NBC & Telemundo Dallas/Fort Worth

Senior Editor, The Free Press

Strategy & Engagement Manager, Risk & Resilience (RapidScale) (Remote)

Clinical Research Associate Manager (Remote)

Principal Specialist, Supplier Quality & Development - Electronics (Remote)

Strategic Advertising Sales Executive (Hybrid) Job at PayPal in New York

Associate Producer, Manifold

EMEA Insights Lead, Consumer and Commercial Strategy

Brand & Presentation Designer - Canva Pro, Remote

Billing Operations Analyst 1

Director, Platform Architecture

Entry-Level BDR: CRE Advertising & Events, Hybrid Role

Remote Retention Marketing Manager, DTC eCommerce

Aurora Tour Guide & Photographer Job at Borealis Basecamp in Fairbanks

Group Underwriter Senior – Anthem Balanced Funding job at Elevance Health in Atlanta, GA, Iselin, NJ, Costa Mesa, CA, Tampa, FL, Indianapolis, IN, Wilmington, DE, Cincinnati, OH, Denver, CO, Mendota Heights, MN, Grand Prairie, TX, Chicago, IL

Enablement Partner

Product Manager Fraud

Crypto Product Compliance Lead

Staff Researcher, Payment Experiences & Pricing

X (Twitter) Account Manager, Content Creator & reputed company Specialist

Engineering Manager - Music at Spotify: 100% Remote (NY)

Remote Operations Center Specialist (Live Sports & Entertainment)

Inbound Sales Call Center Representative

Sales Order Support Operations Specialist (Remote)

Verizon FIOS Sales Agent

Biostatistician 1

Public Health Officer at Royal Caribbean Cruises, Inc. Miami, FL

Senior Account Executive, DSP

Heavy Duty Fleet Maintenance Trainer

Remote Senior EDI Platforms Administrator

Sr. Digital Products & Innovation Analyst

Remote Lead: Commercial Analytics & Pricing Insights

REMOTE - Fedex Freight Broker

Hiring Subsurface Data Analyst in Anchorage, Alaska

Technology Service Operations Engineer

Remote CDI Documentation Specialist (Flexible Hours)

Global Cash Repatriation Specialist (Hybrid/Remote)

Commercial & Land Deals Advisor

Domino's Delivery Driver (05752)

General Manager (09665) - 661 NW 32nd St

International Food Safety and Quality Assurance Manager

Assistant/Department Manager- From $18 up to 24$ per hour

Principal Engineer, Identity & Authorization

Coca-Cola Data Entry Clerk (Remote)

Executive Assistant / Operations Manager — Remote

[Remote] Senior Principal Scientist, Regulatory Liaison

Medical Representative, Gastro of Immunology - Remote

[Remote] Sr. Security Data Engineer, Vulnerability Risk Management

Common Interview Questions And Answers

1. HOW DO YOU PLAN YOUR DAY?

This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

5. HOW DO YOU PROCESS INFORMATION?

Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

8. HOW TO PRIORITIZE WORK?

The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...