Jobs›Cloud Infrastructure

Cloud Infrastructure & Platform Specialist (Databricks + AWS + Azure) (Mid-Level

Irth · Work from home
Work from home
PayPay not listed
WhereWork from home
TypeFull timeMid-level
Posted13 Sep22 days ago, via Himalayas
Skills they list9 named
Cloud InfrastructurePlatform EngineeringDatabricks AdministrationCloud AdministrationDevOpsMid Level Cloud EngineerInfrastructure Cloud EngineerCloud Infrastructure EngineerCloud Infrastructure Specialist
About this job

About Irth Solutions

Irth Solutions is a leading provider of cloud-based SaaS software for damage prevention, asset integrity, stakeholder engagement and land management, helping energy, utility, telecom, and infrastructure companies protect their critical network infrastructure. With nearly three decades of industry experience, Irth serves customers across North America and continues to expand its platform with new data-driven and AI-powered capabilities.

Cloud Infrastructure & Platform Specialist – Insights (AI/ML)

Location
Remote – India
Department
Insights (AI/ML) – Platform Engineering
Reports to
Data Platform & Analytics Manager
Experience
3–5 years

About the Role

Irth is building a governed, multi-cloud data estate on Databricks to power cross-product insights across Damage Prevention, Asset Integrity Pipeline, Land Management, and Stakeholder Management.

We are looking for a Cloud Infrastructure & Platform Specialist to own and operate the underlying cloud and Databricks infrastructure that enables our Data Engineering, Data Science, and MLOps teams to build and deliver data and AI solutions.

You will be the go-to engineer for infrastructure provisioning, identity and access management, Databricks administration, networking, security, and platform onboarding. You will help provision workspaces and catalogs, manage IAM roles and administrative access, establish secure platform guardrails, and resolve infrastructure bottlenecks so engineering teams can onboard and ship efficiently.

This role is ideal for a mid-level cloud/platform engineer who enjoys solving infrastructure problems, automating repetitive tasks, and serving as the technical enabler for other engineering teams.

Key Responsibilities

Cloud Infrastructure Provisioning & Management

Provision, configure, and manage core cloud infrastructure across AWS and Azure supporting Irth’s Databricks-based data estate.

Manage infrastructure components including

VPCs / VNets

Subnets

Route tables and network connectivity

S3 buckets / Azure Storage Accounts

Compute resources

Private endpoints and related networking services

Establish and maintain secure DEV, QA, and PROD environments with appropriate isolation and platform guardrails.

Support cloud landing-zone implementation and ensure environments follow established security, governance, and cost policies.

Use Infrastructure-as-Code (IaC) technologies such as

Terraform

Azure ARM/Bicep

AWS CloudFormation

Version, review, test, and deploy infrastructure changes through controlled engineering workflows.

Troubleshoot infrastructure, networking, and cloud-service issues affecting data and ML workloads.

Identity & Access Management (IAM)

Provision and manage IAM roles, service principals, managed identities, groups, and access policies across AWS, Azure, and Databricks.

Implement least-privilege access and role-based access control (RBAC) aligned with enterprise security standards.

Configure and support identity federation and automated identity lifecycle management using technologies such as

SSO

SCIM

SAML

OAuth

Manage access across cloud resources, Databricks workspaces, Unity Catalog, storage, compute, and other platform services.

Review and process elevated or administrative access requests through controlled and auditable procedures.

Balance engineering-team productivity with security, compliance, and least-privilege requirements.

Participate in periodic access reviews and remediation of excessive or inappropriate permissions.

  • Databricks Platform Administration & Team Onboarding

Create, configure, and administer Databricks workspaces and associated platform resources.

Configure and manage Unity Catalog metastores, catalogs, schemas, storage credentials, external locations, and permissions.

Support onboarding of Data Engineering, Data Science, and MLOps projects by establishing the appropriate platform resources and access.

Troubleshoot onboarding blockers, including

Missing administrative privileges

Cluster-policy conflicts

Workspace configuration issues

Catalog and schema permission problems

Storage-access failures

Identity and authentication issues

Define and maintain Databricks cluster policies to control compute configurations, security, and cost.

Configure instance profiles, managed identities, storage credentials, and other mechanisms required for secure data access.

Establish workspace-level guardrails for compute, networking, storage, and user access.

Partner with Data Engineering, Data Science, and MLOps teams to ensure new projects can be onboarded efficiently with the appropriate catalogs, schemas, permissions, and infrastructure already available.

Act as the primary escalation point for Databricks platform and infrastructure issues.

Security, Networking & Compliance

Implement secure private connectivity between Databricks, cloud services, and enterprise resources.

Configure and troubleshoot technologies such as

AWS PrivateLink / VPC endpoints

Azure Private Link / private endpoints

VNet/VPC peering

Secure cluster connectivity

Network security groups and firewall controls

Egress restrictions

Implement encryption and key-management practices using

AWS KMS

AWS Secrets Manager

Azure Key Vault

Equivalent enterprise security services

Establish appropriate network segmentation and isolation between environments.

Support security reviews and enterprise compliance requirements.

Maintain audit logging and provide evidence for

Access reviews

Administrative activity

Infrastructure changes

Data access

Retention controls

Security and governance reviews

Help ensure infrastructure and platform configurations align with applicable regulatory and organizational requirements.

Cost Management, Automation & Operations

Implement and enforce cloud and Databricks tagging standards across infrastructure and workloads.

Monitor infrastructure and Databricks spend and identify opportunities for cost optimiz

Never pay to get work. If a listing asks for a fee, it is a scam. The ten signs →

Apply on Himalayas
Opens himalayas.app in a new tab