Cloud Platform Engineer Jobs in USA with Visa Sponsorship

Company Overview:

Req ID: 368040

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.

We are currently seeking a Sys. Integration Sr. Specialist Advisor to join our team in Plano, Texas (US-TX), United States (US).

Job Description:

Job Summary

We are seeking a highly skilled Cloudera Public Cloud Platform Engineer to operate and manage the end-to-end CDP platform ecosystem, including data services, NiFI, Kafka, AI/ML platforms, and enterprise observability.

This role is responsible for ensuring availability, scalability, security, and performance of all platform services supporting data, analytics, and AI workloads across environments.

The ideal candidate brings strong expertise in CDP on-prem, public cloud services, cloud infrastructure, Kubernetes-based runtime environments, and platform observability, supporting high-concurrency, mission-critical workloads at multi-terabyte to petabyte scale.

This role is critical to ensuring uninterrupted operation of data, analytics, and AI platforms; any degradation directly impacts downstream business reporting, data pipelines, and model execution.

Key Responsibilities

CDP Platform & Multi-Service Operations

• Own end-to-end operational responsibility for Cloudera Public Cloud services across Dev / Stage / UAT / Prod:
  CDE, CDW, COD, CDL, CDF (NiFi), CDV, CAI, Kafka
• Ensure multi-cluster stability, workload isolation, and SLA adherence
• Support onboarding and operations of multiple applications across environments
• Manage and support multi-environment, multi-cluster deployments with strict isolation, governance, and release coordination across Dev/UAT/Prod

AI/ML Platform Operations

Operate and support Cloudera AI (CAI) environments:

- AI Workbenches, AI Studios
- Model training and development environments
- AI inference endpoints and model serving

Troubleshoot:

- Resource contention (CPU/GPU)
- Model deployment/runtime failures

CDP Runtime & Kubernetes-Aware Operations

• Operate CDP services running on Cloudera-managed Kubernetes infrastructure
• Apply strong understanding of containerized workloads and Kubernetes concepts for troubleshooting

Diagnose and resolve:

- Pod failures, restarts, and resource contention
- Spark job failures in containerized environments (CDE)
- Service-to-service communication issues
- Analyze logs and metrics to identify runtime failures and performance issues
- Collaborate with Cloudera support for managed service-level issues

Data Integration & Platform Services

Operate and support:

- CDF (NiFi) for ingestion pipelines
- CDV (Data Visualization) for reporting workloads
- Octopai for data lineage and catalog integration
- Ensure reliability and performance of data pipelines and integrations

Monitor and troubleshoot Kafka environments:

- Topic configurations, partitions, and replication
- Consumer lag and throughput issues
- Broker connectivity and performance bottlenecks

Security, Governance & SDX Administration

Implement and manage:

- Kerberos, TLS/SSL, Ranger policies

Administer SDX for:

- Centralized security
- Metadata and policy enforcement
- Support Atlas and Octopai integration
- Manage and troubleshoot user access and identity mapping across layers, including:
- Cloud IAM roles and permissions
- CDP users/groups and identity providers
- Ranger policies for fine-grained data access

Resolve access-related issues impacting:

- Data access (S3/ADLS)
- Query execution (CDW/CDE)
- Application and service-level permissions

Cloud Infrastructure & Networking

Troubleshoot:

- S3 / ADLS storage issues
- IAM roles and permissions
- VPC, subnets, routing, security groups
- Bastion host access and connectivity
- Ensure secure and reliable connectivity across services
- Understand and troubleshoot S3-based data lake patterns, including:
- Bucket structure, prefix design, and access patterns
- Performance issues related to small files, request rates, and throughput limits
- Encryption (SSE-S3, SSE-KMS) and access policies
- Manage and troubleshoot cross-account IAM roles and access patterns for CDP environments

Ensure secure access between:

- CDP environments and cloud resources
- Multiple AWS accounts (dev/prod separation)

Disaster Recovery & Resiliency

• Support and validate disaster recovery and failover strategies across CDP environments
• Ensure backup, recovery, and environment resiliency for critical workloads
• Participate in DR drills and recovery validation

Observability, Monitoring & Alerting (Critical)

Implement and manage end-to-end observability:

- Metrics, logs, and alerting

Use:

- Cloudera observability, Cloudera Manager, Prometheus, Grafana

Monitor:

- Cluster health
- Workload performance
- AI inference endpoints
- Enable proactive issue detection and prevention
- Define and implement SLIs/SLOs and alerting thresholds to ensure platform reliability and performance
- Support high-severity (P1/P2) incident response, triage, and resolution within defined SLAs

Operational Support & On-Call

• Participate in on-call rotation to support 24/7 platform operations
• Respond to production incidents, alerts, and service disruptions within defined SLAs
• Handle P1/P2 incidents, including triage, troubleshooting, and resolution
• Perform root cause analysis (RCA) and implement preventive measures

Upgrades, Patching & Platform Lifecycle

Execute:

- CDP upgrades and version management
- Security patches and hotfixes

Perform:

- Rolling upgrades
- Validation and rollback strategies

Performance Optimization & Cost Efficiency

Optimize:

- Platform-level performance (Spark, Hive, Impala workloads)
- Cluster utilization and workload distribution

Drive:

- Autoscaling strategies
- Cost optimization (FinOps practices)

Automation & Operational Excellence

Utilize and support existing automation frameworks for:

- Platform provisioning
- Monitoring and alerting
- Routine operational tasks
- Work with infrastructure teams that manage Infrastructure-as-Code (Terraform) for environment setup and changes

Leverage scripting (Python / Shell) for:

- Operational support
- Task automation
- Troubleshooting and diagnostics
- Maintain and follow runbooks, SOPs, and operational procedures to ensure consistent platform operations

Required Skills

Strong experience with Cloudera CDP Public Cloud

Expertise in:

- Cloud platforms (AWS/Azure/GCP)
- Kubernetes concepts (troubleshooting-focused)

Hands-on with:

- CDE, CDW, CDF (NiFi), CAI

Knowledge of:

- IAM, networking, observability tools
- Platforms operating at multi-terabyte to petabyte scale with high concurrency workloads

Hands-on experience with:

- Kafka (or similar streaming platforms) including monitoring, troubleshooting, and performance tuning

Experience with Cloudera CDP CLI (Command Line Interface) for:

- Platform operations and administration
- Job execution and service management (CDE/CDW/CDL)
- Automation of routine operational tasks

Strong working knowledge of:

- Cloud IAM (AWS IAM / Azure AD) including roles, policies, and cross-service access
- User and group mapping across CDP, cloud IAM, and Ranger policies
- Troubleshooting access issues across storage (S3/ADLS), CDP services, and data access layers

Preferred Skills

Experience with:

- Modernization of legacy data platforms/applications to Cloudera CDP Public Cloud
- Migration and onboarding of workloads to CDE, CDW, and CAI environments
- Supporting hybrid or multi-environment transitions (on-prem cloud)

Familiarity with:

- Cloud platforms (AWS, Azure, GCP) including storage, IAM, and networking concepts
- Kubernetes-based runtime environments (troubleshooting-focused)
- Strong scripting and automation skills (Python, Shell, Terraform) for platform operations

What You ll Work On

Enterprise-scale Cloudera CDP platform supporting data engineering, analytics, and AI workloads across multiple applications

Modernization of legacy platforms and applications into cloud-native CDP services

Operational support and scaling of:

- Data services (CDE, CDW, CDF, CDL)
- AI/ML platforms (CAI, inference, workbenches)
- Platform performance optimization, observability, and reliability engineering for mission-critical workloads

About NTT DATA:

NTT DATA is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure and connectivity. We are one of the leading providers of digital and AI infrastructure in the world. NTT DATA is a part of NTT Group, which invests over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future.

NTT DATA endeavors to make https://us.nttdata.com accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at https://us.nttdata.com/en/contact-us. This contact information is for accommodation requests only and cannot be used to inquire about the status of applications.

NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. For our EEO Policy Statement, please click here. If you d like more information on your EEO rights under the law, please click here. For Pay Transparency information, please click here.