DevOps Engineer Job at Zenith services, San Antonio, TX

dCsyK3ZNUm5zMFpjMzNMNGlUU3BDdVh0NVE9PQ==
  • Zenith services
  • San Antonio, TX

Job Description

Job Title: DevOps Engineer (50% Kafka, 50% DevOps)
Location: San Antonio, USAA

Job Summary:
The DevOps Engineer will work with both Apache Kafka and DevOps tools to design, deploy, and manage real-time data streaming solutions, particularly using AWS services and Apache Flink. This role requires a deep understanding of Kafka, cloud infrastructure, and automation tools.

Key Skills & Expertise:

1.   AWS Managed Services:

◦ Proficiency with AWS services such as MSK (Managed Streaming for Kafka), Kinesis, Lambda, EC2, RDS, VPC, IAM, and more.

◦ Ability to manage infrastructure using CloudFormation or Terraform.

2.   Apache Flink:

◦ Expertise in Apache Flink for stream and batch data processing, including its integration with Kafka.

◦ Experience with managing Flink clusters on AWS (EC2, EKS, or managed services).

3.   Apache Kafka:

◦ In-depth knowledge of Kafka architecture, including brokers, topics, partitions, producers, and consumers.

◦ Experience with managing Kafka clusters (MSK or self-managed).

4.   DevOps & Automation:

◦ Experience with automating deployments and infrastructure using CI/CD tools (e.g., Jenkins, GitLab, GitHub Actions).

◦ Proficiency with Docker, Kubernetes, and cloud-based containerization.

5.   Programming & Scripting:

◦ Strong scripting skills in Python, Bash, or Go for automation and integration tasks.

6.   Monitoring & Performance Tuning:

◦ Knowledge of monitoring tools like CloudWatch, Prometheus, and Grafana.

◦ Expertise in optimizing data pipelines for performance and scalability.

Key Responsibilities:

1.   Infrastructure Design & Implementation:

◦ Design and deploy real-time data pipelines using Apache Flink and Kafka on AWS, ensuring scalability and fault tolerance.

2.   Platform Management:

◦ Manage and optimize Kafka clusters and Flink jobs for performance and scaling on AWS.

3.   Automation & CI/CD:

◦ Automate infrastructure provisioning and monitoring using Terraform, CloudFormation, and other tools.

4.   Collaboration:

◦ Work closely with Data Engineers, Data Scientists, and DevOps teams for smooth integration of data systems.

5.   Security & Compliance:

◦ Implement security for Kafka and Flink clusters, including encryption and access controls.

6.   Optimization & Troubleshooting:

◦ Optimize Kafka and Flink deployments for performance, troubleshoot issues, and ensure reliability

Job Tags

Similar Jobs

Northeast Healthcare Recruitment, Inc.

Med Spa Director Job at Northeast Healthcare Recruitment, Inc.

 ...incredibly proud of our reputation for stellar service and phenomenalpatient care.We are seeking anexperienced and driven Med Spa Director to lead our high-performing aestheticteam. This role blends clinical insight, operational excellence, and strategicleadership... 

24 Seven Talent

Sample Sewer Job at 24 Seven Talent

 ...efficiently according to specifications. Collaborate with the design and production teams to meet project deadlines. Maintain sewing equipment and workspace in a clean and organized manner. Follow safety and quality standards while working onsite.... 

Pride Health

Ultrasound Technician Job at Pride Health

 ...Job Title: Sonographer (Ultrasound) Location: Brooklyn, New York Start Date: December 1, 2025 End Date: January 28, 2026 Shift: 5x8 Days (8-hour shifts, MondayFriday) Compensation: $2,550 per week Position Overview: We are seeking a skilled and... 

300 SECOND AVE

Med Tech Blood Bank Job at 300 SECOND AVE

 ...Job Title: Med Tech Blood Bank Location: Monmouth Medical Center Department Name: Lab MMC Req #: 0000226568 Status: Hourly Shift: Evening Pay Range: $37.37 - $49.00 per hour Pay Transparency: The above reflects the anticipated hourly wage range... 

Danville Services

LPN/RN/Nurse - FT, PT & PRN Job at Danville Services

 ...Job description: Why work at Danville Services of Arizona? There are a LOT of reasons...  ...and know the people you are helping. 5. A home atmosphere. You will be working in the...  ...Experience RN Degree (AD, BSN or MSN) or LPN from an accredited school of nursing Minimum...