New
Batch Automation
Tata Consultancy Services | |
$100,000 - $135,000
| |
United States, Texas, Irving | |
Oct 28, 2026 | |
|
Job Description
Roles & Responsibilities * Automate and optimize batch workflows using robust Shell scripting and file-processing techniques. * Manage secure file transfers using NDM (Connect: Direct) and SFTP, including monitoring, troubleshooting, and operational support. * Develop scalable PySpark ETL pipelines, ensuring high performance and reliability for large-scale data processing. * Implement automation and configuration management using Ansible, following Infrastructure as best practices. * Collaborate with cross-functional teams to ensure secure, reliable, and compliant data-movement operations. Required Skills: Shell Scripting: Strong scripting and file-processing expertise for batch automation and workflow optimization. PySpark: Hands-on experience developing scalable, high-performance, and reliable ETL pipelines for large-scale datasets. NDM (Connect: Direct): Experience managing secure enterprise file transfers, monitoring transfer jobs, and troubleshooting failures. SFTP: Strong knowledge of secure file-transfer operations, controls, monitoring, and issue resolution, Experience implementing automation and configuration management using Infrastructure as Code practices. Operational Excellence: Ability to support secure, reliable, and compliant data movement in collaboration with cross-functional teams.
Salary Range: $100,000 to $135,000 per year
Location
Irving, TX
Function
TECHNOLOGY
Role
Engineer
ID
433321
Skills
Core JAVA
Salary Range
$100,000 - $135,000 Desired Candidate Profile
Qualifications BACHELOR OF COMPUTER SCIENCE | |
$100,000 - $135,000
Oct 28, 2026