Data Engineer II

AWS Data Engineer II
Charlotte, NC - Hybrid/local candidates

Core Technical Skills:
- 2+ years of AWS experience
- AWS services: S3, EMR, Glue Jobs, Lambda, Athena, CloudTrail, SNS, SQS, CloudWatch, Step Functions
- Experience with Kafka, preferably Confluent Kafka
- Experience with Lake Formation,Amazon Redshift and Amazon Athena
- Strong SQL and data modeling skills, executing ETL processes tailored for data warehousing
- Competence in developing and refining data pipelines within AWS
- Extensive understanding of database management fundamentals
- Tools and Languages: Python (good experience in Pyspark) , SQL
- Infrastructure as Code technology: Terraform
- DevOps pipeline (CI/CD): GitHub
- Deep knowledge of IAM roles and Policies
- Experience with AWS workflow orchestration tool like Airflow or Step Functions

Core Responsibilities:
- Where applicable, collaborate with Lead Developers (Data Engineer, Software Engineer, Data Scientist, Technical Test Lead) to understand requirements/use cases to outline technical scope and deliver the technical solution
- Collaborate with Data and Solution architects on key technical decisions
- Skilled in developing data pipelines, focusing on long-term reliability and maintaining high data quality
- Design data warehousing solutions with the end-user in mind, ensuring ease of use without compromising on performance
- Manage and resolve issues in production data warehouse environments on AWS

Core Experience and Abilities:
- Ability to perform hands-on development and peer review for certain components/tech stack on the product
- Standing up of development instances and migration path (with required security, access/roles)
- Develop components and related processes (e.g., data pipelines and associated ETL processes, workflows)
- Ability to build new data pipelines, identify existing data gaps, and provide automated solutions to deliver analytical capabilities and enriched data to applications
- Ability to implement data pipelines with the right attentiveness to durability and data quality
- Implement data warehousing products thinking of the end user's experience (ease of use with the right performance)

Dexian stands at the forefront of Talent + Technology solutions with a presence spanning more than 70 locations worldwide and a team exceeding 10,000 professionals. As one of the largest technology and professional staffing companies and one of the largest minority-owned staffing companies in the United States, Dexian combines over 30 years of industry expertise with cutting-edge technologies to deliver comprehensive global services and support.

Dexian connects the right talent and the right technology with the right organizations to deliver trajectory-changing results that help everyone achieve their ambitions and goals.To learn more, please visit https://dexian.com/.

Dexian is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.