Senior Data Engineer

You want more out of a career. A place to share your ideas freely - even if they're daring or different. Where the true you can learn, grow, and thrive. At Verizon, we power and empower how people live, work and play by connecting them to what brings them joy. We do what we love - driving innovation, creativity, and impact in the world. Our V Team is a community of people who anticipate, lead, and believe that listening is where learning begins. In crisis and in celebration, we come together - lifting our communities and building trust in how we show up, everywhere & always. Want in? Join the V Team Life.

As a part of our Big Data Product team, the Data Solutions Engineer will be responsible for developing and validating Big data products and applications which runs on the large Hadoop cluster and Cloud. The qualified engineer will be developing and testing ETL process, Migrating different applications to cloud , developing Data validation tools used for performing quality assessments and measurements on different data sets that feed data & AI products.

Building big data and batch/real-time analytical solutions that leverage emerging technologies.

• Performing data migration and conversion activities on different applications and platforms.

• Designing, developing and testing of data ingestion pipelines, perform end to end automation of ETL process for various datasets that are being ingested into the big data platform.

• Performing data profiling/analysis, discovery, analysis, suitability and coverage of data, and identifying the various data types, formats, and data quality issues which exist within a given data source.

• Developing transformation logic, interfaces and reports as needed to meet project requirements.

• Participating in discussion for technical architecture, data modeling and ETL standards, collaborate with Product Managers, Architects and Senior Developers to establish the physical application framework (e.g. libraries, modules, execution environments).

• Improving and performance-tuning the optimization of data pipelines.

• Developing unit and integrated automated test suites to validate end to end data pipeline flow, data transformation rules, and data integrity.

• Developing tools to measure the data quality and visualize the anomaly pattern in source and processed data.

• Integrating automated processes into continuous integration workflows.

• Contributing to data quality assurance standards and procedures.

You're curious about new technologies and the game-changing possibilities it creates. You like to stay up-to-date with the latest trends and apply your technical expertise to solve business problems. You thrive in a fast-paced, innovative environment working as a phenomenal teammate to drive the best results and business outcomes.

You'll need to have:

• Bachelor's degree or four or more years of work experience.

• Four or more years of relevant work experience.

• Programming experience in Scala, Java or Python

• Experience in data engineering, preferably in Google Cloud Platform with BigQuery

• Hands-on experience in designing, building, testing and deploying data pipelines in Teradata and Hadoop platform with experience in, HDFS, Hive, Spark, Streaming, HBase, Kafka, Oozie etc.

• Good organizational skills and strong written and verbal communication skills.

Even better if you have one or more of the following:

• Bachelor's degree in Computer Science or equivalent education/training

• Five or more years of Software development and Testing experience.

• Experience with development and automated testing in a CI/CD environment.

• Hands on experience in dashboard development using Looker/Tableau

• Knowledge of GIT/Jenkins and pipeline automation is a must.

• Experience with developing and testing real-time data-processing and Analytics Application Systems.

• Strong knowledge in SQL development on Database and/or BI/DW

• Strong knowledge in shell scripting Experience in Web Services - API development and testing.

• A solid understanding of common software development practices and tools.

• Strong analytical skills with a methodical approach to problem solving applied to the Big Data/AI domain.

• Experience with incident management tools (Opsgenie, PagerDuty etc) is a plus

If Verizon and this role sound like a fit for you, we encourage you to apply even if you don't meet every "even better" qualification listed above.

This role is eligible to be considered for the Department of Defense SkillBridge Program.

We're proud to be an equal opportunity employer - and celebrate our employees' differences, including race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, and Veteran status. At Verizon, we know that diversity makes us stronger. We are committed to a collaborative, inclusive environment that encourages authenticity and fosters a sense of belonging. We strive for everyone to feel valued, connected, and empowered to reach their potential and contribute their best. Check out our diversity and inclusion page to learn more.