Required skills
Job description
Project overview
Job Summary
We are seeking a highly skilled Data Engineer to design, develop, and optimize scalable data pipelines that process large volumes of data. The ideal candidate will have deep expertise in Python, PySpark, AWS Glue, and Amazon EMR, along with experience implementing data quality and lineage frameworks to ensure data integrity across enterprise data platforms.
Required Qualifications
Preferred Qualifications
Job Facts: Contract W2 | 6 Months | No Travel Required | Hybrid | Depends on Experience
Skills: Python, PySpark, PostgreSQL, Data Quality, Data Engineering, Amazon S3, Amazon Kinesis, Continuous Integration, Continuous Delivery, AWS Glue, Amazon Web Services
Reference: Dice Id: RTL61687 | Position Id: 9125139
- 5+ years of Data Engineering experience.
- Expert-level proficiency in Python and PySpark.
- Strong hands-on experience with AWS Glue and Amazon EMR.
- Experience building and supporting large-scale data pipelines (terabyte-scale preferred).
- Strong knowledge of Amazon S3 Data Lakes.
- Experience with Data Quality and Data Lineage implementations.
- Strong experience with PostgreSQL, MySQL, or AWS RDS.
- Excellent problem-solving and performance-tuning skills.
- Experience in the Financial Services industry.
- Hands-on experience with Kafka or AWS Kinesis for real-time data processing.
- Knowledge of CI/CD pipelines for data engineering workflows.
- Experience with Infrastructure as Code (IaC) tools such as Terraform or CloudFormation.
- Familiarity with Agile development methodologies.
Project details
- Start: flexible
- Duration: 6 Months
- Remote: hybrid
- Location: McLean, VA, US, US
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on Dice