Required skills
- Java
- Python
- Apache Spark
- Amazon Web Services
- Data Lakehouse Architecture
- ETL/ELT Development
- Apache Parquet
- Apache Avro
- Data Modeling
- Data Quality
- Data Governance
- Data Lineage
Languages: English
Job description
Location: Columbus, OH Salary: $70.00 USD Hourly - $80.00 USD Hourly Description: Lead Data Engineer - Bachelor's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience. - 10+ years of experience in software engineering with significant focus on data engineering and distributed systems. - Strong programming
Project details
Columbus, OH Salary: $70.00 USD Hourly - $80.00 USD Hourly Description: Lead Data Engineer
Preferred Qualifications
Required Technical Skills
Programming Languages
Cloud & Platform
Big Data Technologies
Data Engineering
Software Engineering
AI & Automation
Medical, dental, and vision insurance are available to qualified candidates who meet eligibility requirements.
By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively "Judge") to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.
Contact:
This job and many more are available through The Judge Group. Please apply with us today!
Job Facts: Contract Independent | On-site | USD $70.00 - 80.00 per hour
Skills: Computer Science, FOCUS, Data Processing, Storage, Mentorship, Workflow, Orchestration, BMC Control-M, Apache Kafka, Streaming, Change Data Capture, Apache HTTP Server, Snow Flake Schema, Data Warehouse, Optimization, Regulatory Compliance, Auditing, Generative Artificial Intelligence (AI), Programming Languages, Java, Python, Cloud Computing, Amazon Web Services, Data Lake, Big Data, Apache Spark, Apache Parquet, Apache Avro, Data Engineering, Extract, Transform, Load, ELT, Data Modeling, Data Quality, Data Governance, Software Engineering, Continuous Integration, Continuous Delivery, Software Development, Code Review, Automated Testing, Artificial Intelligence, Insurance, Privacy, Marketing
Reference: Dice Id: cxjudgpa | Position Id: 1161731
- Bachelor's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
- 10+ years of experience in software engineering with significant focus on data engineering and distributed systems.
- Strong programming expertise in Java and Python.
- Experience designing and building enterprise-scale ETL/ELT platforms.
- Deep understanding of Apache Spark and distributed data processing concepts.
- Experience with AWS cloud services and cloud-native architectures.
- Proven experience with data lakes, lakehouse architectures, and large-scale data platforms.
- Experience working with Parquet, Avro, and related storage technologies.
- Experience leading technical initiatives and mentoring engineering teams.
- Demonstrated experience leveraging AI-assisted development tools within software engineering workflows.
- Experience with workflow orchestration platforms such as Airflow, Dagster, or Control-M.
- Experience with streaming technologies including Kafka and Spark Structured Streaming.
- Knowledge of Change Data Capture (CDC), upsert strategies, and incremental processing frameworks.
- Experience with Delta Lake, Apache Iceberg, or Apache Hudi.
- Experience working with Snowflake or other cloud data warehouse technologies.
- Familiarity with FinOps and cloud cost optimization practices.
- Experience operating mission-critical systems in regulated environments.
- Understanding of compliance, audit, privacy, and PII governance requirements.
- Experience building or supporting Generative AI and Agentic AI solutions.
- Java
- Python
- AWS
- Data Lake / Lakehouse Architecture
- Apache Spark
- Parquet
- Avro
- ETL / ELT Development
- Data Modeling
- Data Quality
- Data Governance
- Data Lineage
- REST APIs
- CI/CD
- Automated Testing
- Observability
- Secure Coding
- AI-Assisted Software Development Tools
- AI Code Review and Test Automation
- Responsible AI Practices
- Start: flexible
- Remote: onsite
- Location: Columbus, OH, US, US
- Rate: 70-80 EUR/h
- Languages: English
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on Dice