Required skills
Nice to have:Apache KafkaAmazon MSKXGBoostSHAPModel Context ProtocolLangfusePySparkDelta LakeAzure Blob Storage
Languages: English
Job description
Project overview
Data Scientist (ML / MLOps, AWS) | Remote | 12 month contract via Harvey Nash
You will:
- Develop and operate scalable data pipelines for structured and unstructured data (Python, PySpark, Delta Lake, Parquet, polars/pandas), integrating sources via AWS S3 and Azure Blob Storage
- Design data processing for machine learning, including feature engineering and graph construction from tabular data for Graph Neural Network models (GraphStorm, DGL, PyTorch)
- Build and extend graph databases on Amazon Neptune (Gremlin), including data modelling and bulk loading of large datasets
- Design and optimize relational database solutions on Amazon Aurora, RDS and PostgreSQL
- Build and run automated data and ML pipelines on AWS SageMaker: processing and training jobs, hyperparameter optimization and Model Registry integration
- Develop and integrate production ML components based on Graph Neural Networks and gradient boosting (XGBoost), including inference endpoints and explainability (SHAP)
- Build data and inference interfaces with AWS Lambda, API Gateway and Step Functions, and event-driven processing with Kafka/MSK
- Automate infrastructure with Infrastructure as Code (CloudFormation, Pulumi) and maintain CI/CD in GitLab
- Integrate AI agent systems, including Model Context Protocol (MCP) and observability with Langfuse
- Create dashboards and visualizations (Grafana, Plotly) to monitor pipelines and model results
- Ensure quality, performance and documentation under existing governance and compliance requirements
Requirements
- Production experience with GraphStorm or DGL, including graph construction and data processing
- Production experience with AWS SageMaker (pipelines, processing and training jobs, Model Registry, production endpoints), 3+ years
- Professional experience in Data Engineering and/or MLOps with productively operated data and ML solutions
- Hands-on experience with Infrastructure as Code using AWS CloudFormation or Pulumi
- Proven experience building and running automated data pipelines for structured and unstructured data in production
- Fluent English
Nice to have
- Event streaming with Apache Kafka or AWS MSK
- XGBoost in production ML processes
- Explainable AI (SHAP) in production
- AI agent systems, MCP and Langfuse
- PySpark and Delta Lake, data integration via S3 and Azure Blob Storage
Project details
- Start: flexible
- Remote: remote
- Location: Warszawa, Stanisława Żaryna 2B, PL
- Rate: 170-190 EUR/h
- Languages: English
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on justjoin.it