About the role
Role & responsibilities
- Develop and maintain data pipelines using AWS Glue, Lambda, EMR, and Snowflake.
- Implement real-time ingestion using Snowpipe and Streams for CDC (Change Data Capture).
- Write efficient PySpark or Scala Spark jobs for large-scale data processing.
- Automate workflows and orchestrate jobs using AWS Step Functions, Airflow, or similar tools.
- Optimize Snowflake queries and warehouse performance.
- Collaborate with Data Scientists, Analysts, and DevOps teams to deliver reliable data solutions.
- Monitor and troubleshoot data pipeline failures and latency issues.
Preferred candidate profile
- Strong experience with Snowflake architecture, SQL, and performance tuning.
- Hands-on expertise in AWS Glue, Lambda, S3, EMR, and CloudWatch.
- Proficiency in Apache Spark (PySpark or Scala).
- Familiarity with Snowpipe, Streams, and Tasks in Snowflake.
- Knowledge of CI/CD tools and infrastructure-as-code (Terraform, CloudFormation).
Experience with version control (Git) and agile development practices
Millions of jobs, with real people getting hired every day
20,000+
New jobs added daily7,000,000+
Verified job listings500,000+
Tailored applications submittedFAQ
Questions, answered
Click "Apply with JobAssist" – we tailor your resume and application to this role and submit it for your approval.
Yes. This role at SP Software was screened before publishing – we confirmed the employer before listing it.
The employer didn't disclose a salary range for this listing. JobAssist shows pay whenever it's available.
This position can be done from anywhere, with no in-office requirement.
Yes – every application is tailored from your profile and this job's requirements, and you can review and edit before it's sent.