About the role
Roles and Responsibilities :
- Design, develop, test, deploy and maintain large-scale data pipelines using Data Bricks, Snowflake, Spark Streaming and other technologies.
- Collaborate with cross-functional teams to gather requirements and design scalable data architectures that meet business needs.
- Develop complex SQL queries to extract insights from massive datasets stored in Snowflake database.
- Troubleshoot issues related to data processing pipeline failures and optimize performance for improved efficiency.
Job Requirements :
- 6-13 years of experience in Data Engineering with expertise in Data Bricks, Snowflake, Spark Streaming.
- Strong understanding of generative AI models such as Vertex AI's retrieval augmented generation (RAG) technology.
- Experience working with large language models like Neo4J or similar tools is an added advantage.
- Proficiency in PySpark programming language.
Millions of jobs, with real people getting hired every day
20,000+
New jobs added daily7,000,000+
Verified job listings500,000+
Tailored applications submittedFAQ
Questions, answered
Click "Apply with JobAssist" – we tailor your resume and application to this role and submit it for your approval.
Yes. This role at The Hartford was screened before publishing – we confirmed the employer before listing it.
The employer didn't disclose a salary range for this listing. JobAssist shows pay whenever it's available.
This position can be done from anywhere, with no in-office requirement.
Yes – every application is tailored from your profile and this job's requirements, and you can review and edit before it's sent.