About This Role
Building and pioneering in the technology space is at the heart of the Data Engineer role at Capital One. You will solve complex business problems in a fast-paced, collaborative, and inclusive environment, driving major transformations across the company.
Responsibilities
- Collaborate with Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
- Influence a team of developers, data analysts, and data scientists with deep experience in machine learning, distributed microservices, lakehouse architecture, and full-stack systems
- Utilize programming languages such as Python and Spark, along with open-source relational and NoSQL databases, and cloud-based data warehousing platforms including Databricks and Snowflake
- Share your passion for staying on top of trends in data, experimenting with and learning new technologies, and mentoring other members of the data community
- Collaborate with product managers and software engineers to deliver robust cloud-first data solutions that drive powerful experiences for millions of Americans
- Independently design, build, and deliver world-class cloud data solutions and applications
- Architect and enforce common data engineering design patterns to ensure code quality, maintainability, and reusability across data platforms and pipelines
- Serve as an ambassador for the data engineering team, communicating technical concepts and data outcomes clearly to stakeholders
- Design and build data pipelines and platforms focusing on scalability, resilience, and operational efficiency
- Implement data security standards, ensuring compliance with data privacy regulations
Requirements
- Bachelor's Degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
- At least 4 years of experience in application development
- At least 2 years of experience in distributed data
- At least 2 years of experience with SQL
- At least 2 years of experience with one programming language (Python, Java, or Scala)
- At least 2 years of experience in data pipeline design and development
- At least 1 year of experience in data modeling and designing end-to-end data solutions using both relational and non-relational database systems
Nice to have:
- 7+ years of experience in application development with proficiency in Python, SQL, Scala, or Java
- 4+ years of hands-on experience designing, deploying, and operating data workloads in at least one public cloud environment (AWS, Microsoft Azure, or Google Cloud)
- 4+ years of experience building or supporting distributed data or compute workloads using tools such as EMR, Spark, Glue, or Databricks
