Solutions Architect

About This Role

Serving as a trusted advisor to customers, the Solutions Architect guides them through their data engineering and data architecture needs, focusing on Databricks solutions. This role involves an even split between billable customer engagement and pre-sales support, designing and deploying comprehensive data solutions that capture, transform, and leverage data for AI, ML, and business intelligence initiatives.

Responsibilities

• Serve as a trusted advisor to customers, guiding them through their data engineering and data architecture needs with a focus on Databricks solutions
• Collaborate with sales teams to present technical solutions to prospective clients, demonstrating the value of SunnyData's offerings
• Manage multiple customer accounts, ensuring timely delivery of solutions and tracking progress to report outcomes
• Architect data solutions, incorporating best practices in data governance, security, and quality
• Evaluate data sources for their value, recommending data inclusion strategies to enhance analytical processes
• Lead internal teams, provide direction and mentorship to project teams to deliver solutions and educate end users on data products and analytic environments
• Perform system analysis, assess and resolve data and system defects, and apply appropriate corrections
• Test data movement, transformation code, and data components to ensure accuracy and reliability

Requirements

• 7+ years as a hands-on Solutions Architect and/or Senior Data Engineer designing and implementing data solutions with a focus on Databricks
• Expertise in Data Engineering technologies (e.g., Spark, Hadoop, Kafka), Databricks platform, and data science/machine learning technologies (e.g., pandas, scikit-learn)
• In-depth understanding of the end-to-end data analytics workflow (e.g., data modeling, ETL processes, and data integration) using modern data engineering techniques
• Ability to lead complex architecture requirements (discovery), solution design sessions, and build out implementation architecture blueprints that can be implemented by data-engineering and analytics teams
• Proficiency in Java, Python, and/or Scala
• Experience with AWS, Azure, and/or GCP
• Ability to write, debug, and optimize SQL queries
• Strong written and verbal communication skills with experience in client-facing roles
• Ability to create and deliver detailed presentations to clients and stakeholders
• Experience in creating detailed solution documentation including POCs, roadmaps, sequence diagrams, class hierarchies, and logical system views
• Experience leading teams and mentoring other engineers
• Ability to develop end-to-end technical solutions into production, ensuring performance, security, scalability, and robust data integration
• Bachelor’s Degree in Computer Science or Engineering related field

Nice to have:

• Familiarity with cloud and distributed data storage systems such as S3, ADLS, HDFS, GCS, Kudu, ElasticSearch/Solr, Cassandra, or other NoSQL storage systems
• Experience with data integration technologies like Spark, Kafka, Streamsets, Matillion, Fivetran, NiFi, AWS Data Migration Services, Azure DataFactory, and Informatica Intelligent Cloud Services (IICS)
• Comprehensive experience with the complete software development lifecycle including design, documentation, implementation, testing, and deployment
• Expertise in automated data transformation and curation using tools like dbt, Spark, Spark streaming, and automated pipelines
• Experience with workflow management and orchestration tools like Airflow, AWS Managed Airflow, Luigi, and NiFi
• At least 2 of the following certifications: Associate Developer for Apache Spark; Data Engineer Associate; Professional Data Engineer; Machine Learning Associate; Professional ML Engineer

Benefits

• Innovative environment: Work with cutting-edge technologies and industry leaders in data engineering and AI
• Customer impact: Make a real difference in how businesses leverage data for strategic decision-making
• Career growth: Opportunities for professional development and career advancement
• Collaborative culture: Join a supportive team that values collaboration and knowledge sharing

About the Company

SunnyData is a leading Databricks technology partner, empowering customers with scalable architectures, robust data engineering pipelines, seamless data consumption layers, and advanced ML and AI applications.